Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.
With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview We are seeking Physicists (PhD or Master's Degree) with strong background in upper-undergraduate Physics or beyond to design rigorous Physics problems used to train and evaluate frontier AI models.
This role focuses on creating realistic, exam-quality tasks that are solvable by humans yet challenging enough to expose failure modes in advanced language models.
Responsibilities: Design and curate upper-undergraduate and graduate-level Physics problems with fully worked, step-by-step solutions.
Create model-breaking tasks that resemble top university coursework but frequently fail frontier AI models.
Customize problem sets according to strict client specifications (SI units, LaTeX formatting, explicit constants, closed-form answers).
Convert multi-part or image-based textbook/exam questions into single, self-contained, text-only problems with one definitive answer.
Write clear, rigorous solution processes and verify consistency across question, reasoning, final answer, and units.
Evaluate model outputs, diagnose common failure modes, and iteratively refine problems to ensure difficulty without sacrificing solvability.
Review and quality-check Physics problems created by others, correcting issues in clarity, correctness, and formatting.
Collaborate with other trainers, reviewers, and project managers to maintain consistent quality at scale.
Commitments Required: 8 hours per day with an overlap of 4 hours with PST.
Employment type: Contractor assignment (no medical/paid leave) Duration of contract: 2 months (possible extention) Location: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico Selection process: Home Assignment + 15min interview Master’s degree or PhD in Physics or a closely related field.
Strong background in upper-undergraduate Physics or beyond.
Fluent English, with the ability to write precise and unambiguous scientific text.
Strong LaTeX proficiency for mathematical derivations and formatting.
Experience with university teaching, grading, exam design, or research involving analytical problem-solving.
Excellent attention to detail in units, constants, symbols, and notation.
Ability to sanity-check and recompute multi-step quantitative solutions.
Familiarity with modern AI/LLM concepts (e.
g., SFT, RLHF, evaluation) and interest in how training data shapes model behavior.
Physics Domain Expertise:  Basic Physics  Condensed Matter  Quantum  Computational  Applied  High Energy & Particle  Astrophysics