In this hourly, remote contractor role, you will work as a Medical Doctor (Specialist) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert medical content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to the prompt; identify errors in clinical methodology, differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning; fact-check medical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality.
Board-certified/board-eligible specialists across a range of fields, including but not limited to Internal Medicine, Family Medicine, Emergency Medicine, Pediatrics, OB/GYN, Cardiology, Neurology, Psychiatry, General Surgery, Anesthesiology, Critical Care, Radiology, Oncology, Dermatology, Orthopedics, Gastroenterology, Pulmonology, Nephrology, Endocrinology, Infectious Disease, and Pathology are welcomed.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.
Important
There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
Key Responsibilities
- Develop AI Training Content: Create detailed prompts and gold-standard answers across clinical topics aligned to your specialty, ensuring accuracy and appropriate scope.
- Optimize AI Performance: Evaluate and rank AI responses to enhance correctness, safety, clarity, and contextual relevance.
- Ensure Model Integrity: Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across use cases and patient populations.
Your Profile
- MD/DO (or equivalent) with completed specialty training (residency/fellowship as applicable) and board eligibility/certification (or local equivalent).
- 5+ years of post-training clinical experience in a specialty setting (hospital, outpatient, academic, or community practice).
- Confident in advanced clinical reasoning: differential diagnosis, triage, red flags, and escalation pathways appropriate to specialty practice.
- Strong understanding of disease processes, guideline-based care, diagnostic pathways, and patient-safety considerations within your specialty.
- Exceptional attention to detail when fact-checking clinical content and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results; minimum C1 English proficiency.
- Comfortable evaluating answers for internal consistency (timelines, physiology, dosing/contraindications where relevant), appropriateness for setting (ED vs inpatient vs outpatient), and risk/benefit tradeoffs.
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Prior experience with AI data training/annotation, guideline work, utilization review, clinical documentation review, or healthcare editorial QA is strongly preferred.
