Physician (MD/DO) - Medical AI Evaluation

What this opportunity involves We re looking for actively practicing, US-licensed physicians (MD/DO) living outside the US, with an active, unrestricted US medical license, to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. On this project, contributors may: • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor trap answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems; • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality; • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales; • What we look for This opportunity is a good fit for US-licensed physicians living outside the US who are looking for a flexible, time-limited project they can fit around clinical practice. Ideally, contributors will have: • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly); • Board certification or completed residency training, with recent direct patient care (attending-level preferred); • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine); • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines; • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus); • Strong written English (C1+). This opportunity is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.