Research Scientist (Measurement and Evaluation)
Job description
About the role
You will own the design and execution of empirical studies that assess how ambient AI reshapes patient outcomes, care quality, and provider experience in real clinical settings. You will translate abstract constructs such as quality of care, safety, and cognitive burden into measurable indicators using principled frameworks. You will partner directly with health systems to implement large-scale evaluations grounded in linked evidence from real-world conversations. Your analyses will map AI-generated summaries against ground truth to quantify trust, verification speed, and downstream clinical decision-making. You will operationalize complex metrics into rigorous experimental or quasi-experimental designs that withstand scientific scrutiny. Your work will feed directly into model development and product strategy, ensuring that measurement drives iteration. You will contribute to the broader scientific literature on how AI systems affect stakeholders across the care continuum. This role demands comfort with ambiguity and a commitment to methodological rigor where it matters most for patient care.
Key facts
What you'll do
- Design and conduct multi-site evaluations of Abridge models and products across diverse clinical workflows.
- Build and maintain collaborative relationships with external researchers to advance the evidence base for ambient AI in healthcare.
- Synthesize rich qualitative insights into a strong user-centric and patient-centric mindset, capturing the lived experience of providers and patients.
- Partner with product and engineering teams to align research questions with the current product roadmap and emerging model capabilities.
- Produce detailed technical reports and deliver compelling presentations to both internal and external stakeholder audiences.
- Contribute original findings to the wider research community through publications in leading peer-reviewed journals and conferences.
- Lead the development of measurement frameworks that translate abstract constructs into valid and reliable indicators.
- Mentor research interns and junior analysts, fostering a culture of scientific curiosity and rigorous inquiry.
- Coordinate data sharing agreements and governance structures to enable responsible use of large-scale clinical conversation data.
- Challenge existing assumptions by pushing methodological frontiers to address high-stakes problems in health systems, providers, and patient outcomes.
Requirements
- Hold a PhD in statistics, biostatistics, computer science, economics, information systems, clinical informatics, or a related field.
- Demonstrate expertise in rigorous quantitative or mixed-methods approaches for conducting evaluations using observational and experimental data.
- Maintain a strong research track record with high-impact publications in peer-reviewed journals or top-tier conferences.
- Exhibit a problem-first mindset where you prioritize real-world problems before selecting or inventing methods.
- Show a curious, adaptable, and proactive disposition suited to thriving in a fast-paced startup environment.
- Demonstrate deep passion for and understanding of Abridge's mission to transform healthcare through AI that enhances human connection.
- Commit to working from our New York City office a minimum of three times per week under a hybrid work model.
- Accept that relocation assistance is available for candidates who move to New York City to join the team.
- Uphold the highest standards of scientific rigor, transparency, and credibility in all research activities.
- Align with the company's values of empathy, responsibility, and trust in every interaction with partners and stakeholders.
Nice to have
- Prior experience publishing work that evaluates AI systems in clinical or healthcare delivery settings.
- Familiarity with linked evidence frameworks and auditable AI concepts in healthcare applications.
- Experience working with electronic health record data and clinical documentation workflows.
- Knowledge of regulatory and compliance considerations relevant to AI in healthcare.
- Track record of securing external funding or grants for research initiatives.
- Experience mentoring junior researchers and contributing to collaborative team science.
Practical notes
This position requires a commitment to work from our New York City office at least three times per week. You will operate within a hybrid schedule that supports both in-person collaboration and remote focus. Relocation assistance is available for candidates who are willing to move to New York City. The role is full-time and aligned with the expectations of a fast-growing, mission-driven organization.