Conduct quantitative evaluations of Abridge models and products using data from real-world deployments, offline evaluations, and customer feedback.
Develop and validate metrics that reflect meaningful outcomes for providers and patients — including assessing construct validity, characterizing measurement error, and surfacing selection bias in observational signals like user ratings and feedback.
Design and execute analyses that address the team's core research questions: validating automated evaluation frameworks against human judgment, characterizing heterogeneity in adoption and usage trajectories, estimating causal effects of ambient AI on clinical and operational outcomes, and extracting structured characterizations of clinical practice from unstructured conversation data.
Build deep familiarity with existing metrics and evaluation frameworks used at Abridge and beyond, interrogating underlying assumptions and proposing alternatives where appropriate.
Develop and maintain deep expertise in Abridge's data assets — including production data, user feedback signals, and clinical conversation data — and serve as the team's authority on data provenance, structure, and limitations for research studies.
Build, extend, and maintain the data pipelines that support internal and external research efforts, working across raw data sources to produce clean, well-documented, research-ready datasets.
Collaborate with Data Engineering and platform teams to ensure that the data the research team needs is accessible, reliable, and well-understood.
Collaborate closely with product, engineering, science, and data teams to ensure evaluation and analysis are credible, decision-relevant, and grounded in a deep understanding of product development and integration.
Partner with commercial teams, and liaise with customers through relationships owned by our Partner Experience organization, to ensure measurement and evaluation reflect how products are used and experienced in real-world practice.
Translate complex analyses into clear, nuanced narratives grounded in data, tailoring communication to different audiences and contexts.
Produce technical analyses, reports, and presentations that inform product decisions, guide strategy, and contribute to a rigorous evidence base for the real-world impact of ambient AI in healthcare.
