Trajectory Health AI emphasizes transparency and accountability in evaluating healthcare AI and population health initiatives. Trajectory, as an independent third party, requires program leaders to submit defined metrics, population data, and objectives to verify and validate both the initial and ongoing effectiveness of client programs.
Through a rigorous review process based on standards adopted by the Consumer Technology Association and the Population Health Impact Institute, Trajectory promotes evidence-based medicine in today’s rapidly changing environment. The Trajectory certification review process allows program sponsors and their clients to update and adjust their programs and devices in a timely fashion to support generally accepted standards of care and to ensure quality and effectiveness.
Transparency is “making clear” the objectives of the product, clarity of metric results and the definitions, the characteristics of populations in development, and other important revelations, all without violating important proprietary methods.
Pre-Market Verification involves the overview of relevant documentation—including population characteristics and completeness of underlying data and the design of the evaluation—that occurred during development and real-world deployment.
Post-Market Validation involves evaluating performance of models or programs in environments using real world data sets over time and across multiple settings and populations, conducting usability testing, and setting quality controls to monitor and address future changes in product use.
The TRC framework assesses how AI and healthcare programs are developed, tested, and initially deployed. This includes highlighting the methodology associated with the predictions or interventions and purported outcomes in pre-market populations.
The TRC framework helps implementation experts evaluate their model or program post-market, real-world situations, including a comparison to original model results and a plan for testing over time in different populations. A primary goal is to assess and validate the ongoing impact of the AI or healthcare program’s impact, including the robustness and clinical efficacy. The TRC assessment process also can be used as a way to address algorithm drift and program degradation.