Clinical Trial Matching
Clinical Trial Matching is the NLP task of automatically determining whether a specific patient is eligible for a given clinical trial — parsing the complex eligibility criteria of trial protocols and matching them against structured and unstructured patient data from electronic health records, directly addressing the critical bottleneck that 85% of clinical trials fail to meet enrollment targets on time.
What Is Clinical Trial Matching?
- Problem: Every clinical trial defines inclusion criteria (conditions that qualify a patient) and exclusion criteria (conditions that disqualify a patient) — together averaging 30-50 criteria per trial.
- Scale: ClinicalTrials.gov lists 450,000+ registered trials, each with complex eligibility criteria written in medical language.
- Patient Data: EHR data includes ICD diagnosis codes, lab values, medications, procedure history, pathology reports, and clinician notes — structured and unstructured.
- Task: For a given (patient, trial) pair, classify as Eligible / Ineligible / Insufficient Information.
- Benchmark: n2c2 2018 Track 1 — 288 patients, 13 chronic disease criteria; TREC Clinical Trials 2021/2022 — information retrieval + eligibility classification.
The Eligibility Criteria Parsing Problem
A real trial exclusion criterion:
"Patients with prior treatment with any anti-PD-1, anti-PD-L1, anti-PD-L2, anti-CTLA-4 antibody, or any other antibody or drug specifically targeting T-cell co-stimulation or immune checkpoint pathways."
Parsing this requires:
- Entity Recognition: Anti-PD-1, anti-PD-L1, anti-CTLA-4 are drug class designations, not trade names.
- Semantic Scope: "Any other antibody specifically targeting T-cell co-stimulation" requires knowledge of immunology to operationalize — is nivolumab excluded? (Yes — anti-PD-1.) Is bevacizumab excluded? (No — anti-VEGF.)
- Temporal Logic: "Prior treatment" vs. "current treatment" vs. "within 28 days" — temporal scoping is critical.
- Negation and Exception Handling: "Unless washout period of ≥6 weeks has elapsed" — a disqualifying criterion transforms into a qualifying condition post-washout.
Technical Approaches
Rule-Based Systems: Manually author extraction rules for each criterion type. High precision, brittle, requires clinical informatics expertise.
Criteria2Query: Generate SQL or FHIR queries from natural language criteria — automates EHR lookup but requires robust NL-to-query translation.
BERT-based Classifiers:
- Fine-tune ClinicalBERT/BioBERT on (criteria text, patient fact) → eligible/ineligible pairs.
- n2c2 2018 best system: ~91% micro-F1 across 13 criteria types.
LLM-based Reasoning (GPT-4):
- Chain-of-thought over structured patient data and parsed criteria.
- Achieves ~85%+ on n2c2 but requires careful prompt engineering for logical connectives.
Performance (n2c2 2018 Track 1)
| System | Micro-F1 | Macro-F1 |
|---|---|---|
| Rule-based baseline | 75.4% | 70.2% |
| ClinicalBERT | 88.3% | 84.1% |
| Ensemble (top n2c2) | 91.8% | 88.7% |
| GPT-4 + CoT | 87.2% | 83.9% |
Why Clinical Trial Matching Matters
- Trial Enrollment Crisis: 85% of clinical trials fail to meet enrollment targets. Under-enrollment leads to underpowered trials, delayed approvals, and billions in wasted investment.
- Patient Access to Innovation: Many eligible patients who would benefit from experimental treatments are never identified — automated matching extends clinical trial access to patients whose physicians are not trial investigators.
- Site Selection: Sponsors can use automated patient screening to identify which clinical sites have sufficient eligible patient populations for efficient enrollment.
- Precision Enrollment: AI matching improves trial population homogeneity — enrolling patients who precisely meet criteria, not approximations, improves trial validity and reduces confounding.
- Rare Disease Trials: For rare diseases (prevalence <200,000), AI matching is essential — manual review of 10 million EHR records to find 50 eligible patients is infeasible without automation.
Clinical Trial Matching is the AI enrollment engine for clinical research — automating the analysis of complex eligibility criteria against patient health records at scale, directly addressing the enrollment crisis that delays development of new treatments for patients who need them.