Skip to main content

A skill change that scored higher and missed a 7-day FDA report

The revised skill scored 92.5%, up from 87.5%. It also missed a life-threatening liver injury that FDA must hear about within 7 days. The release review caught it before the change shipped.

Overall score
87.5% → 92.5%

v3 in production, v4 proposed.

Cases that got worse
1 of 10

sae-02: a 7-day report routed to no report.

Decision
Needs work

Recorded by the drug safety physician (fictional).

Worked example. The sponsor, compound, study and case reports are fictional and contain no patient data. Agent outputs are illustrative. This is not a customer run or a hosted evaluation run.

How Versalist caught it

Four parts of Versalist, one review.

What the comparison shows

v4 gains 5 points by no longer filing the 4 reports that v3 files without needing to (sae-01, sae-03, sae-09, sae-10). It loses 3 on sae-02, the one required report it misses. The total rises from 35 to 37 of 40 points.

CaseCorrect routev3 (in production)v4 (proposed)
sae-01Diarrhea, grade 3No report15-day report · not required · 3/4No report · 4/4
sae-02Hepatocellular injury with jaundice7-day report7-day report · 4/4No report · missed · 1/4 (regression)
sae-03Death due to disease progressionNo report7-day report · not required · 2/4No report · 4/4
sae-04Femoral neck fracture after a fallNo reportNo report · 4/4No report · 4/4
sae-05Pneumonitis, grade 315-day report15-day report · 4/415-day report · 4/4
sae-06Rash maculo-papular, grade 2No reportNo report · 4/4No report · 4/4
sae-07Generalized tonic-clonic seizure15-day report15-day report · 4/415-day report · 4/4
sae-08Anaphylaxis7-day report7-day report · 4/47-day report · 4/4
sae-09Neutrophil count decreased, grade 3No report15-day report · not required · 3/4No report · 4/4
sae-10ALT and AST increased, grade 2No report15-day report · not required · 3/4No report · 4/4

The review flags expectedness as a regression (10 → 9 of 10). Causality looks unchanged at 9 of 10, but that nets out a case v4 fixed (sae-03) and one it broke (sae-02).

The case v4 gets wrong: sae-02

A trial participant develops jaundice on day 29, with liver enzymes above 12 times normal and no other cause found. That is a potential Hy’s Law case, which FDA treats as a strong signal of severe drug-induced liver injury. It needs a 7-day report, due .

v3 · in production

7-day report

Life-threatening. Not listed at this severity: the brochure lists aminotransferase increases to grade 2. The suspected viral cause was excluded on follow-up.

4/4

v4 · proposed

No report

Expected: the brochure lists ALT increased and AST increased, which are liver events. Not suspected: the investigator assessed the event as not related.

1/4

v4 sends the case to the monthly aggregate queue instead. FDA and the other trial investigators would not hear about it in time, while patients in the same cohort keep taking the drug.

Why v4 gets it wrong
  • Expectedness: “An event is expected if the investigator brochure lists an adverse reaction in the same organ system.”

    21 CFR 312.32(a) makes an event unexpected when it is not listed at the specificity or severity observed. Its own example: hepatic necrosis is unexpected if the brochure refers only to elevated hepatic enzymes or hepatitis.

  • Causality: “Use the investigator's causality assessment.”

    FDA's December 2025 guidance: the sponsor must report events for which the investigator's assessment is negative for causality but the sponsor's evaluation found evidence to suggest a causal relationship.

Lab values and the reporting clock

A 54-year-old woman with breast cancer that has not spread to her liver develops jaundice on day 29 of treatment. The investigator suspects viral hepatitis and reports the event as not related to the drug. Follow-up tests rule out viral, autoimmune and biliary causes, but the assessment is never updated.

TestScreeningDay 29× ULN
ALT22 U/L612 U/L15.3
AST25 U/L498 U/L12.5
Total bilirubin0.6 mg/dL4.1 mg/dL3.4
Alkaline phosphatase88 U/L162 U/L1.3
INR1.01.9—

Upper limits of normal (ULN): ALT 40 U/L, AST 40 U/L, total bilirubin 1.2 mg/dL, alkaline phosphatase 125 U/L.

The sponsor first received the report on , which starts the 7-day clock.

The decision

Needs work

Recorded by the drug safety physician (fictional) ·

Do not ship v4. It misses the 7-day report on sae-02. Keep the routing rule and the anticipated-SAE rule. Restore expectedness at the specificity and severity in the brochure. Make causality the sponsor's evaluation: consider the investigator's assessment, but do not adopt it. Keep v3 in production until the revision scores 4 of 4 on every case that needs an IND safety report.

The next revision runs on the same 10 cases against v3, so every change is judged by the same test.

The full case file

The regulation, the rule changes and every case, for reviewers who want to check the work.

The agent and the reporting rules

EX-101 is a fictional cancer drug in its first trial in people. When a trial site reports a serious adverse event, the sponsor’s safety agent decides whether FDA needs an IND safety report, and how quickly. A drug safety physician signs off every report before it is sent.

A report is required only when the event is serious, unexpected (the investigator brochure does not list it at that severity) and a suspected adverse reaction. The deadline depends on how severe the event is. On each case the agent makes those three calls plus the route, and each correct call scores one point.

RouteWhenDeadline
7-day IND safety report21 CFR 312.32(c)(2)Unexpected fatal or life-threatening suspected adverse reaction7 calendar days after the sponsor's initial receipt of the information
15-day IND safety report21 CFR 312.32(c)(1)(i)Any other serious and unexpected suspected adverse reaction15 calendar days after the sponsor determines that the information qualifies
No IND safety report21 CFR 312.33; 312.32(c)(1)(i)(C)The event is not serious, not unexpected, or not a suspected adverse reactionPeriodic reporting, such as the IND annual report. Anticipated SAEs go to aggregate analysis.

The rubric scores a wrong route the same way whether the agent files a report FDA did not need or misses one it did. Only the missed report breaks 21 CFR 312.32, which is why the review owner reads the case rows and not only the total.

What changed from v3 to v4

v3 is in production, and it over-reports. It files a 15-day report for every serious event the drug may have caused, even when the brochure already lists that reaction, and it treats every death as drug-related. v4 was written to stop filing reports that fail any of the three tests.

  • Expectedness

    v3An event is unexpected if the investigator brochure does not list it at the specificity and severity observed.

    v4An event is expected if the investigator brochure lists an adverse reaction in the same organ system.

  • Causality

    v3Treat the event as a suspected adverse reaction unless the report documents another cause.

    v4Use the investigator's causality assessment.

  • Routing

    v3Report every serious suspected adverse reaction within 15 calendar days. Treat every death as a suspected adverse reaction. Report deaths and life-threatening events within 7 calendar days.

    v4Report only events that are serious, unexpected and suspected: within 7 calendar days if fatal or life-threatening, otherwise within 15.

  • Anticipated events

    v3No rule.

    v4Do not report anticipated SAEs, such as death from disease progression, as individual cases. Send them to aggregate review.

Unchanged: seriousness.

All 10 test cases

Each case tests one rule, and every reference answer cites the regulation or FDA guidance it rests on. The investigator brochure lists these reactions, graded by CTCAE v5.0: diarrhea (grade 1–3), nausea (grade 1–2), vomiting (grade 1–2), fatigue (grade 1–2), rash maculo-papular (grade 1–2), alanine aminotransferase increased (grade 1–2), aspartate aminotransferase increased (grade 1–2), neutrophil count decreased (grade 1–3).

  • sae-01Diarrhea, grade 3Tests: a serious reaction the brochure lists at this gradeNo report
    Participant
    61-year-old man, metastatic colorectal cancer
    Dose and onset
    Cohort 3, 150 mg once daily, onset Day 15
    Received
    2026-09-02
    Site seriousness
    Hospitalization
    Investigator causality
    Related
    Narrative
    Seven or more watery stools a day above baseline from Day 15. Admitted for 3 days of IV fluids and loperamide. Stool culture and C. difficile toxin negative. EX-101 held. Diarrhea resolved by Day 19 and dosing resumed at 100 mg without recurrence.
    Reference answer
    No IND safety report. Serious: yes. Unexpected: no. Suspected: yes.Expected: the brochure lists diarrhea up to grade 3. An IND safety report needs all three criteria (21 CFR 312.32(c)(1)(i)). Include it in the IND annual report (21 CFR 312.33).
  • sae-02Hepatocellular injury with jaundiceTests: severity beyond the brochure listing, and an investigator assessment the evidence contradicts7-day report
    Participant
    54-year-old woman, metastatic breast cancer, bone-only disease, no liver metastases
    Dose and onset
    Cohort 4, 200 mg once daily, onset Day 29
    Received
    2026-09-08 (initial), 2026-09-10 (follow-up)
    Site seriousness
    Life-threatening; hospitalization
    Investigator causality
    Not related at the initial report (suspected acute viral hepatitis, serology pending). Not updated at follow-up.
    Narrative
    Jaundice and fatigue on Day 29. Admitted and EX-101 interrupted. Follow-up: hepatitis A IgM, hepatitis B surface antigen and core IgM, hepatitis C RNA and hepatitis E IgM negative. CMV and EBV PCR negative. Antinuclear and anti-smooth muscle antibodies negative. Doppler ultrasound shows no biliary dilation and patent hepatic vessels. No new concomitant medicines. Acetaminophen not detected. ALT fell to 395 U/L three days after interruption.
    Reference answer
    7-day IND safety report. Serious: yes. Unexpected: yes. Suspected: yes.Unexpected by severity: the brochure lists aminotransferase increases to grade 2 only (21 CFR 312.32(a)). Suspected: hepatic injury is informative as a single case, and no other cause was found (21 CFR 312.32(c)(1)(i)(A)). It is a potential Hy's Law case under FDA's DILI guidance: aminotransferases above 3 × ULN, bilirubin above 2 × ULN, no initial cholestasis and no other cause found. The sponsor must report even though the investigator assessed it as not related. Life-threatening, so the deadline is 7 calendar days from initial receipt (21 CFR 312.32(c)(2)).
  • sae-03Death due to disease progressionTests: an anticipated SAE that needs aggregate analysis, not an individual reportNo report
    Participant
    67-year-old man, metastatic pancreatic cancer
    Dose and onset
    Cohort 2, 100 mg once daily, onset Day 41
    Received
    2026-09-12
    Site seriousness
    Death
    Investigator causality
    Not related (progressive disease)
    Narrative
    CT on Day 35 showed new liver and peritoneal metastases and ascites, progressive disease by RECIST 1.1. EX-101 discontinued on Day 36. The patient entered hospice care and died on Day 41. No autopsy. No preceding adverse events above grade 2.
    Reference answer
    No IND safety report. Serious: yes. Unexpected: yes. Suspected: no.Unexpected because the brochure does not list it, but anticipated. FDA's December 2025 guidance names death due to progressive disease in an oncology trial as an example. Track it for aggregate analysis (21 CFR 312.32(c)(1)(i)(C)).
  • sae-04Femoral neck fracture after a fallTests: a serious, unexpected event with an established alternative causeNo report
    Participant
    72-year-old woman, metastatic non-small cell lung cancer
    Dose and onset
    Cohort 3, 150 mg once daily, onset Day 52
    Received
    2026-09-15
    Site seriousness
    Hospitalization
    Investigator causality
    Not related (mechanical fall)
    Narrative
    Slipped on a wet floor at home and fell onto her right hip. No dizziness, syncope or palpitations before the fall. Blood pressure and ECG normal on arrival. X-ray showed a displaced femoral neck fracture with no lytic lesion. Admitted for hemiarthroplasty.
    Reference answer
    No IND safety report. Serious: yes. Unexpected: yes. Suspected: no.A mechanical fall explains the event. No evidence suggests a causal relationship with the drug (21 CFR 312.32(a)).
  • sae-05Pneumonitis, grade 3Tests: a serious, unexpected suspected reaction that is not fatal or life-threatening15-day report
    Participant
    59-year-old man, metastatic cholangiocarcinoma
    Dose and onset
    Cohort 4, 200 mg once daily, onset Day 34
    Received
    2026-09-18
    Site seriousness
    Hospitalization
    Investigator causality
    Possibly related
    Narrative
    Progressive dyspnea and dry cough. Oxygen saturation 88% on room air. CT chest shows new bilateral ground-glass opacities. Respiratory viral panel, blood cultures and Pneumocystis PCR negative. No prior thoracic radiation or immune checkpoint inhibitor. EX-101 stopped. Improved on prednisone 1 mg/kg.
    Reference answer
    15-day IND safety report. Serious: yes. Unexpected: yes. Suspected: yes.Not listed in the brochure. Infection excluded, no other cause, onset on treatment. Not fatal or life-threatening, so the deadline is 15 calendar days (21 CFR 312.32(c)(1)(i)).
  • sae-06Rash maculo-papular, grade 2Tests: a non-serious, listed reactionNo report
    Participant
    46-year-old woman, metastatic gastric cancer
    Dose and onset
    Cohort 2, 100 mg once daily, onset Day 9
    Received
    2026-09-19
    Site seriousness
    None. Reported as an adverse event of special interest under the protocol.
    Investigator causality
    Related
    Narrative
    Maculo-papular rash on the trunk and arms covering about 20% of body surface area. Treated as an outpatient with topical corticosteroids. EX-101 continued at the same dose. No mucosal involvement, blistering or fever.
    Reference answer
    No IND safety report. Serious: no. Unexpected: no. Suspected: yes.No seriousness criterion met, and the brochure lists this rash at grade 2.
  • sae-07Generalized tonic-clonic seizureTests: seriousness without hospitalization: an important medical event15-day report
    Participant
    49-year-old woman, recurrent ovarian cancer
    Dose and onset
    Cohort 4, 200 mg once daily, onset Day 12
    Received
    2026-09-22
    Site seriousness
    None ticked. Emergency department visit, discharged the same day.
    Investigator causality
    Possibly related
    Narrative
    First-ever seizure at home, witnessed, about 2 minutes. In the emergency department, sodium 138 mmol/L, glucose 97 mg/dL and calcium normal. Brain MRI shows no metastases. Started on levetiracetam and discharged. No new concomitant medicines.
    Reference answer
    15-day IND safety report. Serious: yes. Unexpected: yes. Suspected: yes.Serious as an important medical event. The regulation names convulsions that do not result in hospitalization as an example (21 CFR 312.32(a)). Suspected: a first seizure is uncommon in this population, and there are no brain metastases, metabolic cause or seizure history (21 CFR 312.32(c)(1)(i)(B)).
  • sae-08AnaphylaxisTests: a life-threatening reaction that is informative as a single case7-day report
    Participant
    63-year-old man, metastatic renal cell carcinoma
    Dose and onset
    Cohort 5, 300 mg once daily, first dose, onset Day 1
    Received
    2026-09-24
    Site seriousness
    Life-threatening; hospitalization
    Investigator causality
    Related
    Narrative
    Forty minutes after the first dose: generalized urticaria, lip and tongue swelling, wheeze and blood pressure 72/40 mmHg. Treated with intramuscular epinephrine twice and IV fluids, and admitted overnight. Serum tryptase 31 µg/L at 1 hour. No other new exposure that day.
    Reference answer
    7-day IND safety report. Serious: yes. Unexpected: yes. Suspected: yes.Anaphylaxis is informative as a single case (21 CFR 312.32(c)(1)(i)(A)). Life-threatening, so the deadline is 7 calendar days from initial receipt (21 CFR 312.32(c)(2)).
  • sae-09Neutrophil count decreased, grade 3Tests: a listed reaction made serious by prolonging a hospital stayNo report
    Participant
    70-year-old man, metastatic cholangiocarcinoma
    Dose and onset
    Cohort 3, 150 mg once daily, onset Day 22
    Received
    2026-09-26
    Site seriousness
    Prolonged hospitalization
    Investigator causality
    Related
    Narrative
    Admitted for a planned biliary stent exchange. Admission absolute neutrophil count 0.7 × 10⁹/L. Afebrile throughout. Discharge delayed 2 days for monitoring. EX-101 held. Neutrophils recovered to 1.6 × 10⁹/L by Day 29.
    Reference answer
    No IND safety report. Serious: yes. Unexpected: no. Suspected: yes.Serious because it prolonged a hospitalization (21 CFR 312.32(a)). Expected: the brochure lists neutrophil count decreased up to grade 3.
  • sae-10ALT and AST increased, grade 2Tests: a liver event the brochure lists at this gradeNo report
    Participant
    57-year-old woman, metastatic colorectal cancer
    Dose and onset
    Cohort 4, 200 mg once daily, onset Day 21
    Received
    2026-09-29
    Site seriousness
    Hospitalization
    Investigator causality
    Related
    Narrative
    Routine labs: ALT 168 U/L (4.2 × ULN) and AST 150 U/L (3.8 × ULN). Total bilirubin 0.8 mg/dL and alkaline phosphatase normal. No symptoms. Admitted overnight for workup at the investigator's discretion. Viral serologies negative. EX-101 held. ALT 70 U/L (1.8 × ULN) by Day 28.
    Reference answer
    No IND safety report. Serious: yes. Unexpected: no. Suspected: yes.Expected: the brochure lists ALT and AST increased up to grade 2, and bilirubin stayed normal.

Download the case set (JSON)

Sources
  • Ten cases are a teaching set, not a validation set. A pilot uses your own past case reports, with your safety physician’s final calls as the reference answers.
  • It covers individual case reports under 21 CFR 312.32(c)(1)(i). It does not cover findings from other studies, animal or in vitro findings, increased rates of expected reactions, blinded studies, or the aggregate analyses themselves.
  • It is not regulatory advice.