Table 4 Example prompts provided to Flan-T5 to perform zero-shot extraction of postpartum hemorrhage (PPH)-related concepts.

From: Zero-shot interpretable phenotyping of postpartum hemorrhage using large language models

Concept

Prompt

Direct mention of PPH

Answer the following yes/no question. Does the following discharge summary mention postpartum hemorrhage (PPH) during the current delivery? note: 〈note〉

Methylergonovine

Answer the following yes/no question. Does the following discharge summary mention the drug methergine (methylergonovine)? note: 〈note〉

Estimated blood loss

Extract the estimated blood loss (EBL) in the following discharge summary. If you cant́ find the answer, please respond “unanswerable". note: 〈note〉

Placenta accreta spectrum

Answer the following yes/no question. Does the following discharge summary mention placenta percreta during the current delivery? note: 〈note〉

 

Answer the following yes/no question. Does the following discharge summary mention placenta increta during the current delivery? note: 〈note〉

 

Answer the following yes/no question. Does the following discharge summary mention placenta accreta during the current delivery? note: 〈note〉

  1. We include prompts representative of different types of information retrieval (e.g. presence of a condition, presence of a drug, quantitative value extraction, and multi-prompt concept extraction). “〈note〉" refers to the full text of the note. If the entire note can not fit into a single context window of the model, the text is split into chunks, and the prompt is concatenated to each chunk separately and input into the model. The remaining prompts can be found in our accompanying Github repository.
  2. PPH postpartum hemorrhage, EBL estimated blood loss.