MCQ Evidence Policy
This file defines how MCQs should be sourced, tagged, and trusted inside the PMDC NRE-I preparation system.
MCQ Evidence Policy
This file defines how MCQs should be sourced, tagged, and trusted inside the PMDC NRE-I preparation system.
Core rule:
Do not call a question PMDC/NRE-derived unless its source supports that claim.
Evidence Hierarchy
Tier 1: Real NRE recall evidence
- Ahmad’s own remembered questions.
- Confirmed personal exam recalls.
- Real recalled/leaked NRE papers already stored in the workspace.
Use tag:
NRE-recall-derived
Tier 2: NRE/PMDC-facing exam material
- PM&DC Mock.
- NRE Made Easy 1.
- NRE Made Easy 2.
- NRE50 System.
- Exam Intel reports.
- NRE-specific local QBank/mock tests.
Use tags:
PMDC-mock-derived
NRE-made-easy-derived
NRE50-derived
Exam-intel-derived
NRE-qbank-derived
Tier 3: FCPS overlap material
- Radiant Notes FCPS Pearls 10th Edition.
- FCPS Part 1-style banks/pearls when they overlap with NRE scope.
Use tag:
FCPS-overlap-derived
Tier 4: Official scope but original question
- Official syllabus topic.
- Generated from MedCORE topic sheet and standard undergraduate medical knowledge.
Use tag:
Syllabus-derived
Tier 5: General support
- USMLE-style references.
- General textbooks.
- Med student notes.
Use tag:
Concept-support
Required MCQ Metadata
Every MCQ JSON record should include:
{
"source_id": "",
"evidence_tag": "",
"evidence_tier": "",
"source_page": "",
"topic_slug": "",
"subject": "",
"chapter": "",
"question_id": "",
"stem": "",
"options": [],
"answer": "",
"explanation": "",
"tested_concept": "",
"cognitive_task": "",
"discriminator": "",
"trap_type": "",
"future_alert": "",
"verification_status": "unverified"
}
OCR Source Rule
For scanned books such as NRE Made Easy:
- OCR text is not final evidence by itself.
- Each extracted question must retain source page number.
- Any question used directly must be checked against the rendered page image.
- If OCR is uncertain, tag as
needs_review.
Allowed statuses:
raw_ocr
extracted_unverified
needs_review
verified
rejected
adapted_pattern_only
Generated MCQ Mix
For a standard 25-question topic drill:
8-10 NRE/PMDC-pattern questions when available
6-8 QBank/mock-style questions
5-7 syllabus-derived discriminator questions
2-4 integration/trap questions
If NRE/PMDC evidence is weak for a topic, say so in the source JSON and mark questions honestly.
Do Not Do
- Do not invent recalls.
- Do not claim a question came from PMDC/NRE if it was generated from the syllabus.
- Do not let FCPS overlap override actual NRE recall evidence.
- Do not include answer leakage in unsolved MCQ sheets.
- Do not mass-generate MCQs without evidence tags.