skills/medical-blueprint-builder/references/medical-education-methodology.md

# Medical Blueprint Builder — Medical Education Blueprint Methodology

## 1. Purpose
This file provides the educational methodology behind curriculum, course, rotation, and examination blueprints.

Use it when the user asks for:
- CLO / LO design
- curriculum or module blueprint
- rotation objectives
- assessment blueprint
- MCQ / SBA / OSCE planning
- weighting of content and cognitive levels
- constructive alignment
- competency-based education
- revision of an existing syllabus or course

The goal is not to add educational terminology for its own sake. Use only the concepts that improve alignment, prioritization, measurability, and clinical relevance.

Core educational sequence:

Needs → Outcomes → Competencies → Learning activities → Assessment → Feedback → Reassessment

For clinical education, also preserve:

Recognition → Reasoning → Decision → Action → Reassessment

A strong blueprint aligns both sequences.

---

## 2. Outcome hierarchy: Goal, CLO, LO, competency

### 2.1 Overall goal
A broad statement of what the course, rotation, or module is intended to achieve.

Example:
“Prepare junior pediatric residents to assess and manage common and high-risk gastrointestinal presentations safely.”

The overall goal guides direction but is usually too broad for direct assessment.

### 2.2 Course Learning Outcome (CLO)
A CLO describes what the learner should be able to demonstrate by the end of a course, module, rotation, or defined learning unit.

A useful CLO should be:
- learner-centered
- observable or assessable
- clinically meaningful
- appropriate to learner level
- broad enough to integrate several lessons
- specific enough to guide assessment

Preferred pattern:

By the end of [course/rotation], the learner should be able to + action + clinical context + expected level.

Example:
“By the end of the pediatric GI rotation, the learner should be able to evaluate a child with gastrointestinal bleeding, identify instability and major etiologic groups, select appropriate initial investigations, and initiate safe first-line management.”

### 2.3 Learning Objective / Lesson Outcome (LO)
An LO is narrower than a CLO and usually applies to a lesson, topic, session, or sub-competency.

Example LOs under the CLO above:
- Recognize clinical features of significant blood loss.
- Distinguish likely upper from lower gastrointestinal bleeding using history and examination.
- Select initial laboratory tests according to clinical severity.
- Identify indications for urgent escalation or endoscopic evaluation.

### 2.4 Competency
Competency combines knowledge, interpretation, judgment, communication, and/or performance in a relevant context.

Competency is not merely “knowing.” It describes an ability that can be observed or inferred from performance.

Preferred structure:

Learner should be able to + observable action + context + standard / safety condition.

Example:
“Learner should be able to prioritize stabilization and escalation in a child with active GI bleeding and hemodynamic compromise.”

### 2.5 Practical distinction
Use:
- Goal for overall direction.
- CLO for end-of-course or end-of-rotation outcomes.
- LO for individual teaching units or subdomains.
- Competency when the emphasis is on real-world performance.

Do not create multiple layers merely for formality. For a short teaching session, LO alone may be sufficient.

---

## 3. Constructive alignment

The core rule:

What learners are expected to do must match what they practice and what they are assessed on.

Alignment chain:

Outcome → Learning activity → Assessment → Feedback

Example:

Outcome:
“Interpret clinical and laboratory findings to determine severity of acute pancreatitis.”

Poor alignment:
- teaching activity: passive lecture only
- assessment: recall definition of pancreatitis

Better alignment:
- teaching activity: case-based severity classification
- assessment: clinical vignette requiring interpretation and risk decision

Before finalizing a blueprint, ask:
1. Is every important outcome taught or practiced?
2. Is every important outcome assessed appropriately?
3. Is the assessment testing the intended level rather than a lower level?
4. Are low-priority facts consuming disproportionate teaching or examination time?

---

## 4. Cognitive levels: use Bloom pragmatically

Bloom-type cognitive levels may help distinguish superficial recall from clinical application.

Use a practical clinical adaptation rather than rigid taxonomy:

### Recall
Retrieve a fact, definition, criterion, or association.

Examples:
- identify a definition
- recall a major adverse effect
- name a diagnostic criterion

### Understand
Explain meaning, mechanism, relationship, or rationale.

Examples:
- explain why dehydration alters laboratory findings
- compare mechanisms of two disorders

### Interpret
Make sense of clinical data.

Examples:
- interpret a laboratory pattern
- interpret growth trajectory
- interpret imaging findings

### Apply
Use knowledge in a concrete but relatively straightforward scenario.

Examples:
- apply a diagnostic criterion
- select an appropriate investigation

### Analyze / Clinical reasoning
Integrate multiple findings, distinguish alternatives, or manage uncertainty.

Examples:
- compare competing diagnoses
- identify the most discriminating clue
- revise a working diagnosis after new information

### Decide
Choose and justify the next action.

Examples:
- next best investigation
- next best treatment
- escalation decision
- discharge versus admission

Do not assign high cognitive labels just because the question is difficult. A difficult recall question is still recall.

---

## 5. Miller framework for clinical competence

For performance-based clinical education, use Miller’s progression pragmatically:

Knows → Knows how → Shows how → Does

### Knows
Essential knowledge.

Possible assessment:
- selected-response questions
- short-answer questions

### Knows how
Application and clinical reasoning.

Possible assessment:
- SBA/MCQ clinical vignettes
- key-feature questions
- case-based discussion

### Shows how
Demonstrated performance in a controlled setting.

Possible assessment:
- OSCE
- simulation
- structured procedural station

### Does
Performance in real clinical practice.

Possible assessment:
- workplace-based assessment
- direct observation
- mini-CEX
- case-based discussion
- procedure-based assessment
- longitudinal supervisor judgment

Do not use an MCQ to claim direct assessment of procedural performance or real-world professionalism.

---

## 6. Integrating cognitive and performance frameworks

Bloom-type levels answer:
“What kind of thinking is required?”

Miller-type levels answer:
“How close is the assessment to real clinical performance?”

They are complementary, not interchangeable.

Example:
A learner may perform high-level diagnostic reasoning in a written case (“knows how”) but still not demonstrate bedside execution (“shows how” or “does”).

For complex clinical competencies, blueprint across both dimensions when useful.

Suggested matrix:

Competency | Cognitive demand | Performance level | Assessment method

Example:
Recognize shock | Interpretation | Knows how | SBA
Initiate shock management | Decision | Shows how | Simulation/OSCE
Manage shock safely during duty | Decision + action | Does | Workplace assessment

---

## 7. Writing good CLOs and LOs

### 7.1 Use observable verbs
Prefer:
recognize, identify, interpret, distinguish, prioritize, select, justify, perform, communicate, reassess, escalate

Avoid vague verbs when assessment is expected:
know, learn, understand, appreciate, be familiar with

“Understand” may be acceptable in explanatory prose, but measurable outcomes should usually use a more observable verb.

### 7.2 One outcome should not contain too many unrelated actions
Poor:
“Understand the epidemiology, pathophysiology, diagnosis, treatment, communication, and research of inflammatory bowel disease.”

Better to separate into a few integrated outcomes.

### 7.3 Match complexity to learner level
Early learner:
recognize, explain, identify, describe

Clinical student:
interpret, apply, distinguish, select

Resident:
prioritize, decide, manage, reassess, escalate

Advanced learner:
justify trade-offs, manage uncertainty, critique evidence, adapt recommendations

### 7.4 Include context when it matters
Weak:
“Interpret liver tests.”

Better:
“Interpret common liver-test patterns in children and use them to guide the initial differential and next investigation.”

### 7.5 Add standards only when useful
Example:
“Perform initial stabilization of a child with upper GI bleeding using a structured ABC approach and identify indications for urgent senior/endoscopic escalation.”

---

## 8. Blueprint domains

For a clinical course or exam, content can be organized across several dimensions.

### Content dimension
Examples:
- diseases
- presentations
- organ systems
- procedures
- longitudinal care

### Clinical-task dimension
Examples:
- recognition
- diagnosis
- investigation
- management
- prevention
- communication
- reassessment

### Cognitive dimension
Examples:
- recall
- interpretation
- application
- reasoning
- decision-making

### Priority dimension
Examples:
- critical
- high
- moderate
- low

### Context dimension
Examples:
- emergency
- outpatient
- inpatient
- ICU
- preventive care

### Learner-performance dimension
Examples:
- observe
- assist
- perform under supervision
- perform independently within scope

Do not build a multidimensional matrix unless it improves the actual course or assessment design.

---

## 9. Weighting logic

Weighting should reflect educational and clinical importance, not simply the number of pages in a textbook or lecture duration.

Consider five main factors:

### 9.1 Frequency
How often will the learner encounter this problem?

### 9.2 Clinical consequence
What is the harm if the learner misses it?

### 9.3 Decision importance
Does the topic require meaningful diagnostic or management decisions?

### 9.4 Core competency relevance
Is this essential to the learner’s expected role?

### 9.5 Educational leverage
Does learning this improve performance across multiple related problems?

A common rare emergency may deserve greater weighting than a frequent but low-consequence fact.

### Suggested qualitative weighting
Use:
- Critical
- High
- Moderate
- Low

### Suggested quantitative weighting
Only use percentages when the user needs a table of specifications or exam plan.

If no official blueprint exists, label explicitly:
“Proposed weighting” or “Suggested weighting.”

Do not present proposed percentages as authoritative.

### Optional reasoning model
When the user wants a transparent design process, reason qualitatively from:

Priority ≈ frequency + danger + decision impact + competency relevance

This is a conceptual model, not a validated scoring formula.

---

## 10. Table of Specifications (TOS)

Use a TOS when a formal assessment blueprint is requested.

A basic TOS cross-links:

Content domain × Cognitive level

Example columns:

Domain | Learning outcome | Priority | Recall | Interpretation | Application/Reasoning | Decision-making | Total items

For clinical exams, a more useful matrix may be:

Domain | Recognition | Diagnosis | Investigation | Management | Reassessment | Proposed items

The TOS should ensure:
- representative sampling of important content
- appropriate cognitive distribution
- avoidance of over-testing trivial facts
- consistency with course outcomes

### Item allocation workflow
1. Define total number of items.
2. Establish proposed content weighting.
3. Establish desired cognitive emphasis.
4. Allocate items to high-priority cells first.
5. Check that critical domains have enough sampling.
6. Remove cells that would create artificial or low-value questions.
7. Check total items and rebalance.

Do not force every cell to contain an item.

---

## 11. Assessment-method selection

Choose the assessment method according to the intended outcome.

### MCQ / SBA
Best for:
- broad sampling
- interpretation
- clinical application
- diagnostic reasoning
- next-best-step decisions

Less suitable for:
- actual procedural performance
- nuanced communication performance
- real-world professionalism

### Key-feature questions
Useful for:
- critical decisions
- common clinical errors
- management sequences
- selective reasoning rather than exhaustive case recall

### OSCE
Best for:
- structured clinical performance
- examination skills
- counseling
- communication
- data interpretation with action
- emergency or procedural simulation

### Simulation
Best for:
- rare/high-risk events
- teamwork
- emergency prioritization
- dynamic reassessment

### Workplace-based assessment
Best for:
- real-world integration
- clinical judgment
- communication
- professionalism
- longitudinal performance

### Portfolio / reflective evidence
Useful when the outcome concerns:
- longitudinal development
- reflection
- repeated clinical exposure
- evidence of progressive competence

Avoid choosing an assessment simply because it is easy to administer.

---

## 12. Assessment blueprint quality

A good assessment blueprint should support:

### Content validity
Does the assessment sample the intended domain appropriately?

### Cognitive validity
Does it test the intended thinking level?

### Clinical authenticity
Does the task resemble meaningful clinical work where appropriate?

### Safety relevance
Are high-consequence decisions represented?

### Fairness
Is the assessment aligned with what learners were expected and enabled to learn?

### Sampling
Is performance judged from enough items, cases, stations, or observations to avoid excessive dependence on a single encounter?

Do not claim psychometric reliability from blueprint structure alone.

---

## 13. Exam cognitive distribution

There is no universal ideal percentage distribution.

For clinically oriented exams, generally avoid excessive recall. A proposed blueprint may emphasize:
- interpretation
- application
- clinical reasoning
- decision-making

while retaining enough recall to test essential foundational facts.

When proposing percentages:
1. Tailor to learner level.
2. Tailor to purpose of exam.
3. Label percentages as proposed unless official.
4. Explain the rationale briefly.

Example logic:
For junior residents, management decisions and reassessment usually deserve greater emphasis than isolated factual recall.

Do not copy the same cognitive distribution across all courses.

---

## 14. Clinical reasoning as an assessable outcome

Clinical reasoning should be blueprintable rather than treated as an invisible general skill.

Potential reasoning targets:
- problem representation
- illness-script recognition
- discriminating features
- prioritized differential
- test-selection logic
- probability revision
- severity assessment
- next-step decisions
- response-to-treatment interpretation
- escalation

Assessment should focus on key decisions rather than requiring the learner to reproduce every possible reasoning step.

---

## 15. Must-not-miss integration into education design

Safety-critical content should influence:
- CLOs
- teaching emphasis
- simulation scenarios
- exam items
- critical OSCE actions
- remediation thresholds

Examples:
- recognize hemodynamic instability
- identify a contraindication
- initiate stabilization
- identify treatment failure
- escalate care

A must-not-miss item should not be buried among low-priority facts.

For OSCE/simulation, distinguish:
- expected actions
- critical actions
- critical errors

Critical errors should be reserved for actions or omissions with meaningful safety consequences.

---

## 16. Curriculum sequencing and scaffolding

For multi-session courses, order content by dependency and increasing clinical complexity.

Typical progression:

Foundation → Recognition → Interpretation → Reasoning → Decision → Performance → Reassessment

### Foundation
Terminology and mechanisms that are needed for later reasoning.

### Recognition
Classic presentations, red flags, patterns.

### Interpretation
Labs, imaging, trends, severity markers.

### Reasoning
Differential diagnosis and investigation strategy.

### Decision
Management selection and prioritization.

### Performance
Procedures, counseling, communication, team actions.

### Reassessment
Treatment response, failure, escalation, follow-up.

Use spiral learning when an important topic should reappear at greater complexity.

Example:
Medical student: recognize GI bleeding.
Junior resident: stabilize and investigate it.
Senior resident: manage refractory bleeding, uncertainty, escalation, and procedural planning.

---

## 17. Rotation blueprint methodology

A rotation should be built around what learners repeatedly encounter and are expected to do.

Start with:
1. Common presentations
2. High-risk emergencies
3. Core decisions
4. Required interpretation skills
5. Procedures
6. Communication tasks
7. Follow-up and reassessment

Then define expected level of participation:
- observe
- perform with direct supervision
- perform with indirect supervision
- independently perform within role/scope

Do not assign independence beyond the learner’s professional scope or local policy.

Rotation outcomes should reflect actual clinical opportunities. Do not make mastery of a rare procedure mandatory if the rotation cannot reliably provide exposure.

---

## 18. Entrustment-oriented thinking

When useful, frame a complex clinical responsibility as an integrated professional activity rather than fragmented objectives.

Example activity:
“Assess and initiate management of a child presenting with acute gastrointestinal bleeding.”

This may integrate:
- history and examination
- recognition of instability
- initial stabilization
- differential diagnosis
- investigations
- communication
- escalation
- reassessment

Use entrustment language carefully. Do not declare a learner independently competent based only on a written blueprint or single assessment.

---

## 19. Teaching-method alignment

Teaching should provide practice at the target level.

### For foundational knowledge
- concise lecture
- reading
- retrieval practice

### For recognition and interpretation
- image/data cases
- pattern-based cases
- worked examples

### For reasoning
- case-based discussion
- think-aloud reasoning
- compare-and-contrast cases
- illness-script exercises

### For decisions
- next-step cases
- branching scenarios
- management trade-off discussions

### For performance
- skills practice
- OSCE rehearsal
- simulation
- supervised clinical work

### For reassessment
- evolving cases
- follow-up scenarios
- treatment-response cases

Avoid relying only on lectures when the outcome requires performance or decision-making.

---

## 20. Feedback and reassessment

A blueprint is stronger when it includes how learners know whether they have improved.

Feedback should connect to:
- intended outcome
- observed performance
- gap
- corrective action
- reassessment

For high-stakes or safety-critical competencies, include a reassessment pathway after remediation.

Example:
Initial OSCE → targeted feedback → supervised practice → repeat station or workplace observation

---

## 21. Remediation logic

If a learner fails an important outcome:
1. Identify the specific competency gap.
2. Determine whether the gap is knowledge, interpretation, reasoning, decision, communication, or performance.
3. Provide targeted learning activity.
4. Reassess the same competency using an appropriate method.

Do not remediate every failure by assigning more reading.

---

## 22. Blueprint algorithm for the GPT

When asked to build an educational blueprint, follow this sequence unless a simpler output is better.

### Step 1 — Define the learner
Determine:
- level
- prior knowledge
- clinical role
- expected autonomy

### Step 2 — Define scope and purpose
Determine:
- course / session / rotation / exam
- duration
- clinical versus academic emphasis
- formative versus summative purpose

### Step 3 — Identify core clinical work
Ask:
“What should this learner actually be able to recognize, interpret, decide, perform, or reassess?”

### Step 4 — Draft outcomes
Create a small number of integrated CLOs, then LOs where useful.

### Step 5 — Prioritize
Classify:
- Must
- Should
- Nice
or
- Critical
- High
- Moderate
- Low

### Step 6 — Map cognitive/performance level
Use clinical cognitive levels and Miller-type performance levels when relevant.

### Step 7 — Choose learning activities
Match teaching methods to the target performance.

### Step 8 — Choose assessment
Match the assessment method to the outcome.

### Step 9 — Assign proposed weighting
Base weighting on frequency, danger, decision importance, and role relevance.

### Step 10 — Check constructive alignment
Verify:
Outcome ↔ Teaching ↔ Assessment

### Step 11 — Check safety
Ensure must-not-miss knowledge and actions are visible.

### Step 12 — Check feasibility
Ensure the blueprint fits available time, clinical exposure, assessment capacity, and learner level.

---

## 23. Default educational blueprint output

When the user asks for a course/module blueprint, a useful structure is:

1. Learner and context
2. Overall goal
3. CLOs
4. Topic / domain map
5. Priority map
6. LO or competency matrix
7. Teaching-learning methods
8. Assessment strategy
9. Proposed weighting
10. Must-not-miss competencies
11. Constructive alignment check
12. Suggested learning sequence

Do not force every section if the request is narrow.

---

## 24. Default competency matrix

Suggested columns:

Domain | Learner should be able to… | Priority | Cognitive level | Performance level | Teaching method | Assessment

Optional additional columns:
- clinical context
- prerequisite
- expected supervision
- critical error
- remediation method

Keep the matrix readable. Do not add columns that will remain empty or repetitive.

---

## 25. Default exam blueprint output

Suggested structure:

1. Exam purpose
2. Learner level
3. Assessed outcomes
4. Content domains
5. Proposed weighting
6. Cognitive distribution
7. Clinical-task distribution
8. Table of specifications
9. Suggested item formats
10. Must-not-miss / safety-critical content
11. Quality checks

For each proposed item category, specify what decision or competence it is intended to test.

---

## 26. Quality-control checklist

Before outputting an educational blueprint, verify:

### Outcomes
- Are outcomes learner-centered?
- Are they observable or assessable?
- Are there too many outcomes?
- Do they match learner level?

### Clinical relevance
- Is the course organized around meaningful clinical tasks?
- Are common and dangerous problems prioritized?
- Are decisions and reassessment represented?

### Alignment
- Does each major outcome have an appropriate learning activity?
- Is each major outcome assessed at the intended level?
- Is any high-level competency being tested only by low-level recall?

### Weighting
- Is high weighting justified by frequency, danger, decision impact, or role relevance?
- Are proposed percentages clearly labeled as proposals?

### Assessment
- Is the chosen method capable of assessing the intended outcome?
- Are safety-critical competencies sampled?
- Are enough observations/items planned for broad domains?

### Feasibility
- Does the design fit available teaching time?
- Can learners realistically obtain the required clinical exposure?
- Is assessment burden reasonable?

If not, revise before final output.

---

## 27. Common blueprint errors

### Error 1 — Content inventory instead of blueprint
A long list of textbook chapters is not a clinical blueprint.

Fix:
Convert content into learner outcomes and decisions.

### Error 2 — Too many low-level objectives
Dozens of small objectives fragment learning.

Fix:
Use a few integrated CLOs plus selected LOs.

### Error 3 — Misalignment
Outcome requires clinical reasoning, exam tests definitions.

Fix:
Raise assessment to the intended cognitive level.

### Error 4 — False precision in weighting
Percentages are presented as if validated or official.

Fix:
Label them as proposed and explain the basis.

### Error 5 — Assessment-method mismatch
Procedural competency assessed only with MCQ.

Fix:
Use demonstration or workplace assessment.

### Error 6 — Ignoring patient safety
Dangerous omissions receive the same emphasis as trivia.

Fix:
Explicitly identify must-not-miss competencies and critical errors.

### Error 7 — Excessive educational jargon
The blueprint becomes harder to use than the course itself.

Fix:
Use educational terminology only when it improves design or communication.

---

## 28. Final educational principle

A useful medical education blueprint should answer:

What must this learner be able to do?
Why does it matter clinically?
At what level should they perform?
How will they learn it?
How will we know they can do it?
What must they never miss?
What happens if performance is inadequate?

Optimize for:

Outcome → Practice → Assessment → Feedback → Reassessment

while preserving the clinical sequence:

Recognize → Interpret → Reason → Decide → Act → Reassess