Curriculum Test Generator – Architecture Diagrams
1. Main Orchestrator: curriculum-test-generator
Coordinates the entire test generation workflow in SEQUENTIAL order.
Flow: User Inputs (Workbook PDF + Test PDF) → Step 0-6 → Final Output
Sub-Agents Called:
- Step 2: curriculum-analyzer → curriculum_context.md
- Step 3: test-contents-extractor → ExtractedQuestions.md + images/
- Step 4: curriculum-aligned-question-generator → PDF + ANSWERS.md + new_images/
- Step 5: Extract Question Patterns → question_format_patterns.md
- Step 6: Present Results
2. curriculum-analyzer
Analyzes reference workbooks to extract curriculum context.
4-Step Workflow:
- Read the Workbook (PDF)
- Analyze Content Structure
- Document Curriculum Context
- Quality Verification
Output: curriculum_context.md with 8 sections (Topics, Formulas, Worked Examples, Difficulty Benchmarks, Solution Strategies, Common Patterns, Visual Diagram Patterns, Constraints)
3. test-contents-extractor
Extracts questions and diagrams from test PDF using DIAGRAM-FIRST approach.
6-Step Workflow:
- Step 0: Setup folders
- Step 1: Convert PDF to images
- Step 2: DIAGRAM-FIRST analysis
- Step 3: Vision-guided diagram extraction
- Step 4: OCR text extraction
- Final: Create ExtractedQuestions.md
Diagram Classification:
- Type A (Input): Student needs to answer
- Type B (Output): Student must create
- Type C (Reference): Context only
Skills: contents-extractor (convert_pages.py, extract_diagram.py, extract_text.py)
4. curriculum-aligned-question-generator
Generates FRESH test questions based on testing aspects.
3 Priority Sources:
- ExtractedQuestions.md (testing aspects)
- curriculum_context.md (knowledge range)
- question-variation-types skill (fallback)
8-Step Workflow:
- Create folders
- Read inputs
- Process questions
- Generate NEW diagrams
- Build test
- Answer images
- ANSWERS.md
- Final PDF
Skills: diagram-generator, test-pdf-generator, question-variation-types
5. Step 5: Extract Question Format Patterns (NEW PATTERN MANAGEMENT)
Discovers and adds NEW question format patterns to global library.
Flow:
- For each question → Identify FORMAT PATTERN
- Check: Does pattern EXIST in library?
- YES → SKIP
- NO → ADD to library!
Result: Pattern Library GROWS with each test processed.
Existing Patterns: Direct Recall, Calculation, Show/Prove, Solve Equation, Graph Sketch, Graph Reading, Context Translation, Multi-Part, Real-World Model, … (grows over time)
Summary
| Component | Input | Output |
|---|---|---|
| curriculum-test-generator | Workbook + Test PDF | Final test + answers |
| curriculum-analyzer | Workbook PDF | curriculum_context.md |
| test-contents-extractor | Test PDF | ExtractedQuestions.md + images/ |
| curriculum-aligned-question-generator | Both above | PDF + ANSWERS.md + new_images/ |
| Step 5 | ExtractedQuestions.md | question_format_patterns.md |