Course 07 Implementation Spec: The "That's Not My Job" Audit
1. Title and Source Files Used
Course title: The "That's Not My Job" Audit
Owned output file: 07-not-my-job-audit/07_not_my_job_audit_course_content.md
Source files used as base truth:
07-not-my-job-audit/curriculum.md07-not-my-job-audit/website-prompt.md
Source-of-truth commitments for this spec:
- Preserve the core thesis: total ownership compounds; role conservatism shrinks careers.
- Preserve the 2-week, 5-session structure from the curriculum.
- Preserve the four core student outputs named or implied in the curriculum and website prompt:
- ownership interview writeup
- avoidance audit
- role boundary map
- personal expansion framework
- Preserve the central tension: healthy expansion is not the same thing as reckless overreach.
- Preserve the website prompt's tone: bold, high-contrast, culture critique with practical responsibility rather than anti-work posturing.
2. Design Decisions at the Top
Instructional design decisions
- The course is built around identity shift, not information transfer.
Students should leave with a changed decision rule, not just vocabulary about ownership culture.
- Case studies are used as proof-of-possibility, not hero worship.
Each story must be analyzed for conditions, tradeoffs, and failure risk so the course does not teach performative overextension.
- The personal audit is the center of gravity.
The interview project gives external evidence; the avoidance audit forces internal honesty. Session 4 therefore carries the highest emotional and developmental load.
- The course teaches bounded ownership.
The expansion-vs-overreach framework must appear in every session so students do not misread the course as "always do more."
- Assessment prioritizes specificity, judgment, and self-awareness over polish.
Students should not get top marks for persuasive generic writing with no evidence.
- The course is implementation-first.
Every session ends with an artifact or artifact draft. Students should never finish a class with only discussion notes.
Facilitation design decisions
- Facilitators should use a serious but slightly provocative tone.
The course works best when it feels like a critique of passive professional behavior, not a soft leadership seminar.
- Psychological safety must be explicitly created before the avoidance audit.
Students will be naming moments where they stayed silent, avoided action, or hid behind role language.
- Mixed-experience cohorts must be normalized.
Some students will have jobs; some will only have school, volunteer, family, or community roles. The facilitator should repeatedly define "role" broadly.
- Students must be pushed toward concrete examples.
Any answer that stays at the level of values, personality, or abstract ambition should be redirected into a real incident.
Experience and presentation design decisions
- Use the website prompt's visual language as a teaching motif.
The clean corporate surface, burning orange accent, and "slash through NOT" motif should be echoed in slides, worksheets, and prompts.
- Frame the course as an audit, not a motivational challenge.
Students are diagnosing reflexes, mapping boundaries, and building decision rules.
- Use repeated contrast pairs throughout materials.
Examples:
- lane staying vs system seeing
- responsibility vs martyrdom
- initiative vs interference
- expansion vs overreach
- temporary scope stretch vs permanent chaos
3. Delivery Model Assumptions
Cohort and setting assumptions
- Cohort size: 12 to 28 students
- Age range: 15 to 25
- Prior work experience: mixed; examples may come from jobs, school projects, sports teams, clubs, family businesses, churches, or community organizations
- Delivery window: 2 weeks
- Core meeting cadence: 5 live sessions x 90 minutes
- Async workload: approximately 3 to 4 hours total across the course
Live delivery assumptions
- Sessions are instructor-led and discussion-heavy.
- Students should work in rotating pairs and small groups of 3 to 5.
- A visible timer is required for pair shares, audit writing blocks, and presentations.
- Whiteboard, slides, or digital board should be available for synthesis.
Async delivery assumptions
- Students conduct one real interview outside class between Sessions 2 and 3.
- Students submit draft artifacts before Sessions 4 and 5 so facilitators can spot weak work early.
- Students may complete written reflections by hand, in docs, or in LMS text boxes, but final assessed artifacts should be typed.
Materials and tools assumptions
- Core materials:
- slide deck
- interview guide handout
- role boundary map template
- avoidance audit worksheet
- expansion framework template
- presentation template
- Optional digital tools:
- shared doc or LMS
- polling or form tool for entry diagnostics
- AI/LLM evaluator for first-pass scoring and feedback
Accessibility and inclusion assumptions
- Students may not currently hold formal jobs; all prompts should allow school, family, and community examples.
- Students may not have easy access to senior professionals; acceptable interviewees include parents, relatives, supervisors, coaches, older peers, or community leaders with meaningful responsibility.
- If a student cannot secure a live interview, the fallback is one published interview plus a short reflection on its limits. This fallback should pass the course but should not automatically earn top marks.
Safety and culture assumptions
- The facilitator explicitly states that the course does not reward burnout, savior behavior, or undermining authority.
- Students are told they can anonymize names, companies, and sensitive details in written work.
- Students are told that honesty about hesitation, fear, or avoidance is scored positively when paired with analysis.
4. Detailed Course Content
Module 1 / Session 1: The Anatomy of Role-Based Thinking
Session goal: Establish why job descriptions exist, why they become limiting, and why "that's not my job" is often a reflex rather than a rational judgment.
Session outcomes:
- Students can explain why roles exist in organizations.
- Students can identify at least two costs of excessive role conservatism.
- Students produce an initial "role drift" reflection that becomes seed material for later artifacts.
Session 1 run of show
| Time | Segment | Lesson / Activity | Facilitator moves | Student outputs |
|---|---|---|---|---|
| 0-10 min | Opening provocation | Hero quote and quickwrite: "That's not my job." / "Said every person who stayed in the same job forever." | Read both lines cold. Ask students to choose which line feels more true and why. Push for discomfort, not consensus. | 3-5 sentence quickwrite on their instinctive reaction |
| 10-20 min | Pair share | Role drift stories | Prompt: "Name a time your real work differed from the official role." Model with one example. | One concrete story shared in pairs |
| 20-35 min | Mini-lesson 1.1 | Why job descriptions exist | Teach division of labor, coordination, accountability, and reporting. Keep this tight and practical. | Notes with 3 legitimate reasons roles exist |
| 35-45 min | Whole-group synthesis | When role clarity becomes a prison | Ask for examples where role clarity helped and where it blocked action. Capture both sides visibly. | Two-column class list: useful boundaries / harmful boundaries |
| 45-60 min | Mini-lesson 1.2 | The invisible hand of status quo | Introduce organizational antibodies, misaligned incentives, and why people get punished for misses inside role more than wins outside role. | Annotated notes; 1 sentence explaining "organizational antibodies" |
| 60-72 min | Reading and discussion | Excerpt from Work Rules! | Assign a short excerpt. Ask students to underline one line that supports autonomy and one line that warns against chaos. | Marked-up reading; 2 evidence lines |
| 72-84 min | Individual reflection | Role drift reflection | Prompt: "Where in my life am I already doing work beyond the label, and where am I using the label as cover?" Circulate and redirect vague answers. | 250-300 word reflection draft |
| 84-90 min | Exit ticket | Commit to an observation target | Ask each student to name one place they will watch for "that's not my job" behavior before next session. | Exit ticket with one observation target |
Session 1 facilitator guidance
- Do not let the session collapse into anti-management rhetoric. Keep reminding students that roles are both necessary and limiting.
- When students generalize about "lazy coworkers" or "bad bosses," redirect to system dynamics and personal judgment.
- Use repeated phrasing: "The problem is not roles. The problem is worshipping roles."
Session 1 student artifacts
- Quickwrite on the provocation
- Role drift reflection draft
- Exit ticket observation target
Module 2 / Session 2: The Expansion Stories - Case Studies
Session goal: Analyze real and plausible examples of ownership expansion, isolate enabling conditions, and distinguish admirable action from survivorship-biased mythmaking.
Session outcomes:
- Students can name common features across three expansion stories.
- Students can articulate risks, tradeoffs, and failure modes in each story.
- Students leave with a clear brief for the ownership interview assignment.
Session 2 run of show
| Time | Segment | Lesson / Activity | Facilitator moves | Student outputs |
|---|---|---|---|---|
| 0-8 min | Reactivation | Observation target debrief | Ask: "What examples of lane staying or ownership did you notice?" Pull 4-5 examples fast. | One shared observation per student |
| 8-25 min | Case study A | Google intern story | Have students mark what the intern knew, risked, and gained. Ask what conditions made action possible. | Case notes with evidence under 3 headings: capability, risk, outcome |
| 25-40 min | Case study B | Manufacturing floor story | Push students to consider process, authority, and cross-functional breakdown. Ask why such stories are rare. | Short group answer: structural enablers vs blockers |
| 40-55 min | Case study C | Product manager who coded | Force the class to wrestle with tradeoffs: speed, legitimacy, technical debt, political cost. | 1-paragraph judgment: healthy expansion, overreach, or mixed |
| 55-68 min | Comparative analysis | What do all 3 stories share? | Build a live matrix with columns: problem visibility, initiative, communication, capability, recoverability, outcome. | Completed comparison matrix |
| 68-78 min | Failure analysis | What if it had gone badly? | Ask students to rewrite one case as a cautionary tale. This prevents hero-story simplification. | 3-4 bullet "failure version" of one case |
| 78-88 min | Assignment launch | Ownership interview briefing | Walk through the 5 required questions, deliverable length, and quality standards. Model follow-up questions that deepen the story. | Interview plan: person, outreach date, backup option |
| 88-90 min | Close | Public commitment | Each student states who they will interview or when they will secure a backup. | Interview commitment |
Session 2 facilitator guidance
- Make students judge each case, not just admire it.
- Repeatedly ask:
- What did the person understand?
- Who did they communicate with?
- What would failure have cost?
- Was this scalable behavior or a one-off rescue?
- If students romanticize heroic sacrifice, introduce the question: "What system failure required this rescue in the first place?"
Ownership interview assignment launch details
Required questions:
- Tell me about a time you did something that was definitely not your job and it mattered.
- What were you thinking at the moment? Were you afraid?
- Did you get in trouble? Did you get credit?
- Looking back, what would you have done differently?
- What would you tell someone younger about stepping outside their role?
Required follow-up moves students must try at least twice:
- "What made that possible?"
- "What were you afraid would happen?"
- "Who else was affected?"
- "How did you know this was yours to touch?"
- "If someone else copied your decision, when would it go wrong?"
Session 2 student artifacts
- Case comparison matrix
- Failure-version rewrite
- Interview plan and outreach commitment
Module 3 / Session 3: The Ownership Interview Review
Session goal: Turn raw interview stories into analyzable evidence and identify the class-wide pattern language of successful expansion.
Session outcomes:
- Students extract lessons, not just anecdotes, from interviews.
- Students identify recurring patterns across interview data.
- Students produce a working outline for the formal interview writeup.
Pre-session requirement: Students arrive having completed the interview or, at minimum, secured a published interview fallback and one real outreach attempt.
Session 3 run of show
| Time | Segment | Lesson / Activity | Facilitator moves | Student outputs |
|---|---|---|---|---|
| 0-10 min | Accountability check | Interview completion status | Quick show of hands: completed, scheduled, fallback needed. Immediately triage students who are behind. | Completion status logged |
| 10-28 min | Small-group share | Interview story retell | Groups of 4-5. Each student gets 3 minutes to tell the story and 1 minute for clarifying questions. | Oral retell; listener notes |
| 28-42 min | Pattern mining | What repeated across interviews? | Give groups a template with prompts: trigger, fear, risk, communication, credit, long-term effect. | Group pattern chart |
| 42-54 min | Instructor synthesis | Expansion formula from the room | Aggregate patterns publicly. Highlight likely findings from the curriculum: crisis, delayed credit, communication failures, trust gains. | Whole-class synthesis notes |
| 54-66 min | Mini-lesson | From anecdote to analysis | Teach the difference between summary, interpretation, and judgment. Show a weak paragraph and revise it live. | Notes on evidence-based analysis moves |
| 66-80 min | Writing lab | Interview writeup outline | Students outline 5 sections: context, moment of expansion, fear/risk, outcome, personal commentary. Confer with weak drafts. | Detailed writeup outline |
| 80-88 min | Peer calibration | What makes a strong writeup? | Have pairs score a sample paragraph against criteria: specificity, tension, lesson quality, student commentary. | Peer notes on rubric expectations |
| 88-90 min | Close | Submission reminder | Set due date before Session 4 or early Session 4. | Submission plan |
Async fieldwork expectations for Module 3
- Live interview time: 30 to 45 minutes
- Transcription or structured notes: 30 minutes
- Writeup drafting: 90 minutes
- Total expected async time: 2.5 to 3 hours
Session 3 facilitator guidance
- Students often retell interviews as neat moral stories. Interrupt that. Ask where the tension really was.
- Students often under-analyze the fear component. Push them to recover emotional and political risk, not just task difficulty.
- If an interviewee presents themselves as flawless, ask the student what might be missing, uncertain, or reputationally cleaned up in the story.
Session 3 student artifacts
- Group pattern chart
- Interview writeup outline
- Draft or near-final ownership interview writeup
Module 4 / Session 4: The Personal Audit
Session goal: Convert external insight into self-diagnosis by mapping role boundaries, naming avoidance behavior, and learning the expansion-vs-overreach framework.
Session outcomes:
- Students complete a role boundary map.
- Students complete an avoidance audit with multiple real incidents.
- Students can apply the expansion-vs-overreach test to their own scenarios.
Session 4 run of show
| Time | Segment | Lesson / Activity | Facilitator moves | Student outputs |
|---|---|---|---|---|
| 0-10 min | Re-entry | Interview insight transfer | Ask: "What from your interview felt uncomfortably relevant to you?" This sets up self-audit. | 1 personal relevance statement |
| 10-28 min | Lesson 4.1 | Role boundary map instructions | Define four zones: explicit, implied, just outside, way outside. Give examples from job, school, and family contexts. | Role boundary map draft |
| 28-45 min | Mapping activity | Role boundary map build | Students map one primary role and one secondary role. Circulate and challenge shallow maps. | Completed role boundary map |
| 45-63 min | Avoidance audit | What problems did you walk past? | Students list incidents from the last month and answer: Whose job did I assume it was? What stopped me? What would action have required? | Avoidance audit worksheet with at least 4 incidents |
| 63-74 min | Lesson 4.2 | Healthy expansion vs overreach | Teach the five healthy-expansion checks and five overreach signals from the curriculum. | Annotated framework notes |
| 74-84 min | Scenario application | Audit one real avoided problem | Students choose one item from their audit and run it through the framework. | 1 completed expansion-vs-overreach analysis |
| 84-90 min | Transition | Framework preview for Session 5 | Explain that next session converts the audit into a personal operating system. | Draft commitment statement |
Session 4 facilitator guidance
- This is the most vulnerable session. Name that directly.
- Reward honest admissions like "I avoided this because I feared looking arrogant" or "I did not want extra work."
- Do not reward guilt spirals. Move students from shame toward judgment and design.
- If students choose examples that are too small, ask for a problem that had actual consequences.
Required structure for the role boundary map
Each student map must include:
- one primary role
- one secondary role
- at least 3 items in explicit scope
- at least 3 items in implied scope
- at least 3 items just outside scope
- at least 2 items way outside scope
- one note on where they most often hide behind ambiguity
Required structure for the avoidance audit
Each student audit must include at least 4 incidents, and each incident must name:
- the observed problem
- the context
- the assumed owner
- the feared consequence of stepping in
- the likely cost of not acting
- whether action would have been healthy expansion, overreach, or uncertain
Session 4 student artifacts
- Completed role boundary map
- Completed avoidance audit
- One analyzed incident using the expansion-vs-overreach framework
Module 5 / Session 5: Presentations and Personal Operating System
Session goal: Synthesize all prior work into a practical, personal expansion framework and test it publicly through presentation and peer review.
Session outcomes:
- Students present a personal operating system for stepping in or stepping back.
- Students receive peer and LLM-ready feedback against clear criteria.
- Students leave with one near-term behavioral commitment.
Session 5 run of show
| Time | Segment | Lesson / Activity | Facilitator moves | Student outputs |
|---|---|---|---|---|
| 0-12 min | Warm start | Re-state the course thesis | Revisit compounding ownership vs restriction. Ask students what they now reject from their old operating system. | 1 sentence thesis revision |
| 12-22 min | Framework build | Final prep time | Students finalize presentation using a simple structure. Facilitator checks for missing decision rule or weak examples. | Presentation draft |
| 22-70 min | Presentations | "My Expansion Framework" | Each student presents for 3 minutes plus 1 minute of peer questions. If cohort is large, use concurrent breakouts with shared rubric. | Final presentation |
| 70-80 min | Peer review | Structured response | Require peers to score distinction between expansion and overreach, honesty, and actionability. | Peer feedback forms |
| 80-87 min | Final reflection | One change starting next week | Students write the exact situation in which they will apply their framework. | Commitment statement |
| 87-90 min | Closing | Compounding effect of total ownership | Deliver the closing argument from the curriculum. End on asymmetry: short-term safety vs long-term capability. | Final exit reflection |
Required presentation structure
Students must cover all four elements from the curriculum:
- What the avoidance audit revealed
- What the interview taught them
- What healthy expansion means in their actual context
- One specific thing they will do differently starting next week
Session 5 facilitator guidance
- The presentation is not a self-branding speech. It is a decision system presentation.
- Ask follow-up questions that test realism:
- "What would stop this from becoming overreach?"
- "Who do you need to communicate with first?"
- "What kind of problem is still not yours to own?"
- In the close, connect ownership to trust, capability, and system visibility, not just ambition.
Session 5 student artifacts
- Final presentation
- Personal expansion framework
- Peer feedback forms
- Final commitment statement
5. Assignments and Artifacts
A. Ownership Interview Writeup
Weight: 25%
Deliverable: 1,200 to 1,500 words
Required sections:
- interviewee context
- the "not my job" moment
- perceived risk and fear
- what happened next
- what the student believes the story proves
- what the student would borrow, reject, or adapt
Minimum evidence requirements:
- at least 2 direct quotes or clearly marked paraphrases
- at least 1 explicit description of the stakes
- at least 1 explicit description of communication or lack of communication
- at least 1 student judgment about whether the act was healthy expansion, overreach, or mixed
B. Role Boundary Map
Weight: 15%
Deliverable: one-page map or equivalent structured document
Required components:
- explicit scope
- implied scope
- just outside scope
- way outside scope
- role ambiguity note
- one pattern the student wants to change
C. Avoidance Audit
Weight: 20%
Deliverable: structured worksheet with at least 4 incidents plus a 250-word synthesis
Required components:
- incident list
- fear or hesitation named
- cost of non-action estimated
- classification of healthy expansion / overreach / uncertain
- synthesis paragraph on the student's reflex pattern
D. Personal Expansion Framework
Weight: 25%
Deliverable: 600 to 900 words or equivalent slide framework
Required components:
- personal trigger pattern
- criteria for stepping in
- criteria for stepping back
- communication rule
- risk check
- handoff or ownership rule
- near-term application scenario
E. Final Presentation
Weight: 15%
Deliverable: 3-minute presentation with 1-minute Q&A
Required components:
- summary of audit findings
- insight from interview
- explanation of framework
- one concrete next-week commitment
6. AI/LLM Grading and Assessment Framework
Assessment model
The LLM should act as a first-pass evaluator, not the sole authority. Its job is to score observable evidence, identify missing components, and generate actionable feedback. A human should review any submission flagged for ambiguity, emotional concern, or likely hallucinated detail.
Core grading principles
- Grade evidence, not confidence.
Confident but generic writing should score below modest but specific work.
- Reward honest self-observation.
Students should receive credit for accurately naming fear, avoidance, status concerns, or uncertainty.
- Penalize unsupported moralizing.
Statements like "great leaders always step up" without analysis should not score highly.
- Separate initiative from recklessness.
High scores require visible judgment about communication, capability, and recoverability.
- Do not over-penalize writing polish.
Grammar and style matter only when they block meaning.
LLM evidence checks by artifact
Ownership Interview Writeup
- Detect whether a real incident is described with context, action, stakes, and outcome.
- Check for at least one fear, conflict, or uncertainty signal.
- Check whether the student interpreted the story rather than merely retelling it.
- Check whether the student made a judgment about expansion vs overreach.
- Flag submissions with suspiciously generic content, no scene details, or no interview voice.
Role Boundary Map
- Check all four boundary zones are present.
- Check that items are concrete tasks or responsibilities, not vague traits.
- Check whether the "just outside" zone shows real judgment rather than impossible fantasies.
- Flag maps with fewer than required items or unclear role definitions.
Avoidance Audit
- Check incident count and completeness.
- Check that fear is named in plain language.
- Check whether the student estimated the cost of inaction.
- Check whether classification decisions are justified.
- Flag audits that list only trivial incidents with no real stakes.
Personal Expansion Framework
- Check for explicit decision rules.
- Check that communication appears as a requirement, not an optional afterthought.
- Check for a boundary statement describing when not to step in.
- Check for one concrete future application.
- Flag frameworks that are motivational slogans rather than operational rules.
Final Presentation
- Check whether all four required presentation elements appear.
- Check for concrete example use.
- Check actionability of the final commitment.
- Flag presentations that describe values without a decision rule.
Suggested scoring mechanics
- Score each major criterion on a 1 to 4 scale:
- 4 = strong and specific
- 3 = competent and mostly complete
- 2 = partial, vague, or uneven
- 1 = missing, generic, or misunderstood
- Convert to weighted percentages by artifact.
- Provide criterion-level notes before overall judgment.
Automatic LLM flags requiring human review
- Possible fabricated interview or implausibly polished invented dialogue
- Signs of acute distress, exploitation, retaliation, or unsafe work context
- A framework that encourages policy violations, deception, or undermining teammates
- Repeated contradiction between the student's evidence and conclusions
- Submission too short to verify required evidence
Recommended LLM output structure
For each artifact, the LLM should return:
- completion check
- rubric scores by criterion
- 2 to 4 evidence-based observations
- 2 concrete revision moves
- overall level: strong / competent / weak / incomplete
7. Rubrics, Scoring Criteria, and Evaluator Prompt Guidance
A. Ownership Interview Writeup Rubric
| Criterion | 4 - Strong | 3 - Competent | 2 - Partial | 1 - Weak |
|---|---|---|---|---|
| Story specificity | Clear context, stakes, actors, and timeline | Mostly clear but some gaps | General story with limited detail | Vague, generic, or unclear incident |
| Analysis quality | Strong interpretation of why the action mattered and what enabled it | Reasonable interpretation with some insight | More summary than analysis | Little to no analysis |
| Expansion vs overreach judgment | Nuanced judgment with evidence | Judgment present but thinly supported | Judgment asserted with weak support | No meaningful judgment |
| Student commentary | Honest, relevant, and connected to self | Present and somewhat relevant | Generic self-commentary | Minimal or absent |
| Evidence use | Quotes/paraphrases and specifics support claims | Some evidence used | Sparse evidence | Unsupported claims dominate |
B. Role Boundary Map Rubric
| Criterion | 4 - Strong | 3 - Competent | 2 - Partial | 1 - Weak |
|---|---|---|---|---|
| Completeness | All zones complete with sufficient items | Most zones complete | Some zones thin or missing | Major sections missing |
| Concreteness | Tasks and boundaries are specific and realistic | Mostly specific | Mixed specificity | Mostly vague labels |
| Judgment | Clear distinction between near-edge and far-outside work | Distinction mostly clear | Boundaries blur or feel arbitrary | No useful boundary logic |
| Self-awareness | Map reveals real ambiguity and hiding spots | Some self-awareness present | Limited reflection | Defensive or superficial |
C. Avoidance Audit Rubric
| Criterion | 4 - Strong | 3 - Competent | 2 - Partial | 1 - Weak |
|---|---|---|---|---|
| Incident quality | Multiple meaningful incidents with real stakes | Incidents are relevant though uneven | Incidents are small or repetitive | Incidents are trivial or missing |
| Fear diagnosis | Fears are plainly and insightfully named | Fears are named | Fears are implied more than named | Fear analysis absent |
| Cost-of-inaction analysis | Consequences of non-action are concrete | Consequences noted | Consequences vague | No cost analysis |
| Framework application | Healthy expansion / overreach classifications are justified | Mostly justified classifications | Weak or inconsistent logic | No meaningful framework use |
| Synthesis | Clear reflex pattern identified | Some pattern identification | Loose summary only | No pattern synthesis |
D. Personal Expansion Framework Rubric
| Criterion | 4 - Strong | 3 - Competent | 2 - Partial | 1 - Weak |
|---|---|---|---|---|
| Decision rule clarity | Clear step-in / step-back logic | Logic mostly clear | Logic exists but is fuzzy | No operational rule |
| Communication rule | Explicit stakeholder communication plan | Communication mentioned | Communication weak or generic | Communication absent |
| Boundary awareness | Clear limits and anti-overreach checks | Some limits defined | Limits underdeveloped | Encourages overreach or says yes to everything |
| Personal fit | Framework reflects student's actual context and triggers | Mostly contextualized | Generic framework with some personalization | Generic leadership slogans |
| Application readiness | Concrete near-term use case | Plausible use case | Hypothetical or weak use case | No usable application |
E. Final Presentation Rubric
| Criterion | 4 - Strong | 3 - Competent | 2 - Partial | 1 - Weak |
|---|---|---|---|---|
| Content coverage | All required elements covered well | All covered but uneven | One required element weak or missing | Multiple required elements missing |
| Clarity | Easy to follow and well structured | Mostly clear | Some confusion | Hard to follow |
| Actionability | Audience can understand the student's decision rule | Rule mostly understandable | Rule vague | No usable rule |
| Reflection quality | Honest and grounded in artifacts | Reflection present | Reflection shallow | Reflection absent |
Suggested evaluator prompt for the LLM
Use this prompt with the relevant artifact pasted after it:
You are evaluating a student submission for Course 07, "The 'That's Not My Job' Audit."
Your job is to score the work based only on visible evidence in the submission. Do not reward confidence, polish, or grand language unless it is supported by specifics. Reward honest self-awareness, concrete examples, judgment about expansion vs overreach, and practical decision rules.
First, perform a completion check against the required components.
Second, score each rubric criterion on a 1-4 scale.
Third, justify each score with short evidence-based notes that quote or paraphrase the submission.
Fourth, provide 2 strengths and 2 revision moves.
Fifth, give an overall level: Strong, Competent, Weak, or Incomplete.
Important constraints:
- Penalize vague moralizing and generic leadership language.
- Do not penalize minor grammar issues unless meaning is unclear.
- Flag the submission for human review if the story seems fabricated, unsafe, or too incomplete to verify.
- If the student shows honest uncertainty and good judgment, score that positively.
```
## Additional evaluator heuristics
- If the student names no concrete fear, the score cannot exceed competent on self-awareness criteria.
- If the student gives no communication plan, the personal framework cannot exceed partial on decision quality.
- If the student never addresses overreach, the personal framework cannot earn top marks.
- If the interview writeup contains no stakes or consequences, story specificity should score 2 or below.
- If the avoidance audit includes fewer than 4 incidents, completion must be marked incomplete even if the writing is strong.
---
## 8. Feedback Strategy: Strong, Average, Weak Responses and How an LLM Should Respond
## Global feedback posture
The LLM should sound direct, specific, and developmental. It should not flatter students with empty praise. It should identify what is working, what is missing, and what the next revision should change.
### Strong responses usually look like this
- They use real incidents with stakes, not generic opinions.
- They name fear, politics, capability, and communication.
- They distinguish "I could help" from "I should take over."
- They sound honest rather than heroic.
- They end in a usable decision rule.
**How the LLM should respond to strong work:**
- confirm exactly what evidence made the work strong
- name one way to sharpen nuance, not rewrite the whole piece
- push the student toward portability: "Where else will this rule apply?"
### Average responses usually look like this
- They have the right parts but are under-specific.
- They summarize events more than analyze them.
- They gesture at overreach without giving a concrete boundary.
- They contain one useful insight but not yet a full operating system.
**How the LLM should respond to average work:**
- identify the missing layer of detail
- ask for one additional real example or one clearer decision rule
- turn vague statements into revision questions
### Weak responses usually look like this
- They rely on slogans like "leaders take initiative."
- They avoid naming fear, risk, or tradeoffs.
- They present expansion as always good.
- They include no scene details, no consequences, or no personal application.
- They read like the student is trying to sound impressive rather than truthful.
**How the LLM should respond to weak work:**
- state clearly that the submission is too generic to score highly
- point to the missing required evidence
- give a concrete rescue plan: add one incident, name one fear, state one communication step, define one stop condition
## Artifact-specific feedback guidance
### Ownership Interview Writeup
**Strong:** The student captures a vivid story, includes stakes, and explains what the story reveals about judgment, trust, and risk.
**Average:** The student retells the event competently but has limited commentary or weak extraction of lessons.
**Weak:** The writeup reads like a cleaned-up anecdote with no analysis, no quotes, and no tension.
**LLM response pattern:**
- praise specificity where present
- ask "What exactly made this theirs to touch?"
- ask "What would have made this overreach instead?"
### Role Boundary Map
**Strong:** The zones are concrete, realistic, and reveal where the student hides behind role ambiguity.
**Average:** The map is complete but blurry at the edges.
**Weak:** The map uses vague categories like "leadership things" or "helping others" without tasks.
**LLM response pattern:**
- ask the student to convert categories into actual behaviors
- challenge one item in "just outside" and one in "way outside" to test judgment
### Avoidance Audit
**Strong:** The audit contains real incidents, candid fear naming, and sober cost-of-inaction analysis.
**Average:** The audit is honest but light on consequences or classification logic.
**Weak:** The audit is defensive, trivial, or written to avoid discomfort.
**LLM response pattern:**
- identify the strongest incident and tell the student to deepen that one further
- if weak, explicitly ask for a less sanitized example
### Personal Expansion Framework
**Strong:** The framework functions like a decision system with clear triggers, checks, communications, and stop rules.
**Average:** The framework has values but weak operational detail.
**Weak:** The framework is motivational language with no boundary management.
**LLM response pattern:**
- test the framework with a scenario
- ask who the student must notify before stepping in
- ask what would make them step back
### Final Presentation
**Strong:** Clear, evidence-based, and committed to one real behavioral change.
**Average:** Understandable but somewhat abstract or repetitive.
**Weak:** Vague, overly polished, or disconnected from prior artifacts.
**LLM response pattern:**
- assess whether the audience could actually use the student's rule
- if not, ask for the exact sentence they would tell themselves in the moment of hesitation
## Final note for evaluators
The course succeeds when students become more accurate about responsibility, not merely more aggressive about taking it. The highest-scoring work should show initiative with restraint, courage with communication, and ambition with system awareness.