Getting Started 0%

Measure How Effectively You Work With AI

This is an advanced, scenario-based assessment across 11 dimensions in three pillars. All responses are open-ended written answers — no multiple choice. Plan for approximately 40 minutes.

What You'll Be Tested On

You'll work through 5 sections covering the full Human Velocity framework:

1. Specification & Creative Intent — ~8 min  ·  Can you write instructions a machine takes literally?

2. Quality Systems & Failure Analysis — ~8 min  ·  Can you catch errors and design systems to prevent them?

3. Agent Architecture & Delegation — ~10 min  ·  Can you design and delegate to multi-agent systems?

4. Cost & Token Economics — ~8 min  ·  Can you calculate real AI costs and build a sound business case?

5. Integration & Self-Assessment — ~5 min  ·  Can you honestly evaluate your own performance?

Your responses are scored across 11 dimensions on a 1,500-point scale. Depth, structure, and specificity all count. There are no trick questions — answer as thoroughly as you can.

🧠
Human Foundation

Belief & Value Clarity · Goal Architecture · Agency Preservation

🎨
Multimodal Creation

Specification Precision · Multimodal Fluency · Evaluation & Quality Judgment

⚙️
Agentic Operations

Multi-Agent Delegation · Failure Pattern Recognition · Trust & Security Design · Context Architecture · Cost & Token Economics

Specification & Creative Intent

You're leading a product launch and need to direct AI tools to create cohesive deliverables across multiple modalities. This section tests whether you can write specifications a machine takes literally — and connect them to what you actually believe and value.

Scenario: Steadfast — Fintech Product Launch

You're the marketing lead at a fintech startup launching "Steadfast" — a cash flow management app for small business owners. Your team has 10 days to produce: a landing page with hero image, an explainer video script, a series of social media posts, and an email drip campaign.

You have access to AI tools for image generation, copywriting, video scripting, and design — but each tool takes your instructions literally. If you're vague, the outputs will be generic. If you're precise, they'll be exactly what you need.

Your CEO has one requirement: "This campaign needs to feel trustworthy. Small business owners have been burned by fintech promises before."

Write the complete specification for an AI image generator to create the hero visual for the Steadfast landing page. Include every detail the model needs — composition, color palette, mood, subjects, art style, aspect ratio, what to explicitly include, and what to explicitly avoid. The AI cannot read your mind; it will interpret your words literally.

Think about what happens when you leave something unspecified — the AI fills in the blank with its best guess, which may not match your vision.

0 words

Before writing any more prompts, answer: What do you believe makes a fintech product genuinely trustworthy — not just trustworthy-looking? What specific values should this campaign communicate? How would you encode those values into your AI instructions so the outputs reflect them consistently?

Your beliefs and values should drive your AI specifications, not the other way around.

0 words

Map the full deliverable set across modalities. For each piece (hero image, landing page copy, explainer video script, social posts, email drip), specify: which AI tool or model you would use, the output format and dimensions, the specific acceptance criteria for "done," and how you ensure visual and thematic consistency across all five deliverables.

Consistency across modalities is where most AI-assisted campaigns fall apart.

0 words

Quality Systems & Failure Analysis

You manage an AI content pipeline in production. Something is going wrong. This section tests whether you can identify errors that sound authoritative, design quality systems to catch them, and diagnose systemic failures before they cascade.

Flawed AI-Generated Report — Review Before It Sends

This report was produced by your AI pipeline and is about to be sent to 2,000 subscribers:

"The enterprise AI market grew 34% year-over-year according to Gartner's latest forecast, reaching $92 billion in 2025. This unprecedented growth suggests that organizations should accelerate their AI adoption timelines immediately to avoid falling behind competitors.

Our analysis of customer deployment patterns shows that companies using multi-agent architectures achieve 3.7x higher efficiency scores. Based on this data, we strongly recommend transitioning all workflow automation to multi-agent systems within the next quarter.

Cloud infrastructure costs for AI workloads have decreased significantly, making large-scale deployment increasingly affordable. The consensus among industry leaders is that cost is no longer a barrier to AI adoption.

In related developments, the open-source AI community has seen massive growth, with open-weight models now matching proprietary model performance in most benchmarks. However, the security implications of deploying open-source models in enterprise settings remain minimal and well-understood."

Identify every quality issue — factual problems, reasoning flaws, unsupported claims, tone issues, and anything that would erode reader trust. For each issue, explain what type of error it is and why it matters.

Look beyond grammar. The most dangerous errors are the ones that sound authoritative but are wrong or misleading.

0 words

Design an automated quality harness for this pipeline. Define at least 4 specific checks you would encode, describe how each one works technically, what threshold or signal triggers a flag, and what happens when a check fails (block, flag for review, auto-correct, etc.). Be precise enough that an engineer could implement your design.

Good quality harnesses catch categories of errors, not just individual instances.

0 words

This report quality has been degrading gradually over two weeks — not a sudden break, but a slow decline in accuracy and tone. What are the three most likely root causes of gradual degradation in a multi-agent content pipeline? For each, describe the diagnostic indicators you would look for and the specific corrective loop you would implement to prevent recurrence.

Gradual degradation has different root causes than sudden failure. Think about what changes slowly in an AI system.

0 words

Agent Architecture & Delegation

You're designing a real AI system with multiple agents. This section tests your ability to decompose work, architect information flow, design security boundaries, and preserve human oversight in complex agentic systems.

Scenario: AI Customer Support System

Your company needs to build an AI-powered customer support system handling approximately 2,000 conversations per day across chat and email. The system must:

  • Answer product questions from a 50,000-page documentation database
  • Handle billing inquiries (requires read access to billing system — but not write access)
  • Perform technical troubleshooting (step-by-step diagnosis flows)
  • Escalate to human agents when AI confidence is low or issues are sensitive
  • Maintain conversation context across multiple interactions
  • Comply with SOC 2 and GDPR requirements

Budget: 8 weeks, team of 3 engineers. Must handle production volume from day one.

Decompose this system into distinct agents. For each agent, define: its name and specific responsibility, what it receives as input, what it produces as output, how it decides to hand off to another agent, and what constraints or guardrails limit its behavior. Explain why you chose this decomposition over alternatives.

Think about separation of concerns. An agent that does too many things fails in unpredictable ways.

0 words

Design the context architecture. The documentation database is 50,000 pages. Each conversation may reference previous interactions. Token windows are finite. How does the right information reach the right agent at the right time? Address: retrieval strategy, context window management, conversation memory design, and how you prevent agents from being overwhelmed with irrelevant context.

An agent with too much context is as broken as one with too little. The architecture is in what you exclude.

0 words

This system accesses customer billing data and personal information under SOC 2 and GDPR. Design the trust and security architecture: What data can each agent access (and what can it NOT access)? How do you prevent prompt injection attacks from customers? How do you audit what agents do? What happens if an agent hallucinates a billing action or leaks PII?

Security in agentic systems isn't just authentication — it's about what a probabilistic system is allowed to do with certainty-requiring data.

0 words

Where in this system must humans remain in the loop? Identify at least 3 specific decision points that should never be fully automated. For each, describe how you design the handoff so the human agent has full context to act immediately — not spend 10 minutes catching up on what happened before them.

The hardest part of human-in-the-loop design isn't identifying where humans go — it's ensuring they can be effective when they arrive.

0 words

Cost & Token Economics

Time to build the business case. This section tests whether you can calculate the real economics of an AI system, set measurable goals, and identify the risks that could destroy your ROI — before you start building.

Business Case: AI Customer Support

Current state: 45 human agents, average salary $52,000/year, handling 2,000 conversations/day, average resolution time 12 minutes.

Proposed AI system (3 tiers):

  • Tier 1 — Fast model (handles 60% of volume): GPT-5.4 mini at $0.75 input / $4.50 output per 1M tokens. Average 800 input + 400 output tokens per conversation.
  • Tier 2 — Capable model (handles 30% of volume): Claude Sonnet 4.6 at $3.00 input / $15.00 output per 1M tokens. Average 2,000 input + 1,000 output tokens per conversation.
  • Tier 3 — Human escalation (handles 10% of volume): Same per-agent cost as current team.
  • Infrastructure: $8,500/month for hosting, monitoring, and orchestration.

Calculate: (1) The daily token cost for Tier 1 and Tier 2 separately. (2) The total monthly cost of the entire AI system — including token costs, infrastructure, and remaining human agents for Tier 3 escalation. (3) The monthly savings compared to the current all-human team. (4) The break-even point: at what daily conversation volume does the AI system cost the same as the current team? Show your work.

Precision matters. In enterprise proposals, a wrong decimal point can kill a deal or greenlight a losing investment.

0 words

Define three specific, measurable goals for this AI system's first 90 days in production. For each goal, specify: the exact metric, the target value, how you'll measure it, the baseline (where it starts), and what specific action you'll take if the goal isn't met by day 90.

Good goals are specific enough to know when you've hit them and clear enough to know what to do when you haven't.

0 words

Beyond raw cost savings, identify the three biggest risks to this ROI projection. For each risk: explain what could go wrong, quantify or estimate the financial impact if it happens, and describe a specific safeguard you would build into the system design — before launch, not after — to protect the business case.

The best business cases don't just show the upside — they show you've already accounted for what could go wrong.

0 words

Integration & Self-Assessment

Final section. Step back and honestly assess your own performance — then prove your specification skills one more time by designing a tool for your own growth.

Look back at your responses across this entire assessment. Which response are you most confident in, and why? Which felt weakest, and what specific skill gap does that reveal? Be honest — self-awareness scores higher than self-promotion.

The ability to accurately assess your own capabilities is itself a core Human Velocity skill.

0 words

Write a specification for an AI agent that would help you practice the skill you identified as weakest. Define: what the agent does, what inputs it takes, what outputs it produces, how it gives you feedback, what guardrails keep it safe, and what success looks like after 30 days of use. Be precise enough that an engineer could build it from your description alone.

This tests two things at once: can you write a precise specification, and do you know what you need to learn?

0 words

Human Velocity Score

out of 1,500

Ready to Improve?

Your Human Velocity score is a starting point, not a ceiling. Structured practice can raise every dimension.

Join the Bootcamp Explore Advisory

Retake the Assessment