Motivation
How can we structure our work with AI to ensure that the sum is greater than the parts, rather than less?
The widespread deployment of generative AI has created an illusion of frictionless productivity. Empirical studies of high-stakes knowledge work show a recurring complementarity deficit: naive human-AI combinations often underperform both unassisted humans and autonomous AI models (Brodeur et al., 2026; Vaccaro et al., 2024). Brodeur et al. (2026) give a stark demonstration: in a large-scale reproducibility-assessment task, AI-assisted teams outperformed AI-led teams, but neither beat human-only teams.
Generating plausible text, code, or strategic analysis now costs near-zero marginal cognitive effort. The cost of evaluating, verifying, and debugging what that generation produces has stayed constant, or increased. That asymmetry, the generation-verification gap, is the starting point for this session.
Artificial intelligence is neither a uniform productivity multiplier nor a cognitive replacement. It behaves like an asymmetric amplifier: it amplifies whatever interaction structure surrounds it, good or bad. Without deliberate, evidence-based interaction architectures, pairing capable humans with capable AI frequently yields outcomes that are worse, more homogeneous, and harder to maintain than unassisted work.
Three concepts anchor the session:
- Complementarity vs. substitution: does the pairing produce something neither party could produce alone, or does the AI simply replace human effort?
- Naive delegation vs. co-construction: is the human handing off a task wholesale, or actively shaping how the AI contributes to it?
- Epistemic agency: does the human retain ownership of judgment, or does the AI’s confident output quietly replace the human’s own reasoning?
The Light Side
Execution Velocity
AI compresses the time it takes to get from blank page to first draft.
Field and lab experiments consistently find large completion-time reductions for routine writing, standard coding, and initial drafting once generative AI is introduced into the workflow. Noy & Zhang (2023) found that ChatGPT cut the time professionals needed for writing tasks by roughly 40 percent while improving output quality, as judged by peer graders. Peng et al. (2023) found comparable gains for developers using GitHub Copilot, and Merali (2025) extend the pattern to consulting, data-analyst, and management tasks more broadly.
Beyond raw speed, AI reduces the friction of cold-start knowledge retrieval: instead of searching, skimming, and synthesizing background material, a worker can ask directly and get a serviceable orientation within seconds. This is valuable, but it is also where the light side quietly borders the dark side: speed at the input stage does not guarantee speed, or quality, at the output stage. That tension carries through the rest of the session.
Equalizer Effect
AI narrows the gap between novices and experts, at least initially.
Brynjolfsson et al. (2023) studied customer-support agents using a generative AI assistant and found that the assistant raised the productivity of novice and low-skilled agents substantially more than that of experienced agents. AI acted as an immediate scaffold, elevating baseline output to a competent standard and compressing the internal performance variance of the team. Cruces et al. (2025) found the same pattern in a randomized experiment on education-based productivity gaps: generative AI narrowed the gap between lower- and higher-skilled workers substantially.
This “bottom-up leveling” is genuinely valuable for onboarding and for closing skill gaps quickly. It also raises a question we return to under the dark side: what happens to the learning that used to occur while novices struggled through that gap unassisted?
Divergent Thinking
More ideas, further apart, faster.
When individuals query LLMs during early brainstorming, they tend to produce more ideas per minute and ideas that are further apart in meaning (higher semantic distance) than when brainstorming alone (Doshi & Hauser, 2024). Hubert et al. (2024) go further, finding that current generative language models outperform humans on standard divergent-thinking tasks. For an individual working alone, this is a genuine creativity boost.
Summary
| Mechanism | Changes | Evidence |
|---|---|---|
| Execution velocity | Faster drafts, faster prototypes, faster orientation | Noy & Zhang (2023); Peng et al. (2023); Merali (2025) |
| The equalizer effect | Novices and low performers gain the most | Brynjolfsson et al. (2023); Cruces et al. (2025) |
| Individual divergent thinking | More ideas, greater semantic distance | Doshi & Hauser (2024); Hubert et al. (2024) |
The Dark Side
Cognitive Offloading
Faster answers today, weaker retrieval tomorrow.
Bastani et al. (2025) ran field experiments with high-school students working through math problems, some with access to a generative AI tutor and some without. Students with AI access solved practice problems faster and with fewer errors. When the AI was removed for a subsequent unaided exam, however, their performance dropped significantly relative to the control group. The likely mechanism is that AI assistance bypassed the active retrieval and struggle that normally consolidate learning.
A parallel pattern has been observed in professional settings that depend on trained intuition. Budzyń et al. (2025) report a multicentre observational study, not a randomized trial, finding a deskilling risk: endoscopists accustomed to continuous AI assistance during colonoscopy showed reduced unaided polyp-detection accuracy once that assistance was removed. The mechanism is the same as in the classroom case: the effort that used to build the skill has been offloaded, so the skill stops accumulating, though the observational design means confounds (such as which endoscopists were assigned AI support) cannot be fully ruled out the way a randomized trial would.
This is not an argument against AI-assisted learning as such. However, we need to be deliberate about when assistance is appropriate.
Review Bottleneck
AI writes faster than humans can review.
Generation happens at machine speed, but verification, the reading, tracing, and testing needed to catch subtle errors, still happens at human speed (He, Agarwal, et al., 2026). In a separate longitudinal study of open-source projects, He, Miller, et al. (2026) find that Cursor AI raises short-term commit velocity while measurably increasing long-term code complexity. The result is a volume of output that looks correct on a first pass but accumulates undetected flaws.
In software engineering specifically, Xu et al. (2025) find that AI-assisted code, while faster to produce, is associated with decreased productivity for experienced developers once maintenance is accounted for: AI-generated code tends to introduce silent coupling between components and structural complexity that is expensive to unwind later. Borg et al. (2026) corroborate this at the codebase level, tracing downstream maintainability costs directly to AI-assisted commits. The technical-debt bill arrives months later, in the review, refactor, or incident that the shortcut eventually causes, not at commit time.
Fixation and Homogenization Trap
Everyone converges on the model’s first idea.
Two mechanisms compound each other here.
- At the individual level, idea fixation: Wadinambiarachchi et al. (2024) show that designers and analysts who see an AI-generated concept early in their process tend to anchor on its framing, even when instructed to generate independently, narrowing the space of solutions they go on to consider. Lin & Xie (2026) replicate the pattern in product design specifically, comparing generative AI against traditional ideation methods.
- At the collective level, this compounds into a variance collapse. Large language models sample text from dense regions of their learned probability distribution, so their outputs cluster around a small number of “central” answers. Doshi & Hauser (2024) show that while an individual using an LLM produces more ideas (the light-side finding above), a population of many people using the same LLM produces conceptually more similar outputs to each other than an equivalent population working unaided. Boussioux et al. (2024) find the same collapse in crowdsourced problem-solving, and Zhou et al. (2025) show it compounding over time: once continuous AI use stops, individual creativity fails to recover even as homogeneity keeps climbing. Individual creativity goes up; collective diversity goes down.
A related, subtler effect: Williams (2026) find that AI systems used to evaluate ideas (screening pitches, ranking submissions) tend to favor smooth, familiar narrative structures over genuinely novel or “weird” ones, penalizing exactly the kind of outlier idea that breakthrough innovation tends to require.
The practical implication for teams: if everyone on a project queries the same model the same way, the team’s apparent productivity gain can mask a real loss of strategic and creative diversity.
Reasoning Biases
Confident answers are persuasive, correct or not.
Vasconcelos et al. (2023) reframe overreliance as a rational cost-benefit choice rather than a simple cognitive bias: across five studies, people relied on an AI’s answer more when verifying it was harder or costlier, and, strikingly, giving the AI’s reasoning as an explanation did not reduce overreliance on its own, it only helped when it genuinely lowered the cost of checking the answer. Qazi et al. (2025) and Goh et al. (2024) document the downstream consequence directly in clinical diagnostic reasoning: physicians shown a confident but incorrect AI suggestion were measurably more likely to reach the wrong diagnosis themselves. The real danger is that verifying AI output is often costly enough that people rationally choose not to, even when they could, not that people trust AI too much in general.
A closely related failure is selective adherence, the term coined by Alon-Barkat & Busuioc (2023) in a study of public-sector decision-making: decision-makers tend to accept AI suggestions that confirm what they already believed, and reject AI suggestions that contradict their priors, regardless of which suggestion was actually correct. Rounding et al. (2025) confirm the pattern in a multi-country randomized trial of physician decision-making. This means AI can amplify existing bias, beyond simply adding noise to decision-making, by giving it an authoritative-sounding second opinion.
Both failures point to the same design requirement for human-AI collaboration: verification needs to be structured, not left to intuition.
Summary
| Issue | Mechanism | Evidence |
|---|---|---|
| Cognitive atrophy | Offloaded effort stops building the underlying skill | Bastani et al. (2025); Budzyń et al. (2025) |
| Reviewer’s bottleneck | Generation outpaces verification, debt accumulates silently | He, Agarwal, et al. (2026); He, Miller, et al. (2026); Xu et al. (2025); Borg et al. (2026) |
| Fixation & homogenization | Individual anchoring plus collective variance collapse | Wadinambiarachchi et al. (2024); Doshi & Hauser (2024); Zhou et al. (2025) |
| Reasoning biases | Automation bias and selective adherence to AI advice | Vasconcelos et al. (2023); Alon-Barkat & Busuioc (2023) |
The Jagged Frontier
Task Performance
Dell’Acqua et al. (2023) had management consultants complete realistic business tasks with and without access to GPT-4 and found dramatically uneven effects depending on the task. For tasks inside the frontier (closed-form problems with a checkable structure, such as market analysis or product ideation from a given brief), consultants using AI completed more tasks, faster, and at higher quality, with quality gains of roughly 40 percent. For tasks outside the frontier (problems that looked similar on the surface but required subtle, multi-step causal reasoning the model could not reliably do), consultants who trusted the AI’s competence performed worse than a control group working unaided, with quality dropping by roughly 19 percent.
The frontier is called “jagged” because it does not track task difficulty in any intuitive way. Some hard-looking tasks are safely inside it; some easy-looking tasks are outside it. The only way to know which is which is to test, not to guess from how complex a task feels.
Two further findings sharpen the picture:
- The expert penalty: novices gain the most leverage from AI assistance, but domain experts often experience net negative time balances, because reviewing and correcting an AI draft can take longer than producing an expert solution from scratch (Becker et al., 2025; Cui et al., 2025; Xu et al., 2025).
- Determinants of complementary success: the tasks where human-AI pairing reliably helps share two properties, verifiability (can an error be caught by a linter, a unit test, or a simple check, rather than requiring costly manual verification, the cost-of-verification mechanism demonstrated empirically by Vasconcelos et al. (2023)) and task modularity (can the sub-problem be fully isolated from the rest of the analysis?) (Hemmer et al., 2025; Vaccaro et al., 2024).
Realizing Synergies
Verifiable and modular tasks are where humans and AI genuinely add up.
| Determinant | Q-uestion | Significance |
|---|---|---|
| Verifiability | Can an error be caught mechanically (linter, test, calculation check), rather than only by careful reading? | Converts verification from an open-ended cognitive task into a fast, reliable one |
| Task modularity | Can the sub-problem be fully isolated from the rest of the analysis? | Bounds what the AI can silently get wrong, and what the human must review |
Vaccaro et al. (2024) synthesize a large body of human-AI teaming studies and find that superadditive complementarity is not evenly distributed across task types. It concentrates in tasks that are verifiable and modular. Hemmer et al. (2025) arrive at the same two determinants independently, through a conceptual synthesis of the sources of human-AI complementarity in information systems research. When both properties are present, review is fast and errors are contained. When either is absent, review becomes as expensive as doing the task unaided, and the “productivity gain” from generation is fully offset, or reversed, by the cost of verification.
This gives us a practical diagnostic question to ask before delegating any task to AI: if the AI gets this wrong, how would I find out, and how far would the error spread before I did?
Interaction Modes
Overview
Four interaction modes that relate to the failure risks.
- Socratic Scaffold protects skill acquisition
- Centaur Modularizer structures large workflows
- Cognitive Forcer mitigates overreliance
- Delayed Access preserves creative variance
Each mode below targets a specific failure mode identified above. None of them asks you to stop using AI. All of them ask you to change when and how you bring it into the workflow.
The Socratic Scaffold
Cognitive protection for skill acquisition
Objective: skill acquisition, conceptual learning, and problem formulation, without the mental atrophy documented in Bastani et al. (2025).
Mechanism: the human explicitly instructs the model not to output a direct solution or completed code. Instead, the model is prompted to behave like an examiner or tutor: it asks clarifying questions, points to missing boundary conditions or edge cases, and checks whether the human’s stated reasoning is sound, without supplying the reasoning itself. Prather et al. (2024) explore a related idea in programming education, structuring practice around prompt problems that keep the learner reasoning about the solution rather than just consuming AI-generated code.
When to use it: any situation where the point of the task is what you learn from doing it, not just the artifact you produce, coursework, first attempts at a new technique, early-career skill building.
The Centaur Modularizer
Structural separation for large, multi-step workflows
Objective: navigating large, multi-step analytical or writing workflows without losing coherence or accumulating undetected errors, directly addressing the reviewer’s bottleneck discussed under the dark side.
Mechanism: enforce strict spatial and functional separation between human and AI contributions, following the “centaur” pattern documented by Dell’Acqua et al. (2023) and studied further in a team setting by Dell’Acqua et al. (2025). The human retains complete ownership of strategy, problem architecture, and final synthesis. The AI is delegated bounded, non-overlapping subroutines, formatting, data extraction, boilerplate code, first-pass summaries, where the scope of a possible error is small and easy to locate.
When to use it: large deliverables (reports, codebases, presentations) where losing the thread of the overall argument to the AI would be costly, but where clearly delimited sub-tasks are genuinely verifiable and modular (recall Table 3).
The Cognitive Forcer
Adversarial review for high-stakes decisions
Objective: high-stakes decision-making, policy analysis, and code review, directly countering the automation bias and selective adherence documented above in the discussion of Vasconcelos et al. (2023), following the cognitive forcing functions proposed by Buçinca et al. (2021).
Mechanism: before consulting the model at all, the human must commit, in writing, to an independent hypothesis, recommendation, or architecture. Only after that commitment exists is the AI introduced, and only in an adversarial role: it is prompted explicitly to red-team the human’s position, to poke holes, surface edge-case failures, and expose unstated assumptions.
Why the order matters: asking for a critique after you have committed to a position removes the anchoring effect that a first AI answer otherwise has on your own thinking. It also converts the AI from a source of the decision into a check on the decision, structurally undermining automation bias rather than relying on individual vigilance to overcome it.
When to use it: irreversible or costly decisions, code review before merge, any moment where being wrong quietly is more expensive than being challenged loudly.
Delayed AI Access
Preserving variance in creative and strategic work
Objective: creative ideation, strategic direction, and novel product design, directly countering the fixation and homogenization trap discussed under the dark side.
Mechanism: enforce an initial period of fully unassisted human divergent thinking, generating your own ideas before you see the model’s, to establish a genuine personal variance baseline before any AI framing can anchor it (recall Wadinambiarachchi et al. (2024) on idea fixation). AI is introduced only downstream, for expansion and elaboration, and ideally through diverse prompting personas rather than a single default query, deliberately pushing the model away from the dense central region of its output distribution that drives the collective variance collapse documented by Doshi & Hauser (2024). Wan & Kalman (2026) show directly that varying the AI’s persona across a team measurably mitigates this homogenization effect in collaborative ideation.
When to use it: early-stage brainstorming, product concepting, strategy formation, anywhere that the diversity of the option set matters as much as the quality of any single option.
Challenges
You want to become a more deliberate collaborator with AI, not just a faster one? Here are three challenges that might help you along the way.
- Level 1 (Reflect): Keep a 14-day AI reliance diary. Log every AI interaction relevant to your studies or work, noting where the task sat on the jagged frontier, whether your stance was passive or active, how long verification took, and any moment you noticed automation bias in yourself. Close with a written reflection on your personal dependency and verification bottlenecks.
- Level 2 (Change): Over three weeks, commit to applying at least two of the four protocols above (Cognitive Forcer and Delayed Access work well together) across your coursework or projects. Compare your outputs against your usual habits: what changed in cognitive effort, in the maintainability of what you produced, and in what you actually remember afterward?
- Level 3 (Grow): Design and run a small field experiment (4 to 8 people, a study group or a work team). Compare a human-only team, a naive-AI team, and a Centaur-style team on the same complex deliverable. Write up whether true complementarity appeared, whether technical debt accumulated, and whether the AI-assisted teams’ outputs converged more than the human-only team’s did.
Reading List
For digging deeper, I recommend the sources cited here, organized by theme.
Frontiers and productivity
- The jagged technological frontier: Dell’Acqua et al. (2023)
- Productivity effects of generative AI: Noy & Zhang (2023)
- Generative AI at work: Brynjolfsson et al. (2023)
- Generative AI and developer productivity (GitHub Copilot): Peng et al. (2023)
- Scaling laws for AI-assisted knowledge work: Merali (2025)
- Generative AI and education-based productivity gaps: Cruces et al. (2025)
Cognitive offloading and reliance
- Generative AI and learning: Bastani et al. (2025)
- Endoscopist deskilling after AI exposure: Budzyń et al. (2025)
- Cognitive forcing functions: Buçinca et al. (2021)
- Explanations, overreliance, and the cost of verification: Vasconcelos et al. (2023)
- Generative AI and critical thinking: Lee et al. (2025)
Fixation and collective homogenization
- Individual creativity vs. collective diversity: Doshi & Hauser (2024)
- AI more creative than humans on divergent thinking: Hubert et al. (2024)
- Generative AI and design fixation: Wadinambiarachchi et al. (2024)
- Generative AI and divergent thinking in product design: Lin & Xie (2026)
- The crowdless future: generative AI and collective problem-solving: Boussioux et al. (2024)
- When ChatGPT is gone: creativity and homogeneity over time: Zhou et al. (2025)
- Diverse AI personas and homogenization: Wan & Kalman (2026)
- Diagnosing the limits of convergent AI: Williams (2026)
Reasoning biases and verification
- Automation bias and selective adherence in public-sector decisions: Alon-Barkat & Busuioc (2023)
- Automation bias in AI-assisted diagnostic reasoning: Qazi et al. (2025)
- LLM influence on diagnostic reasoning: Goh et al. (2024)
- LLM assistance and physician decision-making: Rounding et al. (2025)
Complementarity and downstream technical debt
- AI-assisted teams vs. AI-led vs. human-only teams: Brodeur et al. (2026)
- Field experiment on generative AI and teamwork: Dell’Acqua et al. (2025)
- AI writes faster than humans can review: He, Agarwal, et al. (2026)
- Speed at the cost of quality (Cursor AI): He, Miller, et al. (2026)
- AI-assisted programming and developer productivity: Xu et al. (2025)
- Downstream effects of AI assistants on maintainability: Borg et al. (2026)
- The expert penalty in high-skilled work: Cui et al. (2025)
- Early-2025 AI and experienced developer productivity: Becker et al. (2025)
- When combinations of humans and AI are useful: Vaccaro et al. (2024)
- Complementarity in human-AI collaboration: Hemmer et al. (2025)
- Prompt problems for learning programming: Prather et al. (2024)