Explore·Research Planning·Augmentation·Developing·EXP-004
Research Plan Critique
Value hypothesis
Reduces the risk of flawed research design by subjecting plans to structured adversarial critique, identifying blind spots and biases before they impact data collection or synthesis.
Quality · Insight
The researcher asks an LLM to review their draft research plan from an adversarial stance, critiquing assumptions, questioning methodology choices, looking for possible issues and potential biases in the study design. Unlike co-creation, the AI here is explicitly a challenger, and the researcher should integrate or rebut the proposed critiques. Recommended practice extends this into a formal bias audit after synthesis, prompting AI to identify which participant segments or perspectives may have been underweighted in the analysis.
Risks in application
Bias Bleed
The bias-checking tool itself carries embedded biases, making the critique potentially unreliable or limited for certain domains.
Shallow Solutions
Critique appears thorough but misses domain-specific, cultural, or contextually specific issues that human expertise would have found.
Expertise that differentiates
Research and Insight
Evaluating which critiques are valid vs. spurious. Knowing when to keep the original, and when challenges merit rework.
Ethical Assessment
Bias detection, fairness evaluation, and recognizing whose perspectives are structurally absent from the research design.
AI Fluency that assures
Task Delegation
Framing the delegation as adversarial requires specifying which dimensions the AI should attack. A vague 'critique this' produces generic objections; a structured brief produces targeted ones.
Performance Discernment
Distinguishing critiques that point to real methodological gaps from critiques that are technically valid but trivial in context.
Related
Possible Indicators
Blind spot detection rate
Actionable critiques identified relative to an unreviewed plan
Bias coverage
Proportion of potential bias types surfaced relative to a structured bias checklist