# Constraints on Generality: from your sample to a defensible claim

Decision workbook and teaching example · 2026-10-06

The completed case is fictional. Its values and decisions are not actual findings; complete your project using relevant permissions, methods and requirements.

- Project: ____________________
- Researcher and role: ____________________
- Date and version: ____________________
- Data seen before the decision: ____________________
- Aim and scope: ____________________

## Completed example

| Stage/decision | Example | Check or action |
| --- | --- | --- |
| Population | Adult volunteers in one course | Distinguish sample and target. |
| Setting | Online class | Specify transfer conditions. |
| Stimuli | Persian words | Limit instrument/language scope. |
| Time | One-week follow-up | Do not claim long-term persistence. |
| Next evidence | Another setting and language | Propose a suitable extension design. |

## Complete your own record

| Topic | Actual decision and reason | Evidence link and status |
| --- | --- | --- |
| Population | __________ | __________ |
| Setting | __________ | __________ |
| Stimuli | __________ | __________ |
| Time | __________ | __________ |
| Next evidence | __________ | __________ |

## Completion checks

- [ ] A scope and target-claim matrix.
- [ ] A COG statement matched to actual evidence.
- [ ] An evidence plan for extending scope.

## Changes and limitations

| Date | Change | Data known at decision time | Reason | Consequence for claim | Reviewer |
| --- | --- | --- | --- | --- | --- |
| __________ | __________ | __________ | __________ | __________ | __________ |

## Sources and further reading

- [Simons, Shoda & Lindsay (2017) — Constraints on Generality](https://journals.sagepub.com/doi/10.1177/1745691617708630)
- [CASP — Critical appraisal checklists](https://casp-uk.net/casp-tools-checklists/)
- [Hernán & Robins — Causal Inference: What If (author-hosted book, 2024 version)](https://www.hsph.harvard.edu/miguel-hernan/wp-content/uploads/sites/1268/2024/04/hernanrobins_WhatIf_26apr24.pdf)

Related guide: https://didgar-research-site1.vercel.app/en/guides/constraints-on-generality/