# Multiverse and specification-curve analysis: decisions to results

Decision workbook and teaching example · 2026-10-06

The completed case is fictional. Its values and decisions are not actual findings; complete your project using relevant permissions, methods and requirements.

- Project: ____________________
- Researcher and role: ____________________
- Date and version: ____________________
- Data seen before the decision: ____________________
- Aim and scope: ____________________

## Completed example

| Stage/decision | Example | Check or action |
| --- | --- | --- |
| Quality choice | Three rules on synthetic flags | Document the rationale and flag origin. |
| Model | Unadjusted or baseline-adjusted | Explain estimand and adjustment. |
| Paths | 3 × 2 = 6 compatible paths | Retain failures and incompatibilities. |
| Result | Score units per hour | Keep units, sample and uncertainty method. |
| Display | All-path table and plot | Label outcome-informed additions. |

## Complete your own record

| Topic | Actual decision and reason | Evidence link and status |
| --- | --- | --- |
| Quality choice | __________ | __________ |
| Model | __________ | __________ |
| Paths | __________ | __________ |
| Result | __________ | __________ |
| Display | __________ | __________ |

## Completion checks

- [ ] Justified decision and option table.
- [ ] All-path results with sample counts and status.
- [ ] Code, synthetic inputs and six-path rerun outputs.

## Changes and limitations

| Date | Change | Data known at decision time | Reason | Consequence for claim | Reviewer |
| --- | --- | --- | --- | --- | --- |
| __________ | __________ | __________ | __________ | __________ | __________ |

## Sources and further reading

- [multiverse — Official R package documentation](https://mucollective.github.io/multiverse/)
- [Center for Open Science — TOP 2025](https://www.cos.io/initiatives/top-guidelines)
- [American Statistical Association — Statement on p-values](https://www.amstat.org/asa/files/pdfs/p-valuestatement.pdf)

Related guide: https://didgar-research-site1.vercel.app/en/guides/multiverse-analysis/