← Every exhibit
The Experimentation RACI Matrix
| Experimentation Lifecycle Milestone | Product Manager / Growth Lead | Lead Data Scientist / Statistician | Software Engineering Lead | Executive Decision Committee |
|---|---|---|---|---|
| Problem Identification & Hypothesis Formulation | Accountable | Consulted | Consulted | Informed |
| Metric Selection & OEC Definition | Accountable | Responsible | Consulted | Informed |
| Prospective Power Calculation & Sizing Signoff | Consulted | Accountable | Informed | Informed |
| Variant Implementation & Code Deployment | Informed | Consulted | Accountable | Informed |
| Pre-Flight QA & A/A Instrumentation Verification | Consulted | Responsible | Accountable | Informed |
| Daily SRM Monitoring & Health Surveillance | Informed | Accountable | Responsible | Informed |
| Statistical Result Synthesis & FDR Correction | Consulted | Accountable | Informed | Informed |
| Rollout / Rollback Production Decision | Accountable | Consulted | Responsible | Accountable |
| Code Cleanup & Feature Flag Retirement | Informed | Informed | Accountable | Informed |
| Institutional Knowledge Base Codification | Accountable | Responsible | Consulted | Informed |
Swipe or scroll horizontally if the table is wider than your screen.
Reference & Evidence
Source: Table from this essay. Sources and interpretation are given in the article.
Related exhibits
-
Taxonomy of Experimentation Architectures
From the essay What is an A/B test? randomized controlled trials, statistical power, and governance
-
6. Executive Diagnostic Framework and Experimentation Audit Checklist
From the essay What is an A/B test? randomized controlled trials, statistical power, and governance
-
The A/B test experimental architecture
From the essay What is an A/B test? randomized controlled trials, statistical power, and governance