The measurement-error indicator audit
An indicator can be useful and still incomplete. Name the construct, domain, rule, timing, error mechanism, validation path, and decision before interpreting the number.
| Audit ID | Construct and domain | Indicator rule | Observed record | Error mechanism to test | Validation evidence | Decision disposition |
|---|---|---|---|---|---|---|
| M-01 | Pipeline quality: a current opportunity can advance with stage evidence, amount, timing, and a next event | Stage field only | Negotiation | Underrepresentation and timing | Stage history, next event, and amount snapshot | Incomplete proxy; do not call stage alone pipeline quality |
| M-02 | Customer value: a customer completes the first promised workflow | Login count in 14 days | Five logins | Contamination and underrepresentation | First completed workflow event and account grain | Useful activity signal; not activation by itself |
| M-03 | Willingness to pay: acceptable price under a declared choice context | Stated maximum price | €1,200 | Context and response-mode error | Observed choice or transaction under a comparable offer | Stated measure only; do not call it observed price |
| M-04 | Sales productivity: productive selling time or output relative to a declared opportunity set | Email count | 48 emails | Contamination and grain mismatch | Time sample, opportunity work, and outcome horizon | Activity proxy; new validation required |
| M-05 | Forecast confidence: an ex ante probability or coded state with a declared information set | Rep-entered Commit category | Commit | Judgment and selection mechanism | Category history, information cutoff, and later outcome | Judgmental forecast; do not treat as objective probability |
| M-06 | Net price: price after the declared concession and collection boundary | Invoice line amount | €900 | Boundary omission and timing | Invoice, credits, pocket-price rule, and collection status | Name the price boundary before comparison |
Swipe or scroll horizontally if the table is wider than your screen.
Reference & Evidence
Source: Author's synthetic indicator audit grounded in MacKenzie, Podsakoff, and Podsakoff (2011) and Li and Ma (2024). All rows, values, mechanisms, and dispositions are illustrative.
Each line is a claim from the register this journal publishes against, resolved from the register at build time.
- A The paper's own purpose: "to integrate new and existing techniques into a comprehensive set of recommendations that can be used to give researchers in mis and the behavioral sciences a framework for developing valid measures" MacKenzie, Podsakoff & Podsakoff. (2011) ·
MCK11-C1 - A The failure it targets: techniques that "provide evidence that the set of items used to represent the focal construct actually measures what it purports to measure" are underused MacKenzie, Podsakoff & Podsakoff. (2011) ·
MCK11-C2 - A A sequence, not a checklist: "this process involves a series of steps beginning with construct conceptualization or reconceptualization of an existing construct" and ending in norms for the scale MacKenzie, Podsakoff & Podsakoff. (2011) ·
MCK11-C3 - A A review, in its own words: "We review some of the classical methods in both density estimation and regression problems with measurement errors" Li & Ma. (2024). An Update on Measurement Error Modeling captured 2026-09-06 ·
LMA24-C1 - A The error types it separates are its own keywords: "Berkson error, classical error, errors in variables" Li & Ma. (2024). An Update on Measurement Error Modeling captured 2026-09-06 ·
LMA24-C2 - A "a completely unknown error distribution will lead to unidentifiability": without knowing something about the error, "there is no way to distinguish x and w" Li & Ma. (2024). An Update on Measurement Error Modeling captured 2026-09-06 ·
LMA24-C3 - A The review's own scope names the trap: it considers "when the original error free model is parametric nonparametric and semiparametric in combination with different error types", so treating an observed variable as error-free is a modelling choice with consequences Li & Ma. (2024). An Update on Measurement Error Modeling captured 2026-09-06 ·
LMA24-C4 - B A construct, its domain, its indicator rule, and the recorded observation are different objects and should not be collapsed into one KPI label. Author synthesis ·
R07-OWN-C2 - B Construct underrepresentation, construct contamination, recording error, temporal misalignment, threshold misclassification, and missingness are distinct audit mechanisms. Author synthesis ·
R07-OWN-C3 - B A single indicator cannot identify its own error structure without assumptions or validation evidence. Author synthesis ·
R07-OWN-C4 - B A measurement audit should preserve the construct domain, unit, indicator rule, time boundary, missing and invalid states, validation path, error mechanism, and decision disposition. Author synthesis ·
R07-OWN-C7 - B An indicator can be operationally useful without being a complete measure of the construct it is named after. Author synthesis ·
R07-OWN-C8 - B The R-07 worksheet values and dispositions are synthetic and contain no customer, participant, product, or company data. Author synthesis ·
R07-OWN-C12
Grades: A, verified against the printed page of the primary source · B, primary source, text layer only · C, authoritative secondary · D, reported.
Related exhibits
-
The common-method-bias release sequence
From the essay Common method bias is not a checkbox
-
What are the construct, domain, indicator, and observation?
From the essay What is measurement error? The gap between a construct and its indicator
-
What is measurement error not?
From the essay What is measurement error? The gap between a construct and its indicator