Operations and management
Did the operating change improve contribution, throughput, availability, or customer outcomes beyond normal business movement?
Anything that changes how the business runs: hours, staffing model, training, fulfilment, or who is running a location.
RolloutGrade evaluates the business intervention at an aggregated level. It is not an employee-performance surveillance product.
Decisions this covers
- Store-manager transition
- Operating-hours change
- Staffing model
- Training program
- Fulfilment process
What RolloutGrade can conclude
- What the affected locations did against comparable untreated locations
- How receipts, average ticket and gross contribution moved
- Whether the result survives removing any single location
What it cannot conclude without stronger data
- Contribution per open or labour hour — that calculation does not exist in the engine yet
- Which specific operating practice drove a change, when several changed together
- Anything about an individual's performance
What this needs from you
- Analytical unit
- Location, per trading day
- Typical data inputs
- Transaction export by location and trading day
- The change date and the locations affected
- Comparable untreated locations
- Operating hours or labour data, when a throughput answer is wanted
Outputs available for this change
Only metrics deterministic code already computes appear here. Anything RolloutGrade cannot produce today is listed further down as a gap, not as a feature.
From your transaction export alone
- Gross sales. What rang up, before discounts and refunds are taken off.
- Net revenue after discounts and refunds. Gross sales with discounts and refunds removed.
- Units, receipts and average ticket. How much was sold, on how many receipts, at what average size.
- Historical period comparison. This period measured against a comparable earlier period.
- Evidence grade. How much weight the result can carry, with the reasons stated.
- Scenario sensitivity range. The result recalculated under a fixed high and low scenario. A robustness range, not a confidence interval.
- Study readiness assessment. Whether the data and comparison on hand can carry the decision you want to make.
- Sample size and minimum detectable effect. How large an effect this much data could actually detect.
- Ongoing monitoring checks. Scheduled re-reads that tell you when a decision stops holding.
Available when the data and design allow it
Gross contribution after direct product costs. Net revenue minus the direct cost of the goods sold. Not profit — it carries no rent, labour or overhead.
Requires — A unit cost for every product in scope
Expected performance without the change. Our estimate of what the period would have looked like if nothing had changed.
Requires — Either untreated comparison locations covering the same dates, or a comparable earlier period
Control-adjusted lift. The movement left over once the comparison group's movement over the same dates is subtracted.
Requires — Untreated comparison locations covering both the baseline and the change period
Estimated incremental gross contribution. The gross contribution we estimate would not have existed without the change. Not profit.
Requires — Untreated comparison locations covering both periods; A unit cost for every product in scope
Leave-one-location-out sensitivity. The result recalculated with each changed location removed in turn.
Requires — Two or more locations that received the change
Pre-change trend check. Whether the changed and comparison groups already moved together before the change.
Requires — A comparison group; Baseline history before the change date
Execution Fidelity. Whether the change was actually delivered everywhere it was supposed to be.
Requires — The intended rollout recorded for each changed location — which stores were meant to carry the change, over which dates
Locked success-rule evaluation. Whether the result cleared the success bar you locked before seeing it.
Requires — A success threshold locked, with an explicit denominator, before any result for the study was first shown — the lock applies on every surface and refuses once a result has been seen
Survey and review context. Why customers say they behaved as they did. Explanatory only — it never moves the economics or the decision.
Requires — Survey responses or a review export
Rollout projection. What the same change might be worth across further locations, with assumptions stated.
Requires — An incremental contribution estimate; A list of candidate locations
Not available yet (7) — what RolloutGrade does not compute for this change
- Decision Isolation. How much of the measured movement can be separated from everything else that changed at the same time. No deterministic calculation produces this today, so it is not offered.
- Decision Stability. Whether the recommended action holds up under reasonable alternative assumptions. No deterministic calculation produces this today, so it is not offered.
- Persistence or novelty decay. Whether an early effect held up or faded once the novelty wore off. No deterministic calculation produces this today, so it is not offered.
- Break-even or reversal threshold. The computed point at which the result would flip the recommended action. No deterministic calculation produces this today, so it is not offered.
- Value of more testing. What another two weeks of data would be worth against the cost of waiting. No deterministic calculation produces this today, so it is not offered.
- Contribution per open or labour hour. Gross contribution divided by the hours it took to produce it. No deterministic calculation produces this today, so it is not offered.
- Location or geography rollout ranking. Which locations to change next, ordered by expected value. No deterministic calculation produces this today, so it is not offered.
The decision you receive
- Expand
- Modify
- Reverse
- Continue testing
Each decision arrives with the economic impact behind it, the strength of the evidence, a stated condition that would reverse it, and what to check at 30, 60 and 90 days.
Evidence limitations to expect
- Operating changes rarely arrive alone. Where several changed together, the result covers the bundle, not one practice.
- Aggregated location results cannot be read as a judgement of any individual.