Pre/Post Deployment Scorecard
Purpose: Compare baseline (pre-deployment) performance against actual outcomes (post-deployment) to validate ROI projections and make the business case for continued investment or scaling.
Instructions: Complete the “Pre-Deployment” column before launch. Complete the “Post-Deployment” columns at 3, 6, and 12 months after launch. Calculate variance against the original projection.
Scorecard: [Project Name]
Project: [Name] Owner: [Name, Title] Deployment Date: [Date] Scorecard Period: [3 months / 6 months / 12 months] Last Updated: [Date]
Section 1: Adoption Scorecard
| Metric | Pre-Deployment | 3-Month Target | 3-Month Actual | 6-Month Target | 6-Month Actual | 12-Month Actual |
|---|---|---|---|---|---|---|
| Active users | N/A | [X] | [X] | |||
| % of target users adopted | 0% | [X%] | [X%] | |||
| Daily active usage rate | N/A | [X%] | [X%] | |||
| Sessions per user per week | N/A | [X] | [X] | |||
| Feature utilization rate | N/A | [X%] | [X%] |
Adoption Health: 🔴 Off Track / 🟡 At Risk / 🟢 On Track
Notes:
Section 2: Operational Performance Scorecard
Customize metrics for your specific use case. Examples below.
Efficiency Metrics
| Metric | Pre-Deployment Baseline | Projected Post | 3-Month Actual | 6-Month Actual | 12-Month Actual | % Change |
|---|---|---|---|---|---|---|
| [Primary time metric, e.g., “Avg handle time”] | [Value] | [Value] | ||||
| [Throughput metric, e.g., “Tasks completed/FTE/day”] | [Value] | [Value] | ||||
| [Quality metric, e.g., “Error rate”] | [Value] | [Value] | ||||
| [Speed metric, e.g., “Time to delivery”] | [Value] | [Value] | ||||
| [Volume metric, e.g., “Tasks processed per month”] | [Value] | [Value] |
Quality Metrics
| Metric | Pre-Deployment Baseline | Projected Post | 3-Month Actual | 6-Month Actual | 12-Month Actual | % Change |
|---|---|---|---|---|---|---|
| [e.g., “CSAT score”] | [Value] | [Value] | ||||
| [e.g., “Error / rework rate”] | [Value] | [Value] | ||||
| [e.g., “First-pass quality rate”] | [Value] | [Value] |
Section 3: Financial Scorecard
Cost Tracking
| Cost Category | Year 1 Budget | Month 3 Actual (Annualized) | Month 6 Actual (Annualized) | Month 12 Actual | Variance vs. Budget |
|---|---|---|---|---|---|
| Development | $[X] | ||||
| Integration | $[X] | ||||
| Training | $[X] | ||||
| Monthly infrastructure | $[X]/mo | ||||
| Monthly API/model costs | $[X]/mo | ||||
| Monthly maintenance | $[X]/mo | ||||
| Total | $[X] |
Cost Variance Notes:
Benefit Tracking
| Benefit Category | Year 1 Projected | Month 3 Realized (Annualized) | Month 6 Realized (Annualized) | Month 12 Realized | % of Projection |
|---|---|---|---|---|---|
| Labor savings | $[X] | ||||
| Process cost reduction | $[X] | ||||
| Productivity gains | $[X] | ||||
| Revenue growth | $[X] | ||||
| Risk mitigation | $[X] | ||||
| Total | $[X] |
Benefit Realization Notes:
ROI Summary
| Metric | Original Projection | 6-Month Actual | 12-Month Actual |
|---|---|---|---|
| Cumulative cost to date | $[X] | ||
| Cumulative benefit to date | $[X] | ||
| Net position | $[X] | ||
| Current ROI | [X]% | ||
| Break-even month (projected) | Month [N] | — | — |
| Break-even month (actual) | Month [N] |
Section 4: User Experience Scorecard
| Metric | Pre-Deployment | 3-Month Target | 3-Month Actual | 6-Month Actual | 12-Month Actual |
|---|---|---|---|---|---|
| Employee satisfaction with tool (1–5) | N/A (baseline: overall satisfaction with current tools) | [X] | |||
| Perceived time savings (hrs/week, survey) | [X] hrs | [X] hrs | |||
| % of users who would recommend tool to colleague | N/A | [X%] | |||
| AI output accuracy rating (user survey) | N/A | [X%] positive |
User Experience Notes:
Section 5: Risk and Compliance Scorecard
| Risk Indicator | Status | Notes |
|---|---|---|
| AI-generated errors reaching end users | 🔴 🟡 🟢 | |
| Compliance/regulatory issues flagged | 🔴 🟡 🟢 | |
| Data privacy incidents | 🔴 🟡 🟢 | |
| Security vulnerabilities identified | 🔴 🟡 🟢 | |
| Model accuracy within acceptable range | 🔴 🟡 🟢 | |
| Escalation/override path functioning | 🔴 🟡 🟢 |
Section 6: Overall Assessment
3-Month Assessment
Overall Status: 🔴 Off Track / 🟡 At Risk / 🟢 On Track
| Dimension | Status | Key Finding |
|---|---|---|
| Adoption | 🔴 🟡 🟢 | |
| Operational performance | 🔴 🟡 🟢 | |
| Financial (costs) | 🔴 🟡 🟢 | |
| Financial (benefits) | 🔴 🟡 🟢 | |
| User experience | 🔴 🟡 🟢 | |
| Risk / compliance | 🔴 🟡 🟢 |
Top 3 Findings: 1. 2. 3.
Recommended Actions:
- [Action 1] — Owner: [Name], Due: [Date]
- [Action 2] — Owner: [Name], Due: [Date]
6-Month Assessment
Overall Status: 🔴 Off Track / 🟡 At Risk / 🟢 On Track
| Dimension | Status | Key Finding |
|---|---|---|
| Adoption | 🔴 🟡 🟢 | |
| Operational performance | 🔴 🟡 🟢 | |
| Financial (costs) | 🔴 🟡 🟢 | |
| Financial (benefits) | 🔴 🟡 🟢 | |
| User experience | 🔴 🟡 🟢 | |
| Risk / compliance | 🔴 🟡 🟢 |
Revised ROI Projection (based on actual data):
- Year 1 ROI: [X]% (was [X]% in original projection)
- Break-even: Month [N] (was Month [N] in original projection)
- 3-Year ROI: [X]% (was [X]% in original projection)
Recommendation:
- Continue as planned
- Modify approach: [description]
- Accelerate scaling: [description]
- Pause and review: [description]
- Terminate: [description]
Rationale:
12-Month Assessment
Overall Status: 🔴 Off Track / 🟡 At Risk / 🟢 On Track
Annual Summary Statement:
1–2 paragraph summary of what was achieved in Year 1, what the actual ROI was, and the recommendation for Year 2.
Year 1 Scorecard Summary:
| Metric | Projected | Actual | Variance |
|---|---|---|---|
| Total investment | $[X] | $[X] | [+/-X%] |
| Total benefits | $[X] | $[X] | [+/-X%] |
| Net benefit | $[X] | $[X] | [+/-X%] |
| ROI | [X%] | [X%] | [+/-X pp] |
| Break-even | Month [N] | Month [N] | [+/-N months] |
Year 2 Recommendation:
- Budget request: $[X]
- Scope: [Continue current scope / Expand to: X]
- Key initiatives: [List]
Appendix: Data Collection Log
| Date | Metric | Value | Source | Collector |
|---|---|---|---|---|