validation-tracker.md
1 --- 2 title: Validation Tracker - Critical Assumptions & Metrics 3 category: 09-business 4 last_verified: 2026-02-16 5 related_files: 6 - business-plan/333Method-Business-Plan.md 7 - docs/03-pipeline/outreach-strategy.md 8 tags: [validation, metrics, kpis, conversion, profitability] 9 status: active 10 --- 11 12 # Validation Tracker - Critical Assumptions & Metrics 13 14 **Purpose:** Track real-world data to validate business plan assumptions and inform GO/NO-GO decisions. 15 16 **Update Frequency:** Weekly (every Monday) 17 18 **Last Updated:** 2026-02-16 (baseline - no data yet) 19 20 --- 21 22 ## Quick Status Dashboard 23 24 | Milestone | Target | Current | Status | ETA | 25 | ----------------------- | ------------------ | ------- | -------------- | --- | 26 | **Month 1 Validation** | 2,500 outreaches | 0 | 🔴 Not Started | - | 27 | **Month 2 Validation** | 50 responses | 0 | 🔴 Not Started | - | 28 | **Month 3 GO/NO-GO** | 30 customers | 0 | 🔴 Not Started | - | 29 | **Business Break-Even** | 1 customer/month | 0 | 🔴 Not Started | - | 30 | **Personal Break-Even** | 30 customers/month | 0 | 🔴 Not Started | - | 31 32 **Legend:** 🟢 On Track | 🟡 At Risk | 🔴 Off Track / Not Started 33 34 --- 35 36 ## Weekly Metrics (Update Every Monday) 37 38 ### Week 1 (2026-02-XX to 2026-02-XX) 39 40 | Metric | Target | Actual | Status | Notes | 41 | ------------------- | ------------------ | ------ | ------ | ------------------------ | 42 | **Outreaches Sent** | 500/week | - | - | Across all channels | 43 | **Response Rate** | 2% (10 responses) | - | - | Responses ÷ Outreaches | 44 | **Conversion Rate** | 20% | - | - | Customers ÷ Responses | 45 | **Overall Funnel** | 0.4% (2 customers) | - | - | Customers ÷ Outreaches | 46 | **CAC** | <$50 | - | - | Total costs ÷ Customers | 47 | **Time to Close** | <14 days | - | - | First contact → Purchase | 48 | **NPS** | >50 | - | - | Promoters - Detractors | 49 | **CSAT** | >80% | - | - | Satisfied ÷ Total | 50 51 **Channel Breakdown:** 52 53 | Channel | Sent | Responses | Customers | Conversion | Notes | 54 | ----------- | ---- | --------- | --------- | ---------- | ----- | 55 | Email | - | - | - | - | | 56 | SMS | - | - | - | - | | 57 | Form | - | - | - | - | | 58 | X (Twitter) | - | - | - | - | | 59 | LinkedIn | - | - | - | - | | 60 | **Total** | - | - | - | - | | 61 62 **Key Insights:** 63 64 - [ ] What worked well this week? 65 - [ ] What didn't work? 66 - [ ] What to change next week? 67 68 --- 69 70 ### Week 2 (2026-02-XX to 2026-02-XX) 71 72 | Metric | Target | Actual | Status | Notes | 73 | ------------------- | -------- | ------ | ------ | ----- | 74 | **Outreaches Sent** | 500/week | - | - | | 75 | **Response Rate** | 2% | - | - | | 76 | **Conversion Rate** | 20% | - | - | | 77 | **Overall Funnel** | 0.4% | - | - | | 78 | **CAC** | <$50 | - | - | | 79 | **Time to Close** | <14 days | - | - | | 80 | **NPS** | >50 | - | - | | 81 | **CSAT** | >80% | - | - | | 82 83 **Channel Breakdown:** 84 85 | Channel | Sent | Responses | Customers | Conversion | Notes | 86 | ----------- | ---- | --------- | --------- | ---------- | ----- | 87 | Email | - | - | - | - | | 88 | SMS | - | - | - | - | | 89 | Form | - | - | - | - | | 90 | X (Twitter) | - | - | - | - | | 91 | LinkedIn | - | - | - | - | | 92 | **Total** | - | - | - | - | | 93 94 **Key Insights:** 95 96 - [ ] What worked well this week? 97 - [ ] What didn't work? 98 - [ ] What to change next week? 99 100 --- 101 102 ## Month 1 Checkpoint (After 2,500-5,000 Outreaches) 103 104 **Date Completed:** \***\*\_\_\_\*\*** 105 106 **Total Outreaches Sent:** \***\*\_\_\_\*\*** 107 108 ### Response Rate Validation 109 110 | Metric | Target | Actual | Variance | Status | 111 | ---------------------- | ------ | ------ | -------- | ------ | 112 | **Response Rate** | 2% ±1% | - | - | 🔴 | 113 | **Responses Received** | 50-100 | - | - | 🔴 | 114 | **Bounce Rate** | <5% | - | - | 🔴 | 115 | **Spam Complaints** | <1% | - | - | 🔴 | 116 | **Open Rate** | - | - | - | - | 117 | **Click Rate** | - | - | - | - | 118 119 ### Channel Effectiveness 120 121 | Channel | Sent | Responses | Response Rate | Cost | CPR | Rank | 122 | ----------- | ---- | --------- | ------------- | ---- | --- | ---- | 123 | Email | - | - | - | - | - | - | 124 | SMS | - | - | - | - | - | - | 125 | Form | - | - | - | - | - | - | 126 | X (Twitter) | - | - | - | - | - | - | 127 | LinkedIn | - | - | - | - | - | - | 128 129 **Best Channel:** \***\*\_\_\_\*\*** 130 131 **Worst Channel:** \***\*\_\_\_\*\*** 132 133 ### Red Flags Check 134 135 - [ ] Response rate <1% → **STOP: Reassess outreach copy/targeting** 136 - [ ] Spam complaints >5% → **STOP: Soften approach, review CAN-SPAM compliance** 137 - [ ] Bounce rate >10% → **STOP: Clean email list, verify phone numbers** 138 139 ### Decisions & Actions 140 141 **What to change:** 142 143 - [ ] 144 - [ ] 145 - [ ] 146 147 **What to double down on:** 148 149 - [ ] 150 - [ ] 151 - [ ] 152 153 **Updated assumptions for Month 2:** 154 155 - Response rate: **\_\_**% 156 - Expected responses/month: **\_\_** 157 - Expected customers/month: **\_\_** 158 159 --- 160 161 ## Month 2-3 Checkpoint (After 50-100 Responses) 162 163 **Date Completed:** \***\*\_\_\_\*\*** 164 165 **Total Responses:** \***\*\_\_\_\*\*** 166 167 ### Conversion Rate Validation 168 169 | Metric | Target | Actual | Variance | Status | 170 | ----------------------------- | ----------- | ------ | -------- | ------ | 171 | **Conversion Rate** | 20% ±10% | - | - | 🔴 | 172 | **Customers Acquired** | 10-30 | - | - | 🔴 | 173 | **Time to Close** | <14 days | - | - | 🔴 | 174 | **Price Acceptance** | <10% object | - | - | 🔴 | 175 | **Report Satisfaction (NPS)** | >50 | - | - | 🔴 | 176 177 ### Customer Feedback 178 179 **Common Objections:** 180 181 1. 182 2. 183 3. 184 185 **Common Praise:** 186 187 1. 188 2. 189 3. 190 191 **Feature Requests:** 192 193 1. 194 2. 195 3. 196 197 ### Red Flags Check 198 199 - [ ] Conversion rate <10% → **STOP: Reassess proposal quality or pricing** 200 - [ ] Time to close >30 days → **STOP: Simplify sales process** 201 - [ ] Price objections >20% → **STOP: Test lower price point ($197)** 202 - [ ] NPS <30 → **STOP: Improve report quality, add human review** 203 204 ### Decisions & Actions 205 206 **What to change:** 207 208 - [ ] 209 - [ ] 210 - [ ] 211 212 **What to double down on:** 213 214 - [ ] 215 - [ ] 216 - [ ] 217 218 **Updated assumptions for Month 3:** 219 220 - Conversion rate: **\_\_**% 221 - Expected customers/month: **\_\_** 222 - Updated revenue forecast: $**\_\_** 223 224 --- 225 226 ## Month 3-4 GO/NO-GO Decision Point (After 30-50 Customers) 227 228 **Date Completed:** \***\*\_\_\_\*\*** 229 230 **Total Customers:** \***\*\_\_\_\*\*** 231 232 ### Unit Economics Validation 233 234 | Metric | Target | Actual | Variance | Status | 235 | ----------------- | -------- | ------ | -------- | ------ | 236 | **CAC (Real)** | <$50 | - | - | 🔴 | 237 | **LTV (Year 1)** | $297 | - | - | 🔴 | 238 | **LTV:CAC Ratio** | >5:1 | - | - | 🔴 | 239 | **Gross Margin** | >95% | - | - | 🔴 | 240 | **Time to Close** | <14 days | - | - | 🔴 | 241 | **NPS** | >50 | - | - | 🔴 | 242 | **CSAT** | >80% | - | - | 🔴 | 243 244 ### Channel ROI Ranking 245 246 | Channel | Customers | CAC | Conversion | Time to Close | ROI Rank | 247 | ----------- | --------- | --- | ---------- | ------------- | -------- | 248 | Email | - | - | - | - | - | 249 | SMS | - | - | - | - | - | 250 | Form | - | - | - | - | - | 251 | X (Twitter) | - | - | - | - | - | 252 | LinkedIn | - | - | - | - | - | 253 254 **Best Channel:** \***\*\_\_\_\*\*** 255 **Worst Channel:** \***\*\_\_\_\*\*** (consider dropping) 256 257 ### A/B Test Results (If Conducted) 258 259 **Test:** Template vs AI-Personalized Outreach 260 261 | Variant | Sent | Responses | Customers | Conversion | Winner | 262 | --------------- | ---- | --------- | --------- | ---------- | ------ | 263 | Template | - | - | - | - | - | 264 | AI-Personalized | - | - | - | - | - | 265 266 **Decision:** Continue with \***\*\_\_\_\*\*** approach 267 268 ### API Cost Validation 269 270 | Stage | Assumed Cost | Actual Cost | Variance | Notes | 271 | ------------------------- | ------------ | ----------- | -------- | ----- | 272 | Scoring (GPT-4o-mini) | $0.015/site | - | - | | 273 | Rescoring (GPT-4o-mini) | $0.015/site | - | - | | 274 | Proposals (Claude Sonnet) | $0.18/site | - | - | | 275 | Enrichment (Claude Haiku) | $0.02/site | - | - | | 276 | **Total per site** | **$0.23** | **-** | **-** | | 277 278 **Cost per customer:** \***\*\_\_\_\*\*** 279 280 --- 281 282 ## GO/NO-GO Decision Framework 283 284 ### ✅ GO (Proceed to Scaling) 285 286 **Criteria:** 287 288 - [ ] CAC <$100 289 - [ ] Conversion rate >0.2% (overall funnel) 290 - [ ] NPS >40 291 - [ ] Time to close <21 days 292 - [ ] Gross margin >95% 293 - [ ] Achieved 30+ customers in 3 months 294 295 **If GO:** 296 297 - [ ] Scale outreach to 1,000/week 298 - [ ] Hire VA for outreach QA (if needed) 299 - [ ] Implement referral program 300 - [ ] Launch monitoring subscriptions 301 - [ ] Update Year 1 forecast with actual metrics 302 303 --- 304 305 ### 🟡 PIVOT (Adjust Strategy) 306 307 **Criteria:** 308 309 - [ ] CAC $100-200 → Optimize outreach copy, focus on best channels 310 - [ ] Conversion rate 0.1-0.2% → Improve proposal quality, test pricing 311 - [ ] NPS 30-40 → Enhance report quality, add human review 312 - [ ] Time to close 21-30 days → Simplify sales process 313 314 **Pivot Actions:** 315 316 - [ ] A/B test new outreach copy 317 - [ ] Test pricing tiers ($197/$297/$497) 318 - [ ] Add human review to reports 319 - [ ] Focus only on top 2 channels 320 - [ ] Extend validation by 1-2 months 321 322 --- 323 324 ### 🛑 STOP (Major Reassessment) 325 326 **Criteria:** 327 328 - [ ] CAC >$200 329 - [ ] Conversion rate <0.1% 330 - [ ] NPS <30 331 - [ ] Time to close >30 days 332 - [ ] Cannot reach 30 customers in 3 months 333 334 **If STOP:** 335 336 - [ ] Pause outreach campaigns 337 - [ ] Conduct customer interviews (existing customers + non-converters) 338 - [ ] Reassess product-market fit 339 - [ ] Consider pivoting to different target market 340 - [ ] Evaluate alternative business models (consulting, agency, etc.) 341 342 --- 343 344 ## Decision Outcome 345 346 **Date:** \***\*\_\_\_\*\*** 347 348 **Decision:** [ ] GO | [ ] PIVOT | [ ] STOP 349 350 **Rationale:** 351 352 **Next Steps:** 353 354 1. 355 2. 356 3. 357 358 **Updated Forecast (if GO or PIVOT):** 359 360 - Month 4-6 target: **\_\_** customers/month 361 - Month 7-9 target: **\_\_** customers/month 362 - Month 10-12 target: **\_\_** customers/month 363 - Year 1 total: **\_\_** customers, $**\_\_** revenue 364 365 --- 366 367 ## Critical Assumptions Status 368 369 | Assumption | Original | Validated | Actual | Status | Last Updated | 370 | -------------------- | -------- | --------- | ------ | -------- | ------------ | 371 | **Response Rate** | 2% | 🔴 No | - | Untested | - | 372 | **Conversion Rate** | 20% | 🔴 No | - | Untested | - | 373 | **Overall Funnel** | 0.4% | 🔴 No | - | Untested | - | 374 | **Price Acceptance** | $297 | 🔴 No | - | Untested | - | 375 | **API Cost/Site** | $0.23 | 🔴 No | - | Untested | - | 376 | **Time to Close** | <14 days | 🔴 No | - | Untested | - | 377 | **NPS** | >50 | 🔴 No | - | Untested | - | 378 | **Best Channel** | Unknown | 🔴 No | - | Untested | - | 379 380 **Legend:** 🟢 Validated & On Track | 🟡 Validated & Off Track | 🔴 Not Yet Validated 381 382 --- 383 384 ## Notes & Learnings 385 386 ### Week 1 387 388 - 389 - 390 - 391 392 ### Week 2 393 394 - 395 - 396 - 397 398 ### Month 1 399 400 - 401 - 402 - 403 404 ### Month 2 405 406 - 407 - 408 - 409 410 ### Month 3 411 412 - 413 - 414 - *** 415 416 ## Resources 417 418 **Related Documents:** 419 420 - [Business Plan - Validation Plan](../business-plan/333Method-Business-Plan.md#validation-plan--critical-assumptions) 421 - [Outreach Strategy Analysis](./03-pipeline/outreach-strategy.md) (if exists) 422 - [Pipeline Capacity Analysis](./03-pipeline/pipeline-capacity.md) 423 424 **Tracking Tools:** 425 426 - Database queries: `SELECT * FROM conversations WHERE created_at > DATE('now', '-7 days')` 427 - Dashboard: `npm run dashboard` → Outreach & Conversations pages 428 - Reports: `npm run report:daily` 429 430 **Update Process:** 431 432 1. Run dashboard Monday morning: `npm run dashboard` 433 2. Export weekly metrics from Outreach & Conversations pages 434 3. Update this document with actual numbers 435 4. Calculate variance from targets 436 5. Identify what to change vs double down 437 6. Update assumptions if needed 438 7. Commit to git: `git add docs/validation-tracker.md && git commit -m "docs: update validation tracker Week X"` 439 440 --- 441 442 **Document Version:** 1.0 443 **Created:** 2026-02-16 444 **Last Updated:** 2026-02-16 445 **Next Review:** 2026-02-23 (Week 1)