commercial
Commercial
Commercial outcome evidence — win rate, ACV, cycle, NRR, churn, displacement.
- Metrics
- 7
- Review cadence
- 7d
- Owner
- OWN_CEO
§16.8 · Category Metrics and Scoreboard · v16.8.0
The measurable evidence layer of category leadership
AIVAON's category leadership is measured, not asserted. Section 16.8 binds 26 rigorously-defined metrics across four measurement dimensions — commercial, product, technical, and strategic — to a competitor reference set of 8 named platforms and a four-cadence review loop that flows directly into the §16.7 Execution Operating System governance machinery. Truth precedence over comfort is the operating principle: the absence of a reading is itself an alertable signal.
Four measurement dimensions
product
Product
Product activation evidence — TTFC, TTP, integration, templates, continuity, on-device.
- Metrics
- 6
- Review cadence
- 14d
- Owner
- OWN_CPO
technical
Technical
Substrate performance evidence — latency, failure rate, routing, cost, uptime.
- Metrics
- 7
- Review cadence
- 7d
- Owner
- OWN_ENGINEERING
strategic
Strategic
Strategic positioning evidence — analyst, case studies, sovereign pipeline, search growth, ecosystem.
- Metrics
- 6
- Review cadence
- 30d
- Owner
- OWN_CEO
COMMERCIAL dimension · 7 metrics
Commercial
Commercial traction measures: competitive win rates, ACV trajectory, sales cycle length, expansion revenue (NRR), churn, and competitor displacement. Converts product-market fit and category definition into sustained commercial outcome.
Review every 7 days · Owner OWN_CEO
| Metric | Direction | Baseline | Q4 target | Year 2 | Source |
|---|---|---|---|---|---|
Win rate vs wrapper platforms (Vapi, Retell, Bland) Proportion of competitive deals won when the alternative consideration is one of Vapi, Retell, or Bland. Primary mechanic for wrapper-platform displacement. METRIC_WIN_RATE_VS_WRAPPERS | ↑ higher percent | 45% | 75% | 80% | database |
Win rate vs hyperscaler-native options (Google Contact Center AI, Microsoft Copilot Studio) Proportion of competitive deals won when the alternative is a hyperscaler-native voice AI platform. Tests AIVAON's sovereignty + substrate-ownership positioning against cloud-native incumbents. METRIC_WIN_RATE_VS_HYPERSCALER | ↑ higher percent | 35% | 65% | 72% | database |
Average annual contract value (ACV) trend ACV across new logos, trending upward as tier mix shifts toward Business and Enterprise SKUs. Evidence of enterprise-grade positioning taking hold. METRIC_ACV_TREND | ↑ higher usd | $25.0k | $72.0k | $120.0k | database |
Sales cycle length Median days from opportunity creation to close. Trending downward as category definition reduces evaluation complexity. METRIC_SALES_CYCLE_LENGTH | ↓ lower days | 120 d | 65 d | 55 d | crm |
Dollar-based net revenue retention (NRR) Expansion revenue from existing customers measured as dollar-based net retention. Primary driver of unit-economic sustainability. METRIC_NET_DOLLAR_RETENTION | ↑ higher percent | 105% | 125% | 135% | database |
Gross logo churn rate Trailing-12-month gross churn rate. Trending downward as platform integration deepens and customers accumulate switching cost. METRIC_CHURN_RATE | ↓ lower percent | 12% | 6% | 4% | database |
Competitor displacement rate Proportion of new deals that replace (rip-and-replace) a named competitor deployment. Leading indicator of the displacement motion that drives sustained category leadership. METRIC_COMPETITOR_DISPLACEMENT_RATE | ↑ higher percent | 15% | 45% | 55% | database |
PRODUCT dimension · 6 metrics
Product
Product activation + adoption measures: time-to-first-call (90s target), time-to-production (30m target), integration success rate, template deployment rate, continuity feature adoption, on-device hybrid intelligence usage. Converts the §16.2 product catalog into live productive-use evidence.
Review every 14 days · Owner OWN_CPO
| Metric | Direction | Baseline | Q4 target | Year 2 | Source |
|---|---|---|---|---|---|
Signup → first successful call (TTFC) Median time from signup completion to first successful voice call, p95 measured. Contractual commitment to the 90-second target that defines the §16.7 Phase 2 exit criterion. METRIC_TIME_TO_FIRST_CALL | ↓ lower seconds | 180 s | 90 s | 75 s | rum |
Signup → first production deployment (TTP) Median time from signup to first production-grade deployment, measured against the 30-minute target. Evidence of self-serve productive-use capability. METRIC_TIME_TO_PRODUCTION | ↓ lower minutes | 90 min | 30 min | 20 min | database |
Integration success rate Proportion of integration activations that reach production use within 14 days. Evidence of Marketplace integration quality. METRIC_INTEGRATION_SUCCESS_RATE | ↑ higher percent | 60% | 88% | 92% | database |
Template deployment rate Proportion of customers who deploy from a Studio / vertical-pack template rather than building from scratch. Evidence of template quality + onboarding acceleration. METRIC_TEMPLATE_DEPLOYMENT_RATE | ↑ higher percent | 35% | 72% | 80% | database |
Continuity feature adoption (ambient voice + memory) Proportion of active customers who activate ambient voice and memory continuity features. Differentiation adoption signal. METRIC_CONTINUITY_FEATURE_ADOPTION | ↑ higher percent | 18% | 58% | 70% | prometheus |
On-device hybrid intelligence usage Proportion of sessions that route inference to the on-device WebLLM / Edge runtime rather than managed/self-hosted. Measures the hybrid-intelligence pillar's commercial adoption. METRIC_ON_DEVICE_USAGE | ↑ higher percent | 15% | 50% | 62% | prometheus |
TECHNICAL dimension · 7 metrics
Technical
Technical performance measures: call setup latency P50/P95/P99 per cell, end-to-end conversational latency including barge-in response, session failure rate, model routing success, infrastructure cost per minute, uptime per cell and jurisdiction against SLA. The substrate evidence that supports every commercial + product claim.
Review every 7 days · Owner OWN_ENGINEERING
| Metric | Direction | Baseline | Q4 target | Year 2 | Source |
|---|---|---|---|---|---|
Call setup latency (P50, by cell) P50 time from carrier offer to media flowing, per cell (Ghana, US-East, US-West, EU-Frankfurt, UK-London, CA-Central). The median substrate-performance signal. METRIC_CALL_SETUP_LATENCY_P50 | ↓ lower milliseconds | 450 ms | 330 ms | 280 ms | prometheus |
Call setup latency (P95 + P99, by cell) P95 and P99 call setup latency per cell. Tail-latency evidence — the percentiles enterprise buyers evaluate against contractual SLA. METRIC_CALL_SETUP_LATENCY_P95_P99 | ↓ lower milliseconds | 1100 ms | 650 ms | 550 ms | prometheus |
End-to-end conversational latency including barge-in (P95) P95 time from end-of-user-utterance to start-of-agent-response, including barge-in resumption. The single number that determines whether the voice experience feels human. METRIC_E2E_CONVERSATIONAL_LATENCY | ↓ lower milliseconds | 720 ms | 470 ms | 400 ms | prometheus |
Session failure rate Proportion of sessions that terminate in a failure mode (unreachable, transcoding error, agent runtime crash, etc.). Trending downward as platform reliability matures. METRIC_SESSION_FAILURE_RATE | ↓ lower percent | 1.8% | 0.5% | 0.3% | prometheus |
Model routing success rate Proportion of model-gateway routing decisions that produce successful inference (completion + within-budget latency + no fallback cascade). Evidence of hybrid-intelligence stack operational quality. METRIC_MODEL_ROUTING_SUCCESS_RATE | ↑ higher percent | 96.5% | 99.2% | 99.6% | prometheus |
Infrastructure cost per minute Fully-loaded infrastructure cost per voice-minute served. Trending downward as scale efficiency compounds; primary input into unit-economic leadership. METRIC_INFRA_COST_PER_MINUTE | ↓ lower usd_per_minute | $0.045/min | $0.026/min | $0.020/min | database |
Uptime per cell and jurisdiction (vs SLA) Rolling 30-day uptime for each operational cell (Ghana, US-East, US-West, EU-Frankfurt, UK-London, CA-Central) measured against the contractual SLA. Evidence of multi-jurisdictional operational reality. METRIC_UPTIME_BY_CELL | ↑ higher percent | 99.88% | 99.98% | 99.99% | prometheus |
STRATEGIC dimension · 6 metrics
Strategic
Strategic positioning measures: analyst mentions (Gartner/Forrester/IDC), named customer case studies, sovereign pipeline, international revenue share, category search growth, and partner ecosystem growth. The leading-indicator set for sustained category leadership.
Review every 30 days · Owner OWN_CEO
| Metric | Direction | Baseline | Q4 target | Year 2 | Source |
|---|---|---|---|---|---|
Analyst mentions (Gartner, Forrester, IDC, equivalent) Cumulative count of named mentions in published research from Gartner, Forrester, IDC, and equivalent tier-one analyst organizations. Leading indicator of category positioning. METRIC_ANALYST_MENTIONS | ↑ higher count | 2 | 28 | 50 | analyst_feed |
Named customer case studies published Cumulative count of case studies published with named customer attribution. Primary commercial credibility mechanic. METRIC_NAMED_CASE_STUDIES | ↑ higher count | 1 | 18 | 35 | manual_entry |
Sovereign deals in pipeline (revenue signal) Forward-looking revenue in the pipeline for the Sovereign SKU / sovereign customer segment. The leading-indicator revenue signal for strategic-customer activation. METRIC_SOVEREIGN_PIPELINE_REVENUE | ↑ higher usd | $500.0k | $10.0M | $25.0M | crm |
Share of revenue outside core (US) market Proportion of ARR generated in non-US markets. Tracks the §16.5 / §16.7 multi-jurisdictional operational reality pillar's commercial traction. METRIC_INTERNATIONAL_REVENUE_SHARE | ↑ higher percent | 8% | 33% | 45% | database |
Category search growth ("sovereign voice AI" and related) Google Trends + equivalent search-volume growth rate for category queries ("sovereign voice AI", "GDPR voice AI", "HIPAA voice AI", "on-device voice AI"). Leading indicator that the category narrative is gaining external market recognition. METRIC_CATEGORY_SEARCH_GROWTH | ↑ higher percent_yoy | 45% | 180% | 250% | search_trends_api |
Certified partner ecosystem growth Cumulative count of certified partners (integration partners, solution partners, resellers). Evidence of ecosystem gravitational pull — the §16.7 Phase 5/6 commitment. METRIC_PARTNER_ECOSYSTEM_GROWTH | ↑ higher count | 8 | 100 | 200 | database |
Competitor reference set (8)
The named platforms that the win-rate and competitor displacement metrics compare against. Three clusters reflect the materially different competitive dynamics: wrapper platforms over managed inference, hyperscaler-native voice offerings, and incumbent enterprise contact-center suites.
wrapper platform
Vapi
voice AI API wrapper over managed LLM + carrier abstraction
Retell AI
conversational voice agent platform for developers
Bland AI
phone call automation with custom voice agents
hyperscaler native
Google Contact Center AI
Cloud-native omnichannel contact center with integrated conversational AI
Microsoft Copilot Studio
Microsoft cloud bot + voice builder inside Dynamics / Teams
enterprise voice
Genesys Cloud CX
enterprise contact center suite with AI add-ons
NICE CXone
enterprise CXaaS with Enlighten AI
Five9
cloud contact center with IVA stack
Review cadences (4)
The §16.8 measurement loop runs on four cadences that each link into a §16.7 governance cadence so the scoreboard feeds the Execution Operating System rather than running parallel to it.
weekly
Weekly Scoreboard Review
Reviews dimensions: dim_commercial, dim_product, dim_technical
Linked: CADENCE_WEEKLY_OPERATIONAL
monthly
Monthly Scoreboard Review
Reviews dimensions: dim_commercial, dim_product, dim_technical, dim_strategic
Linked: CADENCE_MONTHLY_STRATEGIC
quarterly
Quarterly Scoreboard Ratification
Reviews dimensions: dim_commercial, dim_product, dim_technical, dim_strategic
Linked: CADENCE_QUARTERLY_RATIFICATION
annual
Annual Scoreboard Trajectory Review
Reviews dimensions: dim_commercial, dim_product, dim_technical, dim_strategic