~/portfolio/projects/itsm-deployment-vs-renewals
← cd ../projects

#05 · 2020

ITSM App Deployment vs. Renewal Performance

Analysis (employer work, de-identified)
readme.md

Customer success analytics · Threshold analysis · Sentiment analysis · Logistic regression

94% vs 70%

GRR deployed vs. undeployed

50%

deployment tipping point for upsell

+75%

upsell odds with Request Mgmt

my_role: Individual Contributor (IC) - defined the proxy metric, built the deployment tagging, ran threshold, sentiment and regression analyses, and presented findings to customer success leadership.

Is there a correlation between apps being deployed and renewal performance? A research & insights study for an ITSM business unit, combining deployment threshold analysis, sentiment analysis of engagement surveys, and logistic regression to show which deployments drive upsell and retention.

## The question

Is there a correlation between apps being deployed and renewal performance for the ITSM business unit? The initial objective - renewal performance versus implementation status - hit a roadblock: some implementation records had fallacies that could skew the output. Adoption status was binary only, and BU maturity levels were outdated (~95% of ITSM accounts sat at level 0 or 1). Usage status, multi-level and constantly updated by product teams, became the proxy. Refined objective: what is the impact on renewal performance vis-à-vis prior usage status?

## Data & methodology

  • ›Core and Pro ITSM customers with renewals in the last three quarters (19-Q4, 20-Q1, 20-Q2)
  • ›Best app usage status over the three months before renewal, per entitled app (Incident, Request, Change, Service Catalog, CMDB, Analytics, Virtual Assistant, Predictive)
  • ›Not Activated / Activated–Not in Use = undeployed; Low / Medium / High Use = deployed
  • ›An account with at least one deployed app is a deployed account; no-visibility apps are excluded from deployed %
  • ›Excluded MSPs, Federal/On-Prem/Blocked, APAC (incomplete scan data) and ACV outliers at a set cutoff
  • ›Renewal outcomes: BU Upsell, BU Straight, BU Downsell, BU Lost, Opp Lost

## Summary of key findings

  • ›Product deployment rate is positively correlated with renewal performance
  • ›Deployed accounts: 94% GRR / 109% NRR vs. undeployed: 70% / 80%
  • ›Upsell share is higher in the deployed cohort (64% vs. 32%)
  • ›Beyond 50% of apps deployed, renewal performance improves significantly (t-test, p < 0.05)
  • ›Within deployed accounts, GRR declined over three quarters: 96% → 93% → 92%
  • ›Depth of usage (High/Medium vs. Low) is also positively correlated with renewal performance

## ITSM Core - landscape & threshold analysis

  • ›1,791 accounts; 87% of core accounts deployed
  • ›SMB has fewer deployed accounts; AMS and EMEA deploy at similar levels
  • ›GRR is 24 points and NRR 29 points higher for deployed accounts
  • ›>0–50% deployed: 81% GRR / 91% NRR; >50–75%: 90% / 110%; >75–100%: 95% / 110% and the highest share of Enterprise+ accounts
  • ›Quarterly: deployed share 89% → 84% → 89%; upsold share fell 69% → 58%, downsold rose 21% → 32%
  • ›High/Medium-usage accounts beat low-usage-only accounts by 9 points GRR and 11 points NRR

## ITSM Pro

52 accounts - too small for a meaningful conclusion. 85% deployed (98% GRR / 120% NRR); the not-deployed NRR (197%) is skewed by two very large upsell deals.

## Sentiment analysis

  • ›688 engagement-survey responses mapped to ITSM deployments and renewals (most recent sentiment before renewal)
  • ›Comments grouped into 7 topics with Qualtrics TextIQ and rated on a −10 to 10 sentiment scale
  • ›Top areas: Implementation Team (308), Project Management (223), Product Experience (96)
  • ›Implementation Team shows a significantly higher (+10%) share of positive comments
  • ›Behaviors driving the most value: Responsiveness and Meeting Timelines
  • ›Highest cost: Meeting Requirements (highest avg. downsell per account)
  • ›Moments that matter: responsiveness → trust → renewal

## Regression analysis

  • ›1,665 accounts with app deployment and usage mapped to renewal data
  • ›Most deployed apps: Incident, Configuration, Analytics (Premium), Change, Request Management
  • ›Logistic regression controlling for geography and segment (p < .05, pseudo R² = .10)
  • ›Request Management deployment raises upsell probability by 75%; Change Management by 58%
  • ›Opportunity: 23% of accounts haven't deployed Request Management, 22% haven't deployed Change Management
  • ›Incident Management was omitted (correlated > .85 with Request Management)
meta.json
year
2020
status
Analysis (employer work, de-identified)
tags
Customer analyticsLogistic regression
gallery [27]
ITSM App Deployment vs. Renewal Performance - figure 1ITSM App Deployment vs. Renewal Performance - figure 2ITSM App Deployment vs. Renewal Performance - figure 3ITSM App Deployment vs. Renewal Performance - figure 4ITSM App Deployment vs. Renewal Performance - figure 5ITSM App Deployment vs. Renewal Performance - figure 6
show all 27 slides
ITSM App Deployment vs. Renewal Performance - figure 7ITSM App Deployment vs. Renewal Performance - figure 8ITSM App Deployment vs. Renewal Performance - figure 9ITSM App Deployment vs. Renewal Performance - figure 10ITSM App Deployment vs. Renewal Performance - figure 11ITSM App Deployment vs. Renewal Performance - figure 12ITSM App Deployment vs. Renewal Performance - figure 13ITSM App Deployment vs. Renewal Performance - figure 14ITSM App Deployment vs. Renewal Performance - figure 15ITSM App Deployment vs. Renewal Performance - figure 16ITSM App Deployment vs. Renewal Performance - figure 17ITSM App Deployment vs. Renewal Performance - figure 18ITSM App Deployment vs. Renewal Performance - figure 19ITSM App Deployment vs. Renewal Performance - figure 20ITSM App Deployment vs. Renewal Performance - figure 21ITSM App Deployment vs. Renewal Performance - figure 22ITSM App Deployment vs. Renewal Performance - figure 23ITSM App Deployment vs. Renewal Performance - figure 24ITSM App Deployment vs. Renewal Performance - figure 25ITSM App Deployment vs. Renewal Performance - figure 26ITSM App Deployment vs. Renewal Performance - figure 27