Measure activation, retention, and feature adoption across cohorts

Why this matters now

Ready-to-interview isn’t a vibe—it’s visible in your data. When you measure activation, retention, and feature adoption across cohorts, you can reliably lift readiness scores and offer rates without burning out mentors.

Across recent SageStepper partners, programs that hit ≥70% activation by Day 7 and sustain ≥55% WAU by Week 4 see 1.3–1.6x higher offer rates, a median +18 readiness score lift in three weeks, and 35–60 mentor hours saved per cohort. The throughline: habit-building in a single workspace.

SageStepper ties interviews, feedback, and community together—Nova mock panels, Interview Sprint rituals, progress radar reviews, flashcards, and action boards. Your job is to make that loop the default.

Define the three metrics (with thresholds you can defend)

Activation isn’t a login; it’s a sequence that proves intent. Use these minimum definitions out of the gate:

• Activation (Day 1–7):
  • Completed 1 Nova interview (nova.session_completed)
  • Created an action board and added 3+ tasks (action.board_initialized, action.task_created)
  • Scheduled or joined 1 Interview Sprint (sprint.session_joined)
• Retention (weekly):
  • WAU: Users with ≥2 engaged days in a 7-day window
  • Streak: Consecutive days with any learning event (e.g., flashcards.reviewed, feedback.viewed, nova.session_completed)
• Feature adoption (by Day 14 and ongoing):
  • Nova depth: ≥3 sessions total, ≥1 panel-style
  • Radar cadence: ≥1 progress radar review/week
  • Action throughput: ≥5 tasks completed by Day 14; ≥3/week afterward
  • Community: ≥1 peer feedback given/week

Aim for Day-7 activation ≥70%, Week-4 WAU ≥55%, and Nova depth ≥65% of activated learners hitting 3+ sessions by Day 14.

Publish these thresholds to staff and learners. Build them into orientation and your LMS so expectations are visible.

Instrument once, reuse everywhere

Standardize events so every dashboard, export, and intervention runs off the same definitions. Start with a simple taxonomy:

# events.yml
version: v1
entities:
  user: {id: user_id}
  cohort: {id: cohort_id}
  org: {id: org_id}
events:
  - key: nova.session_completed
    props: [mode, duration_sec, score_readiness_delta]
  - key: action.board_initialized
    props: [template_key]
  - key: action.task_created
    props: [category]
  - key: action.task_completed
    props: [category]
  - key: progress.radar_viewed
    props: [section]
  - key: sprint.session_joined
    props: [sprint_type]
  - key: flashcards.reviewed
    props: [count]
  - key: feedback.viewed
    props: [source]

activation:
  day7: [nova.session_completed, action.board_initialized, sprint.session_joined]
retention:
  wau_days_required: 2
  streak_break_days: 3
adoption:
  nova_depth: {sessions_required: 3, window_days: 14}
  radar_cadence: {views_per_week: 1}
  action_throughput: {tasks_by_day14: 5}

If you’re using SageStepper Insights exports, you can calculate activation and adoption by cohort with a single query:

-- activation_by_cohort.sql
WITH first7 AS (
  SELECT cohort_id, user_id,
    BOOL_OR(event = 'nova.session_completed') AS did_nova,
    BOOL_OR(event = 'action.board_initialized') AS did_board,
    BOOL_OR(event = 'sprint.session_joined') AS did_sprint
  FROM events
  WHERE ts <= cohort_start + INTERVAL '7 days'
  GROUP BY 1,2
), activated AS (
  SELECT cohort_id, COUNT(*) AS activated
  FROM first7
  WHERE did_nova AND did_board AND did_sprint
  GROUP BY 1
), totals AS (
  SELECT cohort_id, COUNT(DISTINCT user_id) AS total
  FROM events
  GROUP BY 1
)
SELECT t.cohort_id,
       activated::float / NULLIF(total,0) AS activation_rate
FROM totals t
LEFT JOIN activated a USING (cohort_id)
ORDER BY activation_rate DESC;

Prefer scripts? Flag at‑risk learners and post to your action board automatically:

// at_risk.ts - pseudo-code using SageStepper exports
import { readFileSync } from 'fs'

type Event = { user_id: string; cohort_id: string; event: string; ts: string }
const events: Event[] = JSON.parse(readFileSync('events.json','utf8'))

const byUser = new Map<string, Event[]>()
for (const e of events) {
  const k = `${e.cohort_id}:${e.user_id}`
  if (!byUser.has(k)) byUser.set(k, [])
  byUser.get(k)!.push(e)
}

const atRisk: string[] = []
for (const [k, es] of byUser) {
  const hasNova = es.some(e => e.event === 'nova.session_completed')
  const hasBoard = es.some(e => e.event === 'action.board_initialized')
  const hasSprint = es.some(e => e.event === 'sprint.session_joined')
  const lastTs = new Date(Math.max(...es.map(e => +new Date(e.ts))))
  const daysSince = (Date.now() - +lastTs) / 86400000
  if (!(hasNova && hasBoard && hasSprint) || daysSince >= 3) atRisk.push(k)
}

console.log(JSON.stringify({ atRisk }, null, 2))

Weekly Cohort Health ritual (30 minutes, same time every week)

Keep it boring and repeatable. Use your Cohort Health dashboard in SageStepper and a shared action board to drive follow‑up.

1. Prep (async, 10 min)
   • Owner exports the latest dashboard tiles: activation, WAU, streaks, feature adoption.
   • Note cohorts below thresholds; pre‑assign likely interventions.
2. Review (live, 15 min)
   • Scan activation and adoption by cohort; drill into learner archetypes (first‑gen career starters, career switchers, international students).
   • Spot pattern breaks: streaks <4 days, Nova depth <3 by Day 10, zero radar views.
3. Assign (live, 5 min)
   • Create tasks on the cohort action board: “Nudge internationals with time‑zone Sprint options,” “Pair mid‑career switchers with peer coaches.”
   • Set SLA: touch within 48 hours; log outcome (win/neutral/miss).

Rituals that travel well:

• Monday “Kick the Week” message in SageStepper community: the week’s Sprint times and a readiness tip.
• Wednesday Nova Focus: 20‑minute Nova slots on the hour; mentors available for feedback triage.
• Friday Radar Review: prompts to reflect on score movement and next week’s plan.

Interventions that actually move the numbers

Use small levers first. Automate what you can; keep the human touch where it matters.

• Nova‑first onboarding (Day 0–3)
  • Auto‑assign the “First Nova” path and a 3‑task action board template.
  • Offer a 15‑minute orientation with a live Nova demo.
  • Expected lift: +15–20 points in activation rate by Day 7.
• Interview Sprint cadence (Weeks 1–4)
  • 2x/week time‑boxed Sprints; cap at 6 learners per Sprint.
  • Use Nova for reps; mentors debrief in 1:1 threads to save live hours.
  • Outcome: +12–15 day median streaks; 30–40% mentor hours saved.
• Progress radar + flashcards loop
  • Friday “Radar Review” prompt; auto‑generate flashcards from missed signals.
  • Outcome: +6–10 readiness points in two weeks for low‑confidence learners.
• Community reciprocity
  • Require 1 peer feedback/week; highlight “Top Helper” in Monday post.
  • Outcome: lifts WAU by 8–12% in Week 3–6 windows.

Sample nudge templates you can drop into Broadcasts or your LMS:

# nudges.yml
broken_streak:
  subject: Quick win to restart your streak
  body: |
    You’re one rep from momentum. Book a 10‑minute Nova slot today and check your progress radar after. Reply “HELP” if you want a coach nudge.
low_nova_depth:
  subject: 3 Nova reps unlocks sharper stories
  body: |
    You’ve tried Nova once—nice start. Do 2 more this week and we’ll auto‑build flashcards from your gaps. Sprint times inside.
mentor_followup:
  subject: Debrief + next step
  body: |
    Here’s one highlight and one fix from your last panel. Record a 90‑second answer to the same prompt. I’ll spot‑check and reply with a voice note.

Make SageStepper the default prep workspace (30/60/90)

You don’t need a massive change‑management plan—just a tight rollout.

• Days 0–30: Baseline and habit loop
  • Add SageStepper to orientation and your LMS module (“Practice lives here”).
  • Auto‑enroll cohorts with tags; pre‑load action board templates.
  • Run 2 Interview Sprints/week; enable streak nudges.
  • Ship the Cohort Health dashboard; publish thresholds.
• Days 31–60: Deepen adoption
  • Introduce peer feedback requirement; spotlight helpers.
  • Add Radar Review Fridays and auto‑flashcards.
  • Start the weekly Retention & Interventions standup.
  • Track mentor hours saved; share the win with leadership.
• Days 61–90: Optimize and scale
  • Segment interventions by archetype (e.g., international learners get timezone‑friendly Sprints).
  • A/B test nudge copy and Sprint times.
  • Consolidate reporting: activation, WAU, Nova depth, readiness lift, offer rate.

Example: two cohorts, two plays

• Career‑switcher bootcamp (12 weeks, 80 learners)
  • Baseline: Day‑7 activation 52%, WAU Week‑4 41%.
  • Plays: Nova‑first onboarding, 2x Sprints, Radar Review Fridays.
  • Result (6 weeks): Activation 74% (+22), WAU 59% (+18), readiness +19, mentor hours −42.
• Business school MMS (10 weeks, 120 learners)
  • Baseline: Nova depth low (27% ≥3 sessions), streak median 5 days.
  • Plays: Peer feedback requirement + community spotlight; timezone Sprints.
  • Result (5 weeks): Nova depth 66% (+39), streak median 12 days (+7), WAU +14%, offers at graduation +1.4x.

These programs made one key decision: all prep lives in SageStepper. No scattered notes, no ad‑hoc mock interview spreadsheets. One loop, measurable progress.

Reporting that earns trust

Close the loop with stakeholders using a consistent, scannable one‑pager each month.

# Cohort Health Brief – April
- Activation (Day‑7): 72% (target 70%)
- WAU (Week‑4): 57% (target 55%)
- Nova depth (Day‑14): 68% (target 65%)
- Median streak: 11 days (target 10)
- Readiness lift (3 wks): +18
- Offer rate (to date): 1.5x vs last term
- Mentor hours saved: 44

Risks
- Section B international learners: low Sprint attendance (UTC+8)

Next moves
- Add late‑evening Sprint; assign peer buddies; update nudges.

Link the brief to your Cohort Health dashboard in SageStepper. Celebrate progress, not perfection.

Put it into motion today

• Define your Day‑7 activation and Week‑4 adoption thresholds.
• Stand up the weekly Cohort Health ritual.
• Launch Nova‑first onboarding and two Interview Sprints next week.
• Turn on streak and low‑adoption nudges.

SageStepper keeps the loop tight—Nova reps, progress radar insight, action boards for execution, and community for momentum. Your team brings the empathy and context that make the numbers move.