Words you will meet
- SEAP
- Spoken English Assessment and Practice, the program's name.
- ITI
- Industrial Training Institute: a government vocational school for trades such as electrician or fitter. Polytechnics give engineering diplomas.
- Assessment
- One scored attempt. In 1.0 it meant reading one passage aloud and getting each word checked.
- Speech model
- Software that turns speech into text. SEAP lines the text up against what the learner should have said and marks each word right, wrong, missed or extra.
- Words per minute
- Words read correctly in a minute, the usual measure of reading fluency.
- Reached
- The pilot's success metric: a learner with three sessions, at least one of them a day or more after the first. The dashboard called it Activated.
- Progressive web app (PWA)
- An app delivered as a web link. It opens in the phone's browser and can be added to the home screen. Nothing to download from an app store.
- Implementation partner
- An organization contracted to sign up institutes and run sessions on the ground.
Chapter 1 · Who it is for
For students at vocational institutes, spoken English decides who gets hired, and nobody listens to them practice
When about 3,970 learners joined the pilot, we asked them why. Three in four, 73.6%, said placements and job interviews. Two thirds rated their own speaking at the lowest two of four levels.
The learners are students at ITIs, polytechnics and government and lower-tier degree colleges, aged 18 to 35, most from regional-language backgrounds. Their courses teach English on paper. Instructors have no time to listen to each student, and institutes have no standard way to measure speaking.
Exhibit 1
Learners came for jobs and rated their speaking low, and a quarter had tried an English app and stopped
| Question | Answer | Share |
|---|---|---|
| Why use SEAP | Placements and job interviews | 73.6% |
| Own speaking level | The lowest two of four ("a few words", "simple English about my life") | 66.6% (27.7% plus 38.9%) |
| School | Studied in an English-medium school | 63.7% |
| Phone | Own a smartphone | 89.9% |
| English-learning apps | Tried one and stopped | 26.5% |
| Realistic time a day | 15 minutes or less | 37.5%; another 25.2% said "it depends" |
Two of these rows matter most for what came next. Most had studied in English and still rated their speaking low, so more reading was unlikely to fix it. And a quarter had already tried an English app and stopped, so a product that only scored them would lose them too.
I narrowed the product to this group on purpose
The read-aloud version served any student taking an English course on a national online platform. I narrowed the target to vocational and college learners, because for them spoken English is a hiring filter. The outcome I set was job-linked speaking ability and confidence, measured in the learner, not syllabus coverage.
Program context, kept apart from results
Exhibit 2
Program context: the setting SEAP works in
| Fact | Figure |
|---|---|
| Extra earnings for people in India who speak English fluently | 34% |
| Indian graduates with employable communication skills | 54.6% |
| ITIs in India, and their trainees | About 15,000 institutes, 1.2 to 1.4 million trainees |
| SEAP read-aloud on SWAYAM, from September 2024 | 30,000+ learners, 100,000+ assessments |
Sources: SEAP 1.0 baseline survey (n about 3,970, May 2026); SEAP decks, March and July 2026; concept notes, October 2025 to January 2026.
Chapter 2 · Three versions
Each version taught us one thing, and the pilot data turned an assessment into a tutor
SEAP started as a read-aloud check inside online courses, before I joined. I planned two more versions, each to answer a question the one before could not.
Exhibit 3
Three versions, and what each one taught us
- 01
Read-aloud on SWAYAM: scores reading, offers no practice
- 02
1.0 pilot app: will institutes and learners take it up?
- 03
2.0 learning path: will learners practice speaking as a habit?
| Version | What it was | What it showed | State |
|---|---|---|---|
| Read-aloud, from Sep 2024 | A passage to read aloud inside English courses on SWAYAM, the Ministry of Education's online course platform, scored in words per minute | Reading aloud measures decoding, so it could not support a claim about speaking for jobs, and gave no reason to come back | Predecessor on SWAYAM |
| 1.0, May to July 2026 | A standalone spoken-English assessment app: leveled beginner passages, word-by-word feedback, and an instructor dashboard | 44% retried unprompted, but 6 in 10 never came back; passages came in random order with no rising difficulty | 49 colleges |
| 2.0, from Jul 2026 | A 25-lesson practice tutor with streaks, CEFR-mapped levels, a diagnostic test and seven speaking and listening exercise types | 70% moved up one English proficiency level | Scaled to 1M learners |
1.0 tested whether learners would use it, and its data set 2.0's shape
In November 2025 we split the work into two tracks: 1.0 on the existing speech model, deployed through an implementation partner, while 2.0 and a better model were built. That bought months of real use, at the cost of a model not tuned to Indian accents and a team carrying two products.
I wrote the pilot to answer operational questions: can institutes onboard learners, do learners activate, can we track completion. The answer pulled two ways: 44% retried unprompted, so learners wanted practice, but 6 in 10 never came back, so they also needed a path.
User research set 2.0's scope
I led user research with about 100 vocational and college students in small towns. More than half had already tried Duolingo, and most had stopped. With the designer I wrote the research guide, interview questions and vignettes, ran workshops to fix scope, visited learners after 1.0 went live, and tested 2.0 prototypes with them.
Sources: SEAP 2.0 note, November 2025; SEAP concept notes; SEAP decks, March and July 2026; my handover notes, July 2026.
Chapter 3 · Pilot design
I set the pilot's bar at a return visit, so a supervised class could not fake success
A supervised session in a computer lab can produce hundreds of registrations in an hour. It cannot produce a learner who comes back the next day on their own. So I counted a learner as Reached only after a return.
I wrote the pilot design on 27 April 2026, before the first institute went live. Reached meant three sessions, with at least one a day or more after the first. Registrations were reported but never contracted. For 2.0, part of the implementation partners' fees was tied to Reached, so the partners were paid for learners who came back.
Exhibit 4
The pilot reached about 5,000 learners in 49 colleges, against 18 colleges planned, with 70% active weekly
| Metric | Target, set in advance | Result | Status |
|---|---|---|---|
| Colleges | 18: 6 ITIs, 6 polytechnics, 6 degree colleges | 49 | Exceeded |
| Pilot learners | Tracked | About 5,000 | Measured |
| Weekly active | Tracked | 70% | Measured |
| Learners Reached | Tracked | 1,772 of the 4,578 who did at least one assessment (39%) | Measured |
6 in 10 never came back, so 2.0 needed a path
Exhibit 5
Of the 4,578 who did at least one assessment, 1,772 counted as Reached
- Took part4,578
- Reached1,772 (39%)
That is 39% of the learners who took part, so 6 in 10 never came back to count. Learners given open practice, with passages in random order, did not return. That is the problem 2.0's ordered path was built for, and it fixed it. A committed group practiced hard: the top quarter of users did about 60 assessments each over the eight weeks. The average hides both groups.
Field logs surfaced a login problem and a metric bug
Of nine issues logged in the field, five were learners not receiving the one-time password to log in: the cost of going standalone. Another mattered more for measurement. The dashboard showed zero activated for learners who had returned more than a day later, and we traced it to duplicate names. A metric that reads zero while learners practice teaches everyone to ignore it.
Sources: SEAP 1.0 pilot design, 27 Apr 2026; field issues and user feedback log, May to June 2026; my handover facts sheet, July 2026; SEAP deck, June 2026 (top-quarter usage).
Chapter 4 · The signal
Learners retried passages when they could see a score rise, and said their real problem was making sentences
Without being asked, 44% of learners read a passage they had already done a second time. On the retry, their median fluency rose 7 words a minute, from 87.6 to 94.6.
The gain is on a passage learners had already read. What mattered was the behavior: it showed what would make learners practice, seeing themselves improve.
What learners found hard set 2.0's focus
The baseline survey pointed the same way from the other side.
Exhibit 6
Learners named making sentences hardest; reading aloud, the only thing 1.0 practiced, came last
- Making sentences43.7%
- Grammar when speaking42.5%
- Confidence in front of others37.2%
- Pronunciation31.0%
- Finding the right words29.6%
- Understanding fast speech17.2%
- Reading aloud without pausing9.7%
78% of survey respondents said they felt more confident
In the end-of-pilot survey, 78% of 537 learners who chose to answer said they felt more confident speaking English. Self-report, 537
The July deck cites the retries as evidence for centering 2.0 on practice. The survey pointed to what to practice: making sentences, more than reading.
Sources: SEAP deck, July 2026 (retries, median speed, end-of-pilot survey); SEAP 1.0 baseline survey, May 2026.
Chapter 5 · Learning design
2.0 is a 25-lesson path where speaking and listening lead, and grammar and vocabulary hold them up
In 1.0 a learner picked a passage and read it aloud. In 2.0 she follows 25 lessons in order, from the basics to being ready for an interview, set in workplace and interview scenes.
Speaking stays at the center, because speaking is what employers screen for. Grammar and vocabulary come in to support it, because those were the gaps learners named.
Exhibit 7
Seven speaking and listening exercise types, with grammar and vocabulary built in
| Skill | Formats | The gap it answers |
|---|---|---|
| Speaking | Listen & Speak, Read & Speak | The goal itself, scored by the speech model |
| Listening | Listen & Tap, Listening Comprehension | Understanding fast speech (17.2%) |
| Grammar | Read & Tap, Fill in the Blank | Grammar when speaking (42.5%), making sentences (43.7%) |
| Vocabulary | Fill in the Blank, Match the Columns | Finding the right words (29.6%) |
Levels are mapped to the CEFR, and 70% of learners moved up one level
Most pilot learners were beginners. With the pedagogy team I defined levels mapped to the beginner bands of the CEFR, an international scale of language ability. Moving up means finishing the 25 lessons above a threshold score. At scale, 70% of learners moved up one English proficiency level.
A diagnostic test at entry places each learner at the right level.
The habit loop was designed around a web app's weaker notifications
A native app sends reliable notifications, the best tool for bringing learners back. 2.0 is a progressive web app, so the loop leans on other things.
Exhibit 8
The 2.0 habit loop, as designed
- 01
A nudge to come back, with WhatsApp next on the list
- 02
A lesson: listen, speak, tap
- 03
Feedback, with the right answer and why
- 04
Streak, badge and skill profile update
- 05
A progress report to learner and institute
Instructions are translated into Telugu and Kannada to scaffold beginners. The English being learned stays in English.
One question was still open at handover: a leaderboard scored by points earned rather than by percentage correct, so that a retry earns points instead of dragging a score down. Open at handover Chapter 8 sets out the test.
Sources: SEAP deck, July 2026; SEAP 2.0 priorities and design decisions in my handover notes, July 2026; baseline survey, May 2026.
Chapter 6 · Decisions
Each 2.0 decision had a cost, from harder impact measurement to weaker notifications
The product, pedagogy and design leads and I decided scope and flows together, with ML and engineering joining for technical calls, and I had the final say. We ranked features by reach, impact, confidence and effort. Exercise types were kept to the smallest set an instructor could understand in one sitting. The larger calls are below.
Exhibit 9
Five decisions, and what each one cost
Pivot from an assessment to a 25-lesson tutor
- The call
- Replace open practice with a structured 25-lesson path, with a diagnostic test at entry to place learners.
- What I gave up
- Clean before-and-after measurement. Learners on different paths are much harder to compare.
- Why
- Within a session, 44% retried unprompted, so learners wanted practice. But 6 in 10 never came back, so they also needed a path, and content at the wrong level drove learners away.
Evidence · 2.0 scaled to 1M learners, and 70% moved up one English proficiency level.
Ship as a web app
- The call
- Build 2.0 as a progressive web app.
- What I gave up
- Native notifications.
- Why
- A web app is far simpler to roll out across institutes and to plug into national platforms. We designed nudges around the missing notifications instead, with WhatsApp nudges next on the list.
No skipping past a wrong answer
- The call
- After a second miss, the learner sees the right answer and practices it before moving on.
- What I gave up
- Some speed through the lesson, and some learners' patience.
- Why
- I ruled out skipping. Skipping without feedback turns practice into clicking, and the struggle is where the learning happens.
Certify completion, checkable by anyone
- The call
- The certificate says a learner completed the course, with a QR code anyone can check. Government logos appear only where an agreement allows.
- What I gave up
- A stronger-sounding certificate that learners and institutes asked for.
- Why
- A certificate anyone can check by QR code is one institutes and employers can trust.
Collect accent data from every district before trusting the scores
- The call
- Build a dataset of Indian English from across the country to fine-tune the speech model.
- What I gave up
- Speed. The pilot ran on the base model while the data was collected.
- Why
- The base model was not accurate enough across Indian accents, and a learner marked wrong for a correct word stops trusting the product.
The speech data was run like a product, with its own quality loop
I designed the flow of a custom collection app (login, consent, an audio check, district selection), which another engineering team built. Vendors collected audio across India's roughly 800 districts, with at least 40% of each district's data planned from each gender. Each collector's recordings were checked in rounds of ten. If four of the ten failed, all of that collector's recordings could be rejected, and a district short of its quota for one gender was sent back for re-collection. Two-way conversation practice was parked for lack of model capacity and budget.
Measured The result is one of India's largest speech data programs: more than 5,000 hours across about 800 districts. The speech model fine-tuned on it is 50% more accurate. The pilot's scores came from the base model; building the new model into the product is the next step (chapter 8).
Sources: My handover notes, July 2026; data collection and annotation RFPs, October and November 2025; quality control plan and SOP; recollection rules in the quality log; SEAP deck, July 2026.
Chapter 7 · Measurement
I wrote the measurement plan before the scale decision, with pass marks set in advance
One rule ran through every SEAP number: each carries its source and its filter, and a target is never shown as a result. This page follows the same rule.
The plan was built to be able to say no
In May 2026 I wrote the pilot's metrics framework for the July decision on whether to scale 2.0. Its job was to make a no possible: five pass-or-fail gates, fed by seven critical-path metrics, each with a pass mark written down before the data came in. Behind them sat a register of 146 metric definitions, so no two teams reported the same number two ways.
The decision in July was to go ahead: 2.0 began deploying on 23 July 2026 and scaled through state partnerships to 1M learners.
Exhibit 10
Five gates and seven critical-path metrics were set for the scale decision before the data came in
| Part | Count | What it is for |
|---|---|---|
| Pass or fail gates | 5 | The bar for go or no-go, set before the results |
| Critical-path metrics | 7 | The numbers the gates were read from |
| Hypotheses that could be proven false | 6 | What the pilot had to show, stated so the data could reject it |
| Strategic questions for the scale decision | 6 | What leadership needed answered in July |
| In-app feedback questions, on a schedule | 13 | Asking learners at set points, not all at once |
| Ways to cut the data | 19 | Institute type, location, device and others, to find who the product fails |
| Dashboards | 4 | A different view for each audience |
For 2.0 I set the next priorities in order: certificates generated automatically, WhatsApp nudges to push completion, and short in-app questions after lessons 10 and 25 to measure confidence inside the product. A triage framework, with thresholds we could adjust, ranked institutes to direct field staff's effort.
Chapter 8 sets out how I would measure 2.0.
Sources: SEAP 1.0 metrics framework, May 2026; 2.0 priorities in my handover notes, July 2026.
Chapter 8 · What comes next
Each result has a next test, and 2.0's starts with the leaderboard
The pilot and 2.0 gave measured results and two survey results. Each one points to a next step, under the same rule: the measure and its pass mark are written down before the data comes in.
Exhibit 11
Each result, measured or surveyed, has a next step
| Claim | Status | Next step |
|---|---|---|
| About 5,000 pilot learners in 49 colleges, 70% active weekly | Measured | Track weekly activity in 2.0 the same way |
| 1,772 of 4,578 learners who did at least one assessment were Reached; 6 in 10 never came back | Measured | Compute 2.0's Reached rate the same way |
| 44% retried a passage unprompted | Measured | Test whether the practice carries over to new passages |
| Median fluency up 7 words a minute on a retry, 87.6 to 94.6 | Measured | Measure fluency on passages learners have not yet seen |
| 43.7% named making sentences hardest | Survey, about 3,970 | Already set 2.0's focus on speaking and making sentences |
| 78% felt more confident | Self-report, 537 | Ask every learner in the product, after lessons 10 and 25 |
| The fine-tuned model improves scoring | Measured | 50% more accurate; next, build it into the product |
| 2.0 at scale: 1M learners, 70% moved up one English proficiency level | Measured | The leaderboard test below |
The first test on 2.0 is the leaderboard
The first experiment I would run answers the leaderboard question left open at handover: rank learners by points earned or by percent correct. Classmates compare ranks, so I would assign whole institutes to one version, with Reached within 14 days of joining as the primary metric and first-attempt scores on unseen lessons as the guardrail.
Then build free conversation practice
After that, I would build free conversation practice once the speech models allow it.
Sources: Chapters 3 to 7; SEAP 1.0 metrics framework, May 2026; 2.0 priorities and the open leaderboard question in my handover notes, July 2026.
Reflections
The return-visit bar and the baseline survey together shaped 2.0
What worked
Defining Reached before the pilot and refusing to count registrations. It made the gap impossible to miss: 6 in 10 never came back to open practice, and that is what turned SEAP from an assessment into a 25-lesson tutor.
What I learned
1.0 practiced reading aloud, because it was easy to score on the model we had. The baseline survey named making sentences hardest (43.7%) and reading aloud last (9.7%), so 2.0 centers on speaking and making sentences. The lesson I carry forward: center the product on what learners say is hard.
What I'd do next
Run the leaderboard test on 2.0, build the fine-tuned speech model into the product, and build free conversation practice once the speech models allow it.