Objective
Change one thing in Ananya’s prompt because the calls showed it was needed, ship it as a version, and know when to send it all the traffic.The scenario
Suppose the dry-run transcripts show Ananya reading₹4,500 as “four comma five zero zero” and 15 October as “fifteen ten”, and Evals flags it under Instruction following. One rule in the prompt fixes it. It goes on a new version so A/B Analytics can show whether it helped.
Hands-on
Adding a version and splitting traffic in the dashboard
1
Pick one problem
Open the transcript in Logs or the issue card in Evals, and choose one thing to change. A version that changes three things at once tells you nothing about which one worked.
2
Choose the fix from the voice rules
The voice prompt rules list the usual culprits: long turns, several questions at once, no script for “no” or “call me later”, no way to end, numbers read as written. Add this rule:
Say amounts in words, in rupees: ₹4,500 is "four thousand five hundred rupees". Say dates as "15 October", never "15/10".3
Add a version for it
Open EMI reminder - Hindi. Create Versions is on from part 5, so the version bar shows V1 and V2. Click + and pick the Base version to copy, the one that did better in lesson 2. The new V3 appears with a red dot: 0% traffic.
4
Edit and save V3
Click V3 to switch to it, open Prompt, and paste the rule into Response Guidelines. Click Save or press Cmd/Ctrl+S: “Changes saved successfully”. Add notes from V3’s menu:
Amounts and dates in words.5
Hear it before it has traffic
To be sure a call runs V3 while it still has 0% traffic, copy V3’s version ID from its menu and pass it as
version_id on Initiate Individual Call, with due_amount ₹4,500 and due_date 15 October in custom_args_values. Listen for the amount.6
Give it traffic
Split the traffic as in part 5, lesson 3: 70% on the current winner, 30% on V3. Once V3 is ahead in A/B Analytics, click Finalize in the sidebar row A/B Tests Live!, select V3 and Confirm & Finalize: all traffic goes to V3 and A/B testing turns off.
Checkpoint
The version bar shows V3 with a green dot and its share. New calls in Logs carry a version chip in the Assistant column.
Exercise
In Evals, open the test case from lesson 3 and click Run again. Expected result: the new run’s detail names which agent version ran and when it was published, so a pass is tied to V3.What you learned
- One change per version, so A/B Analytics can attribute the difference.
- The voice rules to reach for first: how to say amounts and dates, short turns, scripted “no” and “call me later”, and how to end.
- Finalize is the end of a test: all traffic to the winner, A/B testing off.