Skip to main content
Link a company policy document to a roleplay so Real Talk Studio scores each session for adherence, violations, and missed opportunities. Those scores roll up into the Compliance card on studio analytics.
This guide is for org and studio admins setting up compliance measurement. Learners see policy feedback on the Dig Deeper step after a session — see Feedback & evidence.

​
What you get

Analytics show the full adherence breakdown once you have at least one roleplay with policy enabled and three completed, valid sessions on those roleplays. Until then, the Compliance card may show finding counts only. Testing sessions and sessions marked too short are excluded.

​
Enable policy scoring on a roleplay

You need permission to edit the roleplay (org admin, studio admin, or scenario author).
1

Open the roleplay editor

Go to /edit-roleplay/[slug]. Common entry points:
  • Studio admin → studio overview → edit a roleplay in the catalog
  • Organization → Catalog → open a roleplay → edit
  • My Roleplays → edit an existing scenario
2

Open the Skills tab

Select Skills in the editor tab bar.
3

Turn on policy feedback

Under Advanced, enable Policy adherence feedback.
4

Paste and save the policy

Paste your policy document (plain text; up to 100,000 characters), then click Save policy.
5

Save or publish the roleplay

Use Save or Publish so learners pick up the change on their next session.
Team roleplays use the same Skills → Advanced → Policy adherence feedback flow in /edit-team-roleplay/[slug].
Use the same policy text learners are expected to follow in real conversations. The AI compares the learner’s turns in the transcript against this document — not the AI partner’s lines.

​
What learners see

Before starting, learners may see a note that the conversation will be reviewed against the linked policy. After the session, on Dig Deeper → Policy adherence, they see:
  • Adherence — where they correctly applied the policy
  • Violations — where their behaviour conflicted with the policy
  • Missed opportunities — where they could have applied the policy but did not
Each finding includes the relevant policy area, a transcript quote, and an explanation.

​
What admins see in analytics

Open Studio admin → Analytics (/admin/studios/[slug]/analytics). The Compliance card shows:
  • % high adherence — share of scored sessions rated high (once enough sessions exist)
  • Violations / Missed / Got it right — counts from policy findings across valid completions on linked roleplays
  • Policy linked on X of Y roleplays — how much of the studio catalog has policy enabled
Link policy on every compliance scenario in the catalog to widen coverage. Sessions only count toward compliance metrics when the roleplay has a saved, enabled policy document.

​
Troubleshooting

Enable Policy adherence feedback, paste text, click Save policy, then save the roleplay.
Learners need to complete full sessions on that roleplay. Testing and too-short sessions are excluded.
You need at least 3 valid scored sessions on policy-linked roleplays.
Confirm the toggle is on, policy text is saved, and the session ran long enough to receive full feedback.
Trim or split content. The limit is 100,000 characters.