> ## Documentation Index
> Fetch the complete documentation index at: https://docs.realtalkstudio.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Policy compliance analytics

> Link a policy document to a roleplay to measure adherence, violations, and missed opportunities in studio analytics

Link a company policy document to a roleplay so Real Talk Studio scores each session for **adherence**, **violations**, and **missed opportunities**. Those scores roll up into the **Compliance** card on [studio analytics](/feature-overview/admin-and-organizations#studio-admin).

<Info>
  This guide is for **org and studio admins** setting up compliance measurement. Learners see policy feedback on the Dig Deeper step after a session — see [Feedback & evidence](/feature-overview/feedback-and-evidence).
</Info>

***

## What you get

| Surface              | What appears                                                                                                            |
| -------------------- | ----------------------------------------------------------------------------------------------------------------------- |
| **Learner feedback** | **Policy adherence** on Dig Deeper — overall rating (high / medium / low), summary, and findings with transcript quotes |
| **Studio analytics** | Compliance adherence %, violation count, missed opportunities, and demonstrated adherence across linked roleplays       |
| **Session history**  | Policy scores stored on each completion for export and review                                                           |

Analytics show the full adherence breakdown once you have at least **one roleplay with policy enabled** and **three completed, valid sessions** on those roleplays. Until then, the Compliance card may show finding counts only.

Testing sessions and sessions marked too short are excluded.

***

## Enable policy scoring on a roleplay

You need permission to edit the roleplay (org admin, studio admin, or scenario author).

<Steps>
  <Step title="Open the roleplay editor">
    Go to **`/edit-roleplay/[slug]`**. Common entry points:

    * **Studio admin** → studio overview → edit a roleplay in the catalog
    * **Organization → Catalog** → open a roleplay → edit
    * **My Roleplays** → edit an existing scenario
  </Step>

  <Step title="Open the Skills tab">
    Select **Skills** in the editor tab bar.
  </Step>

  <Step title="Turn on policy feedback">
    Under **Advanced**, enable **Policy adherence feedback**.
  </Step>

  <Step title="Paste and save the policy">
    Paste your policy document (plain text; up to **100,000 characters**), then click **Save policy**.
  </Step>

  <Step title="Save or publish the roleplay">
    Use **Save** or **Publish** so learners pick up the change on their next session.
  </Step>
</Steps>

Team roleplays use the same **Skills → Advanced → Policy adherence feedback** flow in `/edit-team-roleplay/[slug]`.

<Tip>
  Use the same policy text learners are expected to follow in real conversations. The AI compares the **learner’s** turns in the transcript against this document — not the AI partner’s lines.
</Tip>

***

## What learners see

Before starting, learners may see a note that the conversation will be reviewed against the linked policy.

After the session, on **Dig Deeper → Policy adherence**, they see:

* **Adherence** — where they correctly applied the policy
* **Violations** — where their behaviour conflicted with the policy
* **Missed opportunities** — where they could have applied the policy but did not

Each finding includes the relevant policy area, a transcript quote, and an explanation.

***

## What admins see in analytics

Open **Studio admin → Analytics** (`/admin/studios/[slug]/analytics`).

The **Compliance** card shows:

* **% high adherence** — share of scored sessions rated high (once enough sessions exist)
* **Violations / Missed / Got it right** — counts from policy findings across valid completions on linked roleplays
* **Policy linked on X of Y roleplays** — how much of the studio catalog has policy enabled

Link policy on every compliance scenario in the catalog to widen coverage. Sessions only count toward compliance metrics when the roleplay has a saved, enabled policy document.

***

## Troubleshooting

<AccordionGroup>
  <Accordion title="Compliance card says no roleplays have policy linked">
    Enable **Policy adherence feedback**, paste text, click **Save policy**, then save the roleplay.
  </Accordion>

  <Accordion title="Policy linked but no scored sessions">
    Learners need to complete full sessions on that roleplay. Testing and too-short sessions are excluded.
  </Accordion>

  <Accordion title="Adherence % not shown — only violation counts">
    You need at least **3** valid scored sessions on policy-linked roleplays.
  </Accordion>

  <Accordion title="Learner does not see policy feedback">
    Confirm the toggle is on, policy text is saved, and the session ran long enough to receive full feedback.
  </Accordion>

  <Accordion title="Document too long">
    Trim or split content. The limit is 100,000 characters.
  </Accordion>
</AccordionGroup>

***

## Related

* [Feedback & evidence](/feature-overview/feedback-and-evidence) — learner-facing policy section
* [Scenario creation](/feature-overview/scenario-creation) — skills and authoring workflow
* [Admin & organizations](/feature-overview/admin-and-organizations) — analytics and session history