How to synthesize user interviews with AI (without losing the evidence)
A step-by-step method for using AI to turn interview transcripts into insights you can defend, with every claim traced to a real customer quote.
By Abhishek Chatterjee ·
Short answer: to synthesize user interviews with AI, first clean and label your transcripts, then have the model code each interview separately, extract verbatim quotes with their source, cluster the codes into themes across interviews, and turn themes into insights with explicit severity and frequency. The non-negotiable rule: no insight without a quote, and no pattern without more than one source. AI makes synthesis fast. That rule makes it trustworthy.
Most teams that try AI synthesis hit the same wall. The summary reads well, the themes sound plausible, and then someone in the roadmap review asks "who actually said that?" and nobody can answer. This guide is about avoiding that moment.
What "synthesis" actually means
Research synthesis is the process of turning raw qualitative data, such as interview transcripts, call recordings, support tickets, and survey comments, into a small set of evidence-backed insights that change a product decision.
It is not summarization. A summary compresses one conversation. Synthesis compares many conversations and tells you what is true across them, how strongly, and why it matters.
Classic synthesis has three layers, and AI can help with all of them:
| Layer | What it is | Example |
|---|---|---|
| Code | A short label on a piece of a transcript | "Exports to spreadsheet" |
| Theme | A pattern of codes across interviews | "Users move data out of the product to finish their work" |
| Insight | A theme plus an interpretation that drives a decision | "Finance users export because they don't trust in-app totals, so a reconciliation view matters more than better export formats" |
If you've done affinity mapping with sticky notes, or thematic analysis in the style of Braun and Clarke, this is the same process. AI just does the sticky notes.
Why AI synthesis goes wrong
Large language models are very good at producing text that sounds like a research readout. That is the problem. Four failure modes show up again and again:
- Invented or "smoothed" quotes. The model paraphrases a user and presents it as a quote, or blends two speakers into one sentence.
- False consensus. One vivid interview becomes "users want X". A theme mentioned once gets the same weight as one mentioned in every call.
- Interviewer leakage. Your own questions and hypotheses get reported back as user needs, because the model can't always tell who said what.
- Lost provenance. Even when the insight is right, nobody can trace it back to the conversation it came from, so it can't survive a skeptical stakeholder.
None of these are fixed by a cleverer prompt alone. They're fixed by a process that forces the model to keep evidence attached to every claim.
Step-by-step: synthesizing interviews with AI
- Prepare and label your transcripts
Get a clean transcript for every interview, with speaker labels. Meeting tools export
.vttor.srtcaption files; keep the speaker names. Add a short header to each file: participant role, company size, segment, and the date. Remove small talk if you like, but never edit what participants said. - Code each interview on its own first
Have the model process one transcript at a time and output codes, each with the verbatim quote it came from and the speaker. Processing interviews separately prevents one loud conversation from coloring how the model reads the others. Exclude interviewer lines from what counts as evidence.
- Cluster codes into themes across interviews
Now give the model the coded output from all interviews and ask it to group codes into themes. For each theme, require the list of supporting quotes and which interviews they came from. This is where frequency becomes visible: a theme backed by six participants is different from one backed by one.
- Turn themes into insights
For each strong theme, write the insight: what is happening, why, and what it implies. Rate severity (how painful), frequency (how many sources), and type (pain point, opportunity, behavior, feature request). An insight that doesn't suggest a decision is still a theme.
- Verify before you share
Pick a sample of quotes and search the original transcripts for the exact text. Check that every high-severity insight is backed by more than one participant. Look for themes that only appear in questions you asked, which signals interviewer leakage.
A prompt structure that keeps evidence attached
You don't need a magic prompt, but you do need a strict output contract. Something like this works with any capable model:
You are coding one customer interview transcript.
Rules:
- Only use what the participant said. Ignore interviewer
lines as evidence.
- Every code must include an exact verbatim quote, copied
character for character.
- If you cannot find a quote that supports a code, do not
output the code.
Output a list of:
- code: short label (3-6 words)
- quote: exact text from the transcript
- speaker: participant name or ID
- context: one sentence on what prompted it
Then, for the cross-interview step:
Group these coded excerpts from N interviews into themes.
For each theme output:
- theme: one-sentence statement
- supporting_quotes: list of quote + interview ID
- interview_count: number of distinct interviews supporting it
- counter_evidence: any quotes that contradict the theme
Do not create a theme supported by only one interview; list those
separately as "single-source signals".
The counter_evidence field matters more than it looks. Asking the model to look for disconfirming quotes is the cheapest defense against false consensus.
How to tell if your synthesis is any good
Before a synthesis drives a roadmap decision, score it against five checks. These are the same dimensions we use in Praxiom's Research Quality Score, and you can apply them by hand:
| Check | Question to ask | Red flag |
|---|---|---|
| Citation coverage | Does every insight carry at least one verbatim quote? | Insights with no quotes, or quotes you can't find in the transcript |
| Cross-source triangulation | Are the strong insights supported by more than one participant? | Big claims resting on one conversation |
| Severity spread | Have you distinguished critical pain from mild annoyance? | Everything rated "high" |
| Insight density | Did you extract a reasonable number of insights per source? | Twenty interviews producing three generic themes |
| Theme diversity | Did you capture pain points, behaviors, and opportunities, not only feature requests? | A list that is really a feature wishlist |
If a synthesis fails two or more of these, it isn't ready to drive a decision. Go back to step 2 rather than polishing the wording.
When a general AI assistant is enough, and when it isn't
Pasting transcripts into a general assistant like Claude or ChatGPT is a perfectly good way to start. It works well when:
- you have a small, one-off batch of interviews,
- one person owns the research end to end,
- you'll verify quotes yourself before sharing.
It starts to break when research becomes continuous. Every chat starts from zero, findings from March don't connect to findings from September, and the link between an insight and its source lives only in your head. That's when a dedicated synthesis tool earns its place. The real value isn't speed. It's that evidence stays attached and accumulates across studies.
How Praxiom does this
Praxiom was built around the rule at the top of this post. When you upload interviews, including PDFs, docs, recordings, or .vtt/.srt meeting transcripts, the agent extracts insights in which every insight carries supporting quotes tagged to the source they came from, along with a severity rating, a frequency count, and a type. Each synthesis then gets a Research Quality Score across the five dimensions above, so weak synthesis is flagged before it reaches a PRD. Insights persist in the workspace, so the next study builds on the last one instead of starting over.
From there, insights feed evidence-backed prioritization and, eventually, specs an AI coding agent can build from.
Synthesis checklist
Use this before any synthesis leaves your hands:
- Every transcript has speaker labels and a participant header
- Interviews were coded individually before being combined
- Every insight has at least one verbatim, verifiable quote
- Strong claims are supported by more than one participant
- Single-source signals are labeled as hypotheses, not findings
- Counter-evidence was looked for and recorded
- Severity and frequency are rated, not implied
- Each insight points to a decision, not just a description
Frequently asked questions
Can AI synthesize user interviews accurately?
Yes, if you make it show its work. AI is fast and consistent at coding transcripts and clustering themes, but it will also produce confident themes that no participant actually said. The fix is structural, not a better prompt. Require a verbatim quote and a source reference for every insight, check that strong claims appear in more than one interview, and spot-check quotes against the transcript before anything reaches a roadmap.
What is the difference between a theme and an insight?
A theme is a pattern you observed, such as several users mentioning exports. An insight is a theme plus an interpretation that changes a decision, such as finance teams exporting to spreadsheets because they do not trust in-app totals. Themes describe; insights explain and point to action.
How many interviews do I need before AI synthesis is useful?
AI synthesis helps from the first interview because it speeds up coding and quote extraction. Pattern claims are different. A single interview can suggest a hypothesis but cannot support a frequency claim. Treat anything seen in one source as a lead to test, and only call something a pattern once it shows up independently across several participants.
Should I paste interview transcripts into ChatGPT or Claude?
For a handful of transcripts, a general assistant works if you give it a strict output format with quotes and source references, and you check its output. It breaks down when research is continuous, because each chat starts from zero, nothing links findings across studies, and provenance lives in your head. That is the point where a dedicated research synthesis tool pays off.
How do I stop AI from hallucinating user quotes?
Ask for verbatim quotes only, require the source file and speaker for each one, and reject any insight without a quote. Then verify a sample by searching the original transcript for the exact text. A quote that cannot be found word for word should be treated as fabricated, along with any insight that rests on it.