Problem: Inconsistent AI Responses
You ask the AI to analyze the same customer complaint twice.
1st time the AI says: “Billing Issue.” 2nd time: “Service Quality.”
Same complaint, different category.
Why it Happens
LLMs use randomness settings to avoid robotic responses. Plus, tiny context changes create butterfly effects – even the time of day matters.
The Fix:
Try these solutions in order until one works
Define Categories First
Add to Prompt: “Classify using ONLY these categories: [list them]”
[Why it works: Constrains decision space]
Ask for Reasoning
Add to your prompt: “Explain why you chose this category”
[Why it works: Forces consistent logic]
Reference Example
Add to your prompt: “Categorize like you did for [previous example]”
[Why it works: Anchors decisions]
Want More AI Psychology Insights?
Get practical fixes for common AI frustrations.