Two employees can ask the same question and need different answers, because different policies apply to them. The chatbot needs a rule for choosing, and the policy owner is the one to write it.
Can’t it use the country in the employee’s profile?
A profile field is one fact, and it may not be the one that decides. The policy may turn on the employing company, the employee group or the assignment.
1. Ask the policy owner which facts decide.
For each policy, write down what separates one group from another. It may be the employing company, the employee group, the work location or something else the owner names.
2. Find where each fact is checked.
Each fact needs a place it can be confirmed: a record the chatbot is allowed to read, or a question it asks the employee.
3. Decide what happens when a fact is missing.
When a fact is missing or two records disagree, the chatbot asks, or passes the question to HR. It doesn’t choose a policy on a guess.
Practical check: Remove one deciding fact from a test account and see what the chatbot does.
A fictional example: office and field staff.
An office employee and a field employee can both open the policy library. Each asks whether travel time counts as working time. One needs the field guidance and the other needs the office process. Being able to open a document doesn’t mean it applies to the person reading it.
4. Test the same question from different groups.
- Known employee group
- Answers from the source for that group.
- Missing or conflicting details
- Asks, or passes the question on.
- Guidance that has been replaced
- Isn’t presented as current.
- A personal exception
- Goes to a person for individual review.
Have the policy owner agree the expected answers before the test.
Read more: How to Write HR Policies an AI Agent Can Use · Why an HR Chatbot Gives Bad Answers, and What to Check · How to Run Acceptance Tests on an HR Chatbot Before Launch
The example is fictional. This isn’t legal advice or a decision about anyone’s entitlement. This is general guidance, not advice for your situation.