Article · 5 September 2026
Does your chatbot say it is an AI? Eight of twelve do.
Since 2 August 2026, the EU AI Act requires that a person interacting directly with an AI system is informed of that fact. Three weeks later, we looked at how Swedish consumer lending chats handle it.
Tim Bisander
Founder & CPTO, Billuminate · 4 min read
This article covers what the rule says, what we observed, and how we have chosen to handle it ourselves. It is not legal advice, and it deliberately avoids the question of who is or is not compliant.
What does the rule actually say?
Article 50(1) of the AI Act (Regulation (EU) 2024/1689) requires providers to ensure that people interacting directly with an AI system are informed that they are doing so. There is one notable exemption: the duty does not apply where it is obvious to a reasonably well-informed and attentive person, given the circumstances, that they are talking to an AI.
That exemption matters. A company presenting a clearly robotic button-menu may well fall within it. A fluent, humanlike assistant with a human-sounding name is a harder case.
Whether any individual company falls inside or outside the exemption is an assessment for supervisors and ultimately courts, not for us.
What did we observe?
As part of our CRIX measurement of Swedish consumer lending chats, we recorded what each of the twelve publicly reachable assistants displayed about its own nature. We deliberately waited three weeks after the requirement took effect, and then observed every chat in a single sweep, so that each company had a reasonable opportunity to bring its disclosure into line before we looked.
Eight of the twelve state that the customer is talking to an AI. Four of those also warn that the answers may be wrong. Three present the assistant as something other than an AI. One displayed nothing at all.
Billuminate CRIX · Cohort 1 · Consumer loans
Does the chat say it is an AI? 8 of 12 do.
What the twelve measured lending chats displayed about their own nature, observed in a single sweep three weeks after the EU AI Act transparency requirement took effect.
- States it is an AI, and warns that answers may be wrong · 4 of 12
- States it is an AI · 4 of 12
- Presents the assistant as something other than an AI · 3 of 12
- Displayed nothing at all · 1 of 12
We report what was observed, not what anyone is in breach of; the regulation’s exemption for the obvious may apply. August 2026.
Why does this matter in practice, not just on paper?
The caution is warranted. In the same measurement, 19 per cent of the answers given contained something untrue.
Billuminate CRIX · Cohort 1 · Consumer loans
One answer in five contained something untrue
19 per cent of the answers given in the CRIX measurement included an untrue statement the customer could have acted on.
Ordinary questions about co-borrowers, income and payment defaults, answered fluently, confidently and incorrectly.
This finding makes informing consumers that they are talking to an AI more than a regulatory formality. It is the one signal that tells them how to read the answer, and to treat it with care. Banking is built on trust: a consumer who interacts with a bank has every reason to trust what they are told, and will typically act on it. That is exactly why they need to know when the answer comes from a machine that can be wrong.
As long as answers can be wrong, telling people what they are talking to is part of answering honestly.
So the four companies that both state it is an AI and warn that answers may be wrong are not being over-cautious, they are simply doing what they should. The disclosure and the error rate belong together.
Who supervises this in Sweden?
Despite the rule applying since 2 August 2026, Sweden has not yet settled who will supervise it. Interim authorities have been appointed, among them Finansinspektionen, IMY and PTS, but no authority has yet been designated for the chatbot transparency duty specifically.
Waiting for that to resolve is not much of a plan. The rule applies today, and avoiding a position on it is not primarily a legal risk. It leaves the company’s own customers without the one warning that would make them careful.
How we handle it ourselves
We are not a compliance advisor, so we will simply describe our own reasoning. Bill, our assistant, states that it is an AI, warns that answers can contain errors, and shows which sources each answer is built on. We do this not because a rule forces us to, but because the disclosure and the accuracy work belong together: telling a person they are talking to a machine is what makes them apply the healthy caution that even a well-built system deserves. Transparency is not a legal tax on AI, it is part of what makes AI usable in a regulated industry built on the foundation of trust.
Three questions worth asking about any customer-facing AI
The same three we effectively asked in our measurement. If the answer to all three is yes, the transparency question is largely settled, and the harder work can begin: making the answers correct.
01
Does the chat say what it is?
The plain version of the duty. A person who has to guess whether they are talking to a machine has already been left to work it out for themselves.
02
Does it say that it can be wrong?
Half of those that disclose stop at the disclosure. Saying that answers may contain errors is what turns the fact into something the reader can use.
03
Would a reasonable customer understand?
The exemption turns on this, and it is the hardest of the three to answer honestly about your own chat. A humanlike assistant with a human-sounding name is a harder case than a button menu.

About the author
Tim Bisander, founder and CPTO at Billuminate
The observations come from the CRIX measurement of Swedish consumer lending chats, August 2026. The full report is public on our website.
LinkedIn →