BillBot
Our crawler
BillBot fetches public knowledge from corporate websites and authority sources so Billuminate can answer with verified, sourced content. It follows the protocol, identifies itself openly, and respects opt-out without negotiation.
01 · Identity
How to recognize us
BillBot identifies itself in the User-Agent header on every request:
BillBot/1.0 (+https://www.billuminate.io/billbot)If you see that string in your server logs, it is us. The URL points back to this page so any operator can quickly check who we are and what we do.
02 · Behavior
How BillBot behaves
- Follows
robots.txtperRFC 9309. We do not crawl anything a site has disallowed. - Maximum one request per second per domain. You should never notice us in your load.
- Uses
ETagandIf-Modified-Sincefor conditional GETs. Unchanged pages cost you no bandwidth. - Bounded crawl depth per source, configured per customer. We do not spread across your site without reason.
HTTPSonly. No cookies, no forms, no logged-in views.
03 · Opt-out
Don't want us crawling?
Two options. Either works. You don't have to contact us to opt out, but we welcome an email so we can confirm.
Option A: robots.txt
Add the following to your robots.txt:
User-agent: BillBot
Disallow: /On the next crawl, we see the directive and stop. No exceptions, no negotiation.
Option B: Email us
Send a request to privacy@billuminate.io with the domain you want excluded. We confirm within one business day and remove any existing material from our knowledge base within seven days.
04 · Why
Why we crawl
Billuminate is building a verified knowledge layer for consumer-facing financial questions. End-users should be able to ask things like "what is a payment remark?" or "what rules apply when I move my savings?" and get answers traceable to the underlying source.
That requires us to keep current content from authority sources (Swedish Tax Agency, Consumer Agency, Central Bank, Financial Supervisory Authority, ...) and from companies operating consumer products (banks, lenders, insurers). BillBot keeps that data fresh.
We do not train models on what we crawl. Content is used as a grounding layer for retrieval and cited answers, not for weight learning.
05 · Data
What we do with the content
Content is stored within the EU. PII is stripped at ingestion where possible. We do not republish text verbatim — we synthesize answers with source citations. Takedown requests are honored, within 48 hours for logos and within seven days for text.
Full policy lives on the transparency page.
