ZenTalkBot
A crawler that visits online stores to prepare a demo of the ZenTalk AI shopping assistant on their real products.
Mozilla/5.0 (compatible; ZenTalkBot/1.0; +https://zentalk.pl/pl/bot)Who we are
ZenTalkBot is operated by ZenTalk AI (Global Thiel, Poland, VAT ID PL7811775336). It is not a search engine and does not crawl the web continuously — it visits a specific store only when we prepare a demo for it, usually before contacting the owner or at their request.
What it collects
- Public product pages: name, price, availability, description, attributes, categories and the main image.
- Information pages (shipping, payment, returns, contact) and blog posts.
- Only what any visitor can see — no logging in, forms, cart or store admin. We do not collect the store's customer data.
How it behaves
- Follows robots.txt (RFC 9309): Disallow rules for ZenTalkBot, or for all robots (*) when there are none for us.
- Honours Crawl-delay; without it, waits at least 1 s between API requests and 2 s between pages. On HTTP 429 or 503 it halves its speed.
- Sends one request at a time and stops once the selected number of products is fetched — a one-off visit.
- Does not bypass protection: if the site shows a bot challenge (e.g. Cloudflare) or blocks access, crawling stops.
- Content is never used to train AI models — only as the demo's knowledge base (Content-Signal ai-train=no is respected).
WordPress, WooCommerce and Shopify
If the store runs on WordPress / WooCommerce or Shopify, we use their public API (wp-json, Store API, products.json) — the same data as on the store pages, fetched in a few dozen requests instead of thousands. When robots.txt disallows /wp-json/ for all robots, we use it only after a deliberate decision for that specific demo, precisely because it puts less load on the store. A ZenTalkBot entry with “Disallow: /” (below) blocks us completely, including the API.
What happens to the data
- Fetched content goes into a single, non-public demo account; only the store owner receives the chat link.
- After 30 days the demo expires and the content is deleted automatically — unless the store becomes a ZenTalk customer.
- We delete it earlier on request (contact below).
How to block or slow down ZenTalkBot
Add an entry to robots.txt in your store's root directory:
User-agent: ZenTalkBot Disallow: /
User-agent: ZenTalkBot Crawl-delay: 10
Requests come from Vercel infrastructure (Dublin region) without fixed IP addresses — use robots.txt or the ZenTalkBot User-Agent name to block.
Contact
Questions, reports and data deletion requests: biuro@zentalk.pl.