--- title: "AI chatbot trained on your website" description: "Point your AI assistant at your help site: a robots-aware crawl of up to 50 pages, every answer cited to the page it came from. Ready today." last_updated: "2026-10-06T17:03:39+03:00" --- # AI chatbot trained on your website Source: https://busymate.ai/connectors/site-crawl Last modified: 2026-10-06T17:03:39+03:00 Point your AI assistant at your help site: a robots-aware crawl of up to 50 pages, every answer cited to the page it came from. Ready today. Status: ready today. ## Try it ยท Connect yours - Try it: Coming soon โ€” Ask it on Busymate AI: https://busymate.ai/chat/new - Connect Website crawl: https://busymate.ai/console/knowledge โ€” A web address the crawler may read and a page limit. ## Website crawl in action A customer writes on Website crawl, your mate answers from your own content, and your team steps in from the Inbox when it matters. - The Knowledge base setup card in the Console of a new workspace, before anything is connected.: https://busymate.ai/connector-proof/site-crawl/console-light-desktop-1888.webp (2026-10-02) Diagram: a customer sends a message on Website crawl; your mate answers; when needed the conversation is handed to your Inbox and team. ## Set it up in the Console 1. In Console โ†’ Knowledge, add a source with the address and how many pages it may index (1 to 50). 2. Watch the source report its pages and chunks; an empty crawl is visible, never silent. 3. Publish a version and ask your mate a question only your site can answer. ## Questions ### Is it ready today? Ready today from your Console and over MCP. ### Does connecting Website crawl cost extra? No platform fee: Busymate AI bills per workspace plan, not per channel. The channel's own provider may charge for its numbers, messages or approvals. ### What happens when it cannot answer? It says when it is unsure. If handoff is enabled for your workspace and channel, it can ask your team to take over in the Inbox. It confirms when your team has been asked to help. ## Related - How to integrate Website crawl: https://busymate.ai/docs/guides/knowledge#1-add-a-website-source - Knowledge sources: https://busymate.ai/connectors/category/knowledge-base.md - All connectors: https://busymate.ai/connectors.md