Set Up
To set up your website knowledge base, navigate to the Knowledge Base tab and click Add New. Select either Indexed Website or Realtime Website from the Category dropdown menu, then add your URL(s) into the Website URL box and click Test. Fill in any additional sections marked as required.Some websites may fail the Test URL function, indicating they are inaccessible. A site is considered inaccessible if it uses CAPTCHAs, anti-bot protections, or other access restrictions.
Indexed Websites
Indexed website knowledge bases will crawl the entire sitemap and index the identified webpages pages. This provides faster responses since the information is pre-stored rather than fetched in real-time.Re-indexing
When changes are made to your webpages, you will need to re-index to update the knowledge base. You can choose to re-index:- The entire site
- Specific site folders
- Individual pages
Realtime Websites
Realtime websites fetch content live from the website URL each time the agent is queried. This provides the most up-to-date information but may be slower due to live tool calls.Best Practices
- Re-index regularly (for indexed websites) if your website content changes frequently to ensure your agent has current information.
- Avoid using URLs that point to downloadable files like
.pdf,.docx, etc. Instead, download the file and upload it via a Document Knowledge Base. - Always test a new URL by asking the agent about it and validating the returned response for accuracy.
- If you want to limit your agent to certain parts of your site, use the exact URL to a specific page instead of a home page.
- Write clear, informative descriptions to help your agents use your knowledge base properly, such as what topics are contained and when the agent should use it.