Skip to main content

Crawling Frequency

AddSearch automatically crawls your website to add new content and update existing pages in the search index. This process, called crawling and re-crawling, adapts dynamically based on how often your site's content changes.

How Crawling Frequency Works​

AddSearch monitors your website's update patterns to adjust the recrawl cycle. When you first start using AddSearch, it might take some time before new and updated pages appear in search results. As AddSearch learns the frequency of your content updates, the recrawling process becomes faster, making new content available in the search more quickly.

Using Sitemaps to Influence Crawling​

To ensure that your index includes all your intended pages, add your sitemap URL to your AddSearch index. Sitemaps are recrawled daily. Therefore, any new pages included in your sitemap will be added to the index within 24 hours.

To add your sitemap, enter its URL in the Index Tools section available in your AddSearch dashboard. For guidance, see Single Pages Indexing.

Real-Time Indexing for Frequent Updates​

If your website adds or updates large amounts of content frequently, use AddSearch's RSS feed feature for immediate indexing.

  • When enabled, new or updated content is reflected in search results immediately.
  • RSS feed support is available for Core, Advanced, and Enterprise plans. [Note: verify plan names and availability.]

Alternatively, you can add and update content directly using the AddSearch search API.