Crawl budget

What it is: crawl budget is the number of pages a search engine is willing to crawl on your site in a given window. It’s shaped by your site’s size, speed, and authority. On larger sites, crawlers won’t reach every page every day.

Why it matters: if a crawler hasn’t gotten to your new article yet, it can’t be indexed or ranked. Relying on crawl budget alone means slow, unpredictable discovery.

Goal: by proactively notifying engines on publish (IndexNow, Google Indexing API) and keeping the sitemap fresh, BurstWriter gets new articles crawled without waiting for your crawl budget to come around.