How to Set Crawl Frequency for Website Analysis
Regular website analysis helps you stay on top of technical issues, broken links, performance bottlenecks, and SEO improvements. Screpy uses a crawler to scan your website and generate actionable reports. To keep this data fresh and relevant, you can customize how often the crawler runs.
Steps to Set Crawl Frequency:
-
Go to your project dashboard.
-
Click on Project Settings.
-
Under the Crawler Settings section, find the Crawl Frequency option.
-
Choose your preferred interval:
– Weekly
– Every 15 Days
– Monthly
By adjusting the crawl frequency, you control how often Screpy analyzes your website’s structure, SEO health, and performance. Weekly crawls are recommended for active websites or those undergoing frequent updates, while monthly may be suitable for static or less frequently updated sites.
If you're unsure which option is best for you, feel free to reach out to our support team for personalized guidance.