FAQ

Frequently Asked Questions

By Yunus

• 7 articles

How to add the sitemap to the technical audit so it only crawls the pages on the sitemap?

A sitemap is a file that lists all the important pages on your website, helping search engines and other tools (like Google) understand the structure of your site. It usually comes in the form of an XML file (e.g., sitemap.xml) and acts as a roadmap for crawlers to follow and index your content more efficiently. Currently, Screpy does not support manually submitting a sitemap. This means there is no option at this time to add a sitemap URL to guide our crawler during the analysis process. Instead, Screpy automatically tries to discover and scan your pages starting from your homepage. While this works for most websites, we understand that some users may prefer to define exactly which URLs should be included using a sitemap. We’re aware of this need and always aim to improve the user experience. If you have a large or complex site, and Screpy is not analyzing all of your pages as expected, feel free to contact our support team.

Last updated on Jul 03, 2025

My SERP keywords are not being analyzed automatically.

What Is SERP and Why Is It Important? SERP stands for Search Engine Results Page — the page you see after performing a search on Google, Bing, or any other search engine. It shows a list of web pages that are most relevant to your query. Tracking your position on the SERP for specific keywords is crucial for understanding how well your website is performing in organic search results. SERP analysis allows you to monitor your rankings, identify changes, and uncover opportunities to improve your visibility and traffic. By regularly analyzing keyword positions, you can make informed SEO decisions and stay ahead of the competition. How to Enable Automatic SERP Analysis in Screpy To make sure your keyword rankings are analyzed regularly without manual effort, you can enable the Auto Analyze feature in Screpy. Here's how: 1. Go to your project dashboard. 2. Click on Project Settings. 3. Navigate to the SERP Settings section. 4. Toggle on the Auto Analyze option. Once enabled, Screpy will automatically check and update the rankings for your selected keywords at regular intervals. This ensures your data stays up to date and helps you react quickly to changes in your search performance. If you have any trouble enabling this feature or need further assistance, feel free to contact our support team.

Last updated on Jul 03, 2025

My projects are not being analyzed automatically.

How to Set Crawl Frequency for Website Analysis Regular website analysis helps you stay on top of technical issues, broken links, performance bottlenecks, and SEO improvements. Screpy uses a crawler to scan your website and generate actionable reports. To keep this data fresh and relevant, you can customize how often the crawler runs. Steps to Set Crawl Frequency: 1. Go to your project dashboard. 2. Click on Project Settings. 3. Under the Crawler Settings section, find the Crawl Frequency option. 4. Choose your preferred interval: – Weekly – Every 15 Days – Monthly By adjusting the crawl frequency, you control how often Screpy analyzes your website’s structure, SEO health, and performance. Weekly crawls are recommended for active websites or those undergoing frequent updates, while monthly may be suitable for static or less frequently updated sites. If you're unsure which option is best for you, feel free to reach out to our support team for personalized guidance.

Last updated on Jul 03, 2025

I’m getting a redirect error.

What Is a Redirect Page? A redirect page is a webpage that automatically sends visitors (and bots like Screpy’s crawler) from one URL to another. This often happens when a website has moved content to a new address or wants to direct traffic from outdated URLs to current ones. For example: If yourwebsite.com automatically redirects to www.yourwebsite.com/home, then the original link is considered a redirect. Redirects are common and useful, but they can interfere with website analysis tools if not handled correctly — especially during project setup. Make Sure You’re Adding the Correct URL If you’re having trouble during project creation or crawling: 1. Avoid using inner pages. You might be trying to add a subpage instead of your actual homepage. 2. Use your main homepage URL. Example: https://www.yourwebsite.com instead of https://www.yourwebsite.com/about 3. Check for redirects. Make sure the link you are entering does not automatically redirect to another page. Screpy performs best when starting from the actual root domain without redirection. If you're still unsure whether the link you're using is correct, try opening it in an incognito browser tab. If it instantly changes to another URL, it’s likely a redirect. Let us know if you need help identifying the right URL to use.

Last updated on Jul 03, 2025

I got a 403 error.

What Is a 403 Forbidden Error? A 403 Forbidden Error occurs when a web server understands your request but refuses to fulfill it. In simple terms, it means you're not allowed to access the requested resource. This error is often caused by: - Firewall or security rules blocking certain IPs - Permissions not allowing public access to a file or directory - Security plugins or services denying specific bots or tools When Screpy receives a 403 error while trying to analyze your website, it typically means our crawler is being blocked. Why Screpy Might Be Blocked (And How to Fix It) If you're seeing a 403 error during analysis, it likely means your site’s firewall or security configuration is preventing Screpy from accessing it. To resolve this: 1. Check your firewall settings Your server or hosting provider might be blocking Screpy’s bots. 2. Allow Screpy’s IP addresses You’ll need to whitelist Screpy’s server IPs so our crawlers can reach your website. Screpy Server IPs: - 188.245.118.213 - 49.13.118.216 - 49.13.56.96 - 5.75.247.29 3. Look into security plugins or services Tools like Cloudflare, Wordfence, or other protection systems may be denying bot access. Adjust their settings to allow Screpy. Once Screpy has access, the analysis will continue without issues. If you need help identifying where the block is coming from or how to whitelist our IPs, feel free to contact our support team.

Last updated on Jul 03, 2025

How can I ignore a page from being crawled?

If there are certain pages on your website that you don’t want Screpy to analyze—such as thank-you pages, login panels, or duplicate content. You can easily exclude them from the crawling process. Steps to Ignore a Page from Crawl Analysis: 1. Open your project in Screpy. 2. From the left-hand sidebar, click on “Crawled Pages.” 3. In the list of crawled URLs, select the pages you want to exclude. 4. Once selected, a menu will appear at the top of the list. 5. Click on the “Ignore URL” option. These pages will now be excluded from future crawls and will not affect your technical or SEO analysis scores. Note: You can always revisit this section to undo the ignore action if needed. If you have any questions about which pages should be ignored or how this affects your overall analysis, feel free to contact our support team.

Last updated on Jul 03, 2025

Why Aren’t Images on My Website Being Analyzed?

By default, image analysis is turned off when your website is crawled in Screpy. This helps improve crawl speed and efficiency, especially for larger websites. If you’d like Screpy to include image-related checks (such as missing alt attributes, oversized files, or loading issues), you can enable this option manually. How to Enable Image Analysis: You can activate image analysis in two ways: 1. Before starting a crawl: – Go to Advanced Settings during the crawl setup. – Enable the Image Analysis option. 2. After the crawl has started or finished: – Go to your Project Settings. – Under crawler options, enable Image Analysis, and then re-run the crawl. Note: Each image analysis costs 5 credits per image. Please make sure you have sufficient credits in your account before enabling this feature. If you’re unsure about enabling image analysis or need help with the process, our support team is happy to assist.

Last updated on Jul 03, 2025