iiinova — where your digital self keeps evolving

Screaming Frog @screamingfrog.co.uk · 18/02/2026

Just released a small update to 23.3 of the @screamingfrog.co.uk SEO Spider - www.screamingfrog.co.uk/blog/seo-spi.... Includes an update to issue 'HTML Document Over 2MB' with Google's update on file size limits, alongside small improvements and bug fixes.

150

Screaming Frog @screamingfrog.co.uk · 27/01/2026

Little tip - Under ‘Config > Spider > Limits’ you can limit the number of URLs crawled per subdomain. This little-known config can be useful when performing research, such as crawling a sample number of URLs per subdomain in list mode.

030

Screaming Frog @screamingfrog.co.uk · 14/01/2026

Little tip - If you’re using vector embeddings for redirect mapping, you can add a rule to define the URL patterns used for semantic similarity analysis via ‘Config > Content > Embeddings', such as from a staging to a live website. More here - www.screamingfrog.co.uk/seo-spider/t...

010

Screaming Frog @screamingfrog.co.uk · 07/01/2026

Little tip - If you don't want to keep crawls you can adjust the crawl retention settings via ‘File > Settings > Crawl Retention’ to auto delete after a period of time. You can also prevent projects and crawls from being cleaned up via right click 'Lock' in 'File > Crawls'.

141

Screaming Frog @screamingfrog.co.uk · 05/11/2025

Little tip - You can right click and 'Show Inlinks', 'Show Inlinks to Children', or perform the same for 'Outlinks' to see all inlink and outlink relationships in our site visualisations.

000

Screaming Frog @screamingfrog.co.uk · 24/09/2025

Little tip - You can fetch API data without any crawling. Just go to 'Mode > APIs', select your APIs such as GA4, GSC, PSI or link metrics - and upload the list of URLs to pull data quickly.

050

Screaming Frog @screamingfrog.co.uk · 13/08/2025

Little tip - You can run prompts against specific segments. You can also segment against issues. So you can easily generate alt text only for images missing alt text for example.

130

Screaming Frog @screamingfrog.co.uk · 17/07/2025

Little tip - You can customise the OpenAI endpoint to use LLMs that are compatible with the OpenAI API format. For example, this means you can use Grok or DeepSeek by updating the endpoint, and API key.

000

Screaming Frog @screamingfrog.co.uk · 10/06/2025

Just released @screamingfrog.co.uk SEO Spider v.22: www.screamingfrog.co.uk/blog/seo-spi... Includes - 🔍Semantic Similarity & Outliers 📊Content Cluster Visualisation 🐸 Semantic Search 🤖 AI Integration Improvements 🦾 Column Config, Custom Export, Export To Tabs! And lots more. Enjoy!

1113

Screaming Frog @screamingfrog.co.uk · 16/04/2025

Little tip - There are 'outside <head>' filters for key elements such as titles, canonicals, hreflang etc in their tabs. However, often the cause is an invalid element in the <head>, which closes it early. Check the Validation tab to see if this has been triggered when debugging.

120

Screaming Frog @screamingfrog.co.uk · 12/03/2025

Little tip - You can compare crawls of staging to a live website by using 'URL Mapping' in crawl comparison. Equivalent URLs are then compared against each other to identify changes and issues between the crawls. (More in out tutorial here - www.screamingfrog.co.uk/seo-spider/t...)

0125

Screaming Frog @screamingfrog.co.uk · 18/02/2025

Our team are exhibiting @womenintechseo.bsky.social WTSFest London this week. If you're attending, come and say hello, ask us any burning crawling queries, or pick up some 😱🐸 swag!

0101

Screaming Frog @screamingfrog.co.uk · 05/02/2025

Little tip - If a site relies upon infinite scroll or lazy loading, you can use the Custom JavaScript snippet 'Scroll Page' to load additional content and links when crawling via 'Config > Custom > JavaScript > Add from Library'.

0111

Screaming Frog @screamingfrog.co.uk · 15/01/2025

Little tip - You can right click and ‘Show Link In Browser’ and ‘Show Link in HTML’ in both the Inlinks and Outlinks tabs to make it more efficient to find specific links.

061

Screaming Frog @screamingfrog.co.uk · 10/01/2025

Little tip - To crawl multiple subdomains or root domains that are unlinked, switch to list mode (Mode > List), then disable the 'limit crawl depth' setting (Config > Spider > Limits) & upload them to crawl together.

051

Screaming Frog @screamingfrog.co.uk · 06/01/2025

Virgin Holidays migration from the .co.uk to Virgin Atlantic .com domain.

040

Screaming Frog @screamingfrog.co.uk · 05/12/2024

Little tip - There are additional crawl stats available via the progress bar arrows. Alongside URLs completed & remaining, you can view elapsed & estimated time remaining, as well as crawl start date & time.

040

Screaming Frog @screamingfrog.co.uk · 19/11/2024

Come and say hello, ask any crawling questions, or grab some swag from the @screamingfrog.co.uk team running the crawling clinic @brightonseo.bsky.social San Diego - www.screamingfrog.co.uk/brightonseo-...

020