Sign in

Screaming Frog

@screamingfrog.co.uk
1.1K followers 164 following 116 posts

Run by Founder Dan Sharp of Screaming Frog, a UK search marketing agency & developer of the SEO Spider. Gooner. SEO. & Philanthropist.

PostsRepliesMedia
Reposted by Screaming Frog
Will @iamwill.io · 26/08/2026
🌿 GreenSEO is back at @brightonseo.com in October, exploring sustainability in the AI age. 🍻 Join us for a free night of SEO, sustainability and AI, with talks from Kiri Nowak-Smith, Ed Chinn and Jimmy Dorrell. 🎟 Tickets in comments. Proudly sponsored by @screamingfrog.co.uk and Climbing Trees.
GreenSEO event poster promoting “Sustainability in the Age of AI,” featuring speakers Kiri Nowak, Ed Chinn and Jimmy Dorrell. The event is at The Walrus, Brighton, on Wednesday 7 October at 6:30pm, with free tickets available at greenseo.org/brightonseo. Sponsored by Climbing Trees, Screaming Frog and Creative Bloom, and part of the BrightonSEO fringe.
102
Screaming Frog @screamingfrog.co.uk · 07/08/2026
😂 Nice one dude, will give it a share as usual. Suspect it's all down hill after a top 10 finish last year...
000
Reposted by Screaming Frog
Randip @jadednerd.bsky.social · 05/08/2026
Too much football, too soon! Here's the FPL link to this year's SEO league Auto-join: fantasy.premierleague.com/leagues/auto... Code: 59636c @screamingfrog.co.uk Here you go. (P.S. I'm offering a minority stake in the league to private investors, totally above board and not at all corrupt)
fantasy.premierleague.com
Fantasy Premier League, Official Fantasy Football Game of the Premier League
Official Fantasy Premier League 2026/27. Free to play fantasy football game, set up your fantasy football team at the Official Premier League site.
101
Screaming Frog @screamingfrog.co.uk · 01/06/2026
New tutorial on 'How To Set Up Crawl Email Notifications & Export Attachments' in @screamingfrog.co.uk - www.screamingfrog.co.uk/seo-spider/t...
screamingfrog.co.uk
How To Set Up Crawl Email Notifications & Export Attachments - Screaming Frog
Stay informed about your crawls and send bulk exports to stakeholders without opening the app using email notifications.
010
Screaming Frog @screamingfrog.co.uk · 31/05/2026
👏 Congrats to Owain! Plus, like you, think that's my first top 10 finish, so will def take that 😂 Plus my team actually winning the real league as well for the first time in 22 years! 🎉😆
010
Reposted by Screaming Frog
Athens SEO @athenseo.bsky.social · 03/04/2026
Thrilled to welcome @screamingfrog.co.uk as a Tech Partner of Athens SEO 2026. They believed in us from the start, and if you work in tech SEO, you already know how much that means. Huge thanks to the whole team! 🎟️ Half of the onsite tickets are gone. Livestream available. athenseo.com/buy-tickets/
011
Screaming Frog @screamingfrog.co.uk · 23/03/2026
Hi Will, if you're using the near duplicate analysis, then you can refine the content area used for it. More here in our tutorial - www.screamingfrog.co.uk/seo-spider/t.... We strip out the nav, footer etc by default. But welcome to refine further!
screamingfrog.co.uk
How To Check For Duplicate Content
Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.
120
Screaming Frog @screamingfrog.co.uk · 04/03/2026
Daniel is the imposter! Both Ben and Euan in your sceenshot are on the PPC team at SF as well 😂 The SF FPL league this year is a close one!
100
Reposted by Screaming Frog
Aleyda Solis @aleyda.bsky.social · 25/02/2026
🌍 How to use embeddings to map hreflang tags at scale - A clever use of @screamingfrog.co.uk Open AI API integration to implement hreflang by @pelogia.bsky.social - Check it out: www.guspelogia.com/embeddings-h...
062
Screaming Frog @screamingfrog.co.uk · 18/02/2026
Just released a small update to 23.3 of the @screamingfrog.co.uk SEO Spider - www.screamingfrog.co.uk/blog/seo-spi.... Includes an update to issue 'HTML Document Over 2MB' with Google's update on file size limits, alongside small improvements and bug fixes.
140
Screaming Frog @screamingfrog.co.uk · 27/01/2026
Little tip - Under ‘Config > Spider > Limits’ you can limit the number of URLs crawled per subdomain. This little-known config can be useful when performing research, such as crawling a sample number of URLs per subdomain in list mode.
030
Screaming Frog @screamingfrog.co.uk · 14/01/2026
Little tip - If you’re using vector embeddings for redirect mapping, you can add a rule to define the URL patterns used for semantic similarity analysis via ‘Config > Content > Embeddings', such as from a staging to a live website. More here - www.screamingfrog.co.uk/seo-spider/t...
010
Screaming Frog @screamingfrog.co.uk · 07/01/2026
Little tip - If you don't want to keep crawls you can adjust the crawl retention settings via ‘File > Settings > Crawl Retention’ to auto delete after a period of time. You can also prevent projects and crawls from being cleaned up via right click 'Lock' in 'File > Crawls'.
141
Screaming Frog @screamingfrog.co.uk · 04/12/2025
😂 Can we stop the league now pls 🤝
110
Screaming Frog @screamingfrog.co.uk · 01/12/2025
I did see a request for a team Sephora calendar this year, which made me laugh (and spit my tea out when I looked at it!).
110
Screaming Frog @screamingfrog.co.uk · 01/12/2025
Hat on
130
Screaming Frog @screamingfrog.co.uk · 20/11/2025
Hey Adam! No, nothing changed there. It will be present in a 'Spider' mode export, but not in a 'list' mode export obviously (as we don't know the source - which pages link to the URLs you upload). Perhaps that's the confusion? Cheers
110
Screaming Frog @screamingfrog.co.uk · 18/11/2025
Just released a small update to 23.1 of the @screamingfrog.co.uk SEO Spider - www.screamingfrog.co.uk/blog/seo-spi.... Mostly small improvements, and bug fixes to the latest release.
screamingfrog.co.uk
Screaming Frog SEO Spider Update – Version 23.0 - Screaming Frog
We’re quite pleased to announce Screaming Frog SEO Spider version 23.0, codenamed internally as ‘Rush Hour’. The SEO Spider has a number of integrations, and the core of this release is keeping these ...
020
Screaming Frog @screamingfrog.co.uk · 05/11/2025
Little tip - You can right click and 'Show Inlinks', 'Show Inlinks to Children', or perform the same for 'Outlinks' to see all inlink and outlink relationships in our site visualisations.
000
Screaming Frog @screamingfrog.co.uk · 21/10/2025
The @brightonseo.com Crawling Clinic October ’25 - screamingfrog.co.uk/blog/brighto... Come and chat about any crawling issues you're experiencing, or grab some new SF swag!
screamingfrog.co.uk
The brightonSEO Crawling Clinic October ’25 - Screaming Frog
It’s that time again! The Screaming Frog crew will be heading down to the sunny rainy south coast for the biannual brightonSEO. As always we’re exhibiting, and can be found in the same spot as April: ...
031
Screaming Frog @screamingfrog.co.uk · 20/10/2025
We've introduced crawl retention settings today (www.screamingfrog.co.uk/blog/seo-spi...), which might help with your previous request.
screamingfrog.co.uk
Screaming Frog SEO Spider Update – Version 23.0 - Screaming Frog
We’re quite pleased to announce Screaming Frog SEO Spider version 23.0, codenamed internally as ‘Rush Hour’. The SEO Spider has a number of integrations, and the core of this release is keeping these ...
110
Screaming Frog @screamingfrog.co.uk · 20/10/2025
Just released @screamingfrog.co.uk SEO Spider v.23: screamingfrog.co.uk/blog/seo-spi... Includes - 💡Lighthouse & PSI Updated to Insight Audits ⚙️Crawl Retention Config 🧑‍🤝‍🧑Semantic Similarity Embedding Rules 📊Display All Links in Visualisations 🍇Links in Content Cluster Diagram & more!
screamingfrog.co.uk
Screaming Frog SEO Spider Update – Version 23.0 - Screaming Frog
We’re quite pleased to announce Screaming Frog SEO Spider version 23.0, codenamed internally as ‘Rush Hour’. The SEO Spider has a number of integrations, and the core of this release is keeping these ...
041
Reposted by Screaming Frog
Will @iamwill.io · 03/10/2025
🌿 Less than a month to go until our next GreenSEO event! Join us in Brighton on Thursday 22nd Oct for an evening of sessions on SEO and the environment. 🎟️ Grab your free ticket here: greenseo.org/brightonseo Part of the @brightonseo.com Fringe. Sponsored by Climb Trees and @screamingfrog.co.uk.
GreenSEO group photo
043
Screaming Frog @screamingfrog.co.uk · 24/09/2025
Little tip - You can fetch API data without any crawling. Just go to 'Mode > APIs', select your APIs such as GA4, GSC, PSI or link metrics - and upload the list of URLs to pull data quickly.
050
Reposted by Screaming Frog
Carl Hendy @carlhendy.com · 24/09/2025
My first public “vibe-coded” idea-to-product: storeratings.co Building this was fun but definitely tested my patience. A combination of Vercel, GitHub, and Cursor, I got there in the end. I am not a developer or designer, go easy.
183
Reposted by Screaming Frog
John Mueller @johnmu.com · 04/09/2025
So long, and thanks for all the fishes, uhm, memories. I'll miss you, Mr Wiseguy. RIP @alanbleiweiss.bsky.social
3243
Screaming Frog @screamingfrog.co.uk · 13/08/2025
Little tip - You can run prompts against specific segments. You can also segment against issues. So you can easily generate alt text only for images missing alt text for example.
130
Reposted by Screaming Frog
Ian Lurie @ianlurie.bsky.social · 06/08/2025
Finally getting around to playing with @screamingfrog.co.uk's LLM API integration. My goodness, that's cool.
011
Reposted by Screaming Frog
Randip @jadednerd.bsky.social · 04/08/2025
I need another month off football but here's the FPL link for the SEO league. @screamingfrog.co.uk Here you go! Auto-join: fantasy.premierleague.com/leagues/auto... code: 0xxnvz
fantasy.premierleague.com
Fantasy Premier League, Official Fantasy Football Game of the Premier League
Official Fantasy Premier League 2025/26. Free to play fantasy football game, set up your fantasy football team at the Official Premier League site.
101
Screaming Frog @screamingfrog.co.uk · 04/08/2025
Was just thinking the same 😂 Come round quick!! Will give it a share now ⚽👍
000
Screaming Frog @screamingfrog.co.uk · 18/07/2025
AI search is booming, but SEO is still not dead - searchengineland.com/ai-search-bo... from @lilyray.nyc
searchengineland.com
AI search is booming, but SEO is still not dead
AI search tools are on the rise, but SEO fundamentals remain critical. Learn how the two intersect and what it means for your strategy.
052
Screaming Frog @screamingfrog.co.uk · 17/07/2025
Little tip - You can customise the OpenAI endpoint to use LLMs that are compatible with the OpenAI API format. For example, this means you can use Grok or DeepSeek by updating the endpoint, and API key.
000
Screaming Frog @screamingfrog.co.uk · 07/07/2025
Currently you need to filter for the way around you wish to redirect and export. It 'can' find a closest neighbour on the same subdomain (rather than target) which might not be helpful - so will likely add a config at some stage to help with that (as it wasn't really purpose-built for this task!).
120
Screaming Frog @screamingfrog.co.uk · 07/07/2025
How To Use Vector Embeddings for Redirect Mapping - www.screamingfrog.co.uk/seo-spider/t...
screamingfrog.co.uk
How To Use Vector Embeddings for Redirect Mapping - Screaming Frog
While not purpose-built for this task, find out how to use embeddings to identify the closest matching neighbour to utilise for redirect mapping.
192
Screaming Frog @screamingfrog.co.uk · 01/07/2025
We made a decision not to offer that a long time ago I am afraid, after seeing many businesses like ours find out it's simply not sustainable.
000
Reposted by Screaming Frog
Google Search status dashboard bot @search-status-bot.bsky.social · 30/06/2025
June 2025 core update - Released the June 2025 core update . The rollout may take up to 3 weeks to complete. (source) #seo
2155
Reposted by Screaming Frog
David Gossage @dgossage.bsky.social · 25/06/2025
How to Interpret the Content Clustering Visualisation in @screamingfrog.co.uk #seo seogreetings.com/blogs/news/h...
seogreetings.com
How to Interpret the Content Clustering Visualisation in Screaming Fro
Screaming Frog’s Semantic Content Cluster Diagram is a game-changing visualisation tool that helps SEOs quickly understand the true structure of a site’s content by understanding the semantic relevanc...
001
Screaming Frog @screamingfrog.co.uk · 24/06/2025
Noindex No Longer Means Not Rendered - tamethebots.com/blog-n-bits/...
tamethebots.com
Noindex No Longer Means Not Rendered
It seems there's been a change in how Google's rendering works when a page is set to noindex, with JavaScript now being executed.
011
Screaming Frog @screamingfrog.co.uk · 23/06/2025
New tutorial available on 'How To Crawl With AI Prompts' - screamingfrog.co.uk/seo-spider/t... Includes - - How to set up and crawl with prompts - Common use cases - Running prompts for specific segments & issues - Custom endpoints & more! Enjoy.
screamingfrog.co.uk
How To Crawl With AI Prompts - Screaming Frog
Learn how to connect to LLM APIs and set up custom prompts against crawl data for more insight.
140
Screaming Frog @screamingfrog.co.uk · 16/06/2025
New tutorial on 'How to Identify Semantically Similar Pages & Outliers' - www.screamingfrog.co.uk/seo-spider/t...
screamingfrog.co.uk
How to Identify Semantically Similar Pages & Outliers - Screaming Frog
Analyse the semantic similarity of pages in a crawl to help identify duplicate content and detect potentially off-topic, less relevant content on a site.
020
Screaming Frog @screamingfrog.co.uk · 10/06/2025
Just released @screamingfrog.co.uk SEO Spider v.22: www.screamingfrog.co.uk/blog/seo-spi... Includes - 🔍Semantic Similarity & Outliers 📊Content Cluster Visualisation 🐸 Semantic Search 🤖 AI Integration Improvements 🦾 Column Config, Custom Export, Export To Tabs! And lots more. Enjoy!
1113
Screaming Frog @screamingfrog.co.uk · 09/06/2025
Readability of Spanish Texts: Alternative Metrics to ‘Flesch Reading Ease’ - www.screamingfrog.co.uk/blog/readabi... from @mjcachon.bsky.social
screamingfrog.co.uk
Readability of Spanish Texts: Alternative Metrics to ‘Flesch Reading Ease’? - Screaming Frog
When we face the challenge of examining the readability of content in web projects, we find well-known publications and metrics such as Flesch Reading Ease. The importance of these metrics lies in som...
012
Screaming Frog @screamingfrog.co.uk · 28/05/2025
How AI Mode Works and How SEO Can Prepare for the Future of Search - ipullrank.com/how-ai-mode-...
ipullrank.com
How AI Mode Works and How SEO Can Prepare for the Future of Search -
AI Mode is transforming Google Search beyond recognition, and SEO isn’t ready. This article explains how generative search works, why traditional tactics are falling short, and what marketers must do ...
111
Screaming Frog @screamingfrog.co.uk · 21/05/2025
Top ways to ensure your content performs well in Google's AI experiences on Search - developers.google.com/search/blog/...
developers.google.com
Top ways to ensure your content performs well in Google's AI experiences on Search  |  Google Search Central Blog  |  Google for Developers
032
Screaming Frog @screamingfrog.co.uk · 19/05/2025
How Long Does It Take to Rank in Google? And How Old Are Top Ranking Pages? - ahrefs.com/blog/how-lon...
ahrefs.com
How Long Does It Take to Rank in Google? And How Old Are Top Ranking Pages?
Back in 2017, we ran a study to answer an important question: How old are the top-ranking pages in Google? In 2025, the data looks very different.
010
Screaming Frog @screamingfrog.co.uk · 16/05/2025
Finding and Testing Internal Link Changes with Screaming Frog - www.screamingfrog.co.uk/blog/finding... from @ryanjonesseo.bsky.social
screamingfrog.co.uk
Finding and Testing Internal Link Changes with Screaming Frog - Screaming Frog
Internal linking is a crucial but often overlooked aspect of SEO that can significantly impact your website’s search performance. This guide explains how to use the SEO Spider’s features to identify i...
022
Screaming Frog @screamingfrog.co.uk · 13/05/2025
Fresh Doc Dump: PageRank, Navboost, and RankEmbed: DOJ Papers Outline Google’s Stack - www.searchengineworld.com/fresh-doc-du...
searchengineworld.com
Fresh Doc Dump: PageRank, Navboost, and RankEmbed: DOJ Papers Outline Google’s Stack
Google’s own court-filed slide deck just spilled more tea on Navboost, and the details punch a few holes in years of SEO guesswork.  The newly released trove goes further, mapping more than 100 raw si...
150
Screaming Frog @screamingfrog.co.uk · 08/05/2025
Google's AI Adventure - One Year On - www.seoforgooglenews.com/p/googles-ai...
seoforgooglenews.com
Google's AI Adventure - One Year On
A year after the introduction of AI Overviews, let's look at the impact on publishers' traffic and visibility and what's next in store for AI in search.
000
Screaming Frog @screamingfrog.co.uk · 05/05/2025
New Study: The 130 Day Indexing Rule - indexinginsight.substack.com/p/new-study-...
indexinginsight.substack.com
New Study: The 130 Day Indexing Rule
At Indexing Insight we've analysed 1.4 million pages to understand if the 130 Day Indexing rule is true.
020
Screaming Frog @screamingfrog.co.uk · 05/05/2025
11 Lessons Learned From Auditing Over 500 Websites - www.searchenginejournal.com/lessons-lear... from @olgazarr.bsky.social
searchenginejournal.com
11 Lessons Learned From Auditing Over 500 Websites
After auditing hundreds of websites, the most frequent or significant problems are not complex technical SEO issues. Read on and learn what truly works.
040