PingTalks PingTalks
Technology How to 10 min read

Screaming Frog MCP in Claude: Chat Your Way Through an SEO Audit

Screaming Frog's MCP server lets Claude run crawls, reports and crawl comparisons by chat. Here is the setup, five prompts for Indian sites and the rupee maths on the paid licence.

Laptop showing website crawl data for a Screaming Frog MCP SEO audit in Claude

Key takeawaysThe story in 20 seconds

01The Screaming Frog MCP server, added in SEO Spider 24.0 on 19 May 2026, lets Claude Desktop and LM Studio run crawls, reports and crawl comparisons by chat.

02The Screaming Frog MCP needs a paid SEO Spider licence, which costs £199 a year, about ₹24,790 at the 16 November 2026 rate.

03Screaming Frog’s free version caps crawls at 500 URLs and does not include the MCP server.

04In one public test, Claude reported zero structured data on a site because extraction was switched off in the crawler, so every “missing” finding needs a config check.

Type “crawl my site and rank the five worst problems” into Claude, and Screaming Frog now runs the crawl for you. The Screaming Frog MCP server, built into SEO Spider version 24, lets Claude start crawls, pull reports and compare audits by chat, but only on a paid licence that costs about ₹24,790 a year.

We walked through the setup against Screaming Frog’s own guide, checked every menu path against it on 16 November 2026, and wrote the prompts we’d actually use on an Indian site. Our view: it’s worth paying for if you audit more than one site a month. It is not a junior SEO, and the one detailed public test shows why.

Screaming Frog MCP audit data open on a laptop
The MCP doesn't change what Screaming Frog crawls. It changes who asks the questions.

What does the Screaming Frog MCP server actually do?

The Screaming Frog MCP server connects the SEO Spider desktop crawler to an AI assistant such as Claude Desktop or LM Studio. The assistant can then start a crawl, load an old one, generate any report or bulk export, read a page’s content and compare two crawls, all from plain-language requests in a chat.

It shipped in SEO Spider 24.0 on 19 May 2026. Screaming Frog founder Dan Sharp’s MCP guide, first posted on 17 March 2026, lists 29 tools. Most do one job: sf_crawl starts a crawl, sf_generate_report builds a named report, sf_url_links lists a page’s inlinks or outlinks.

Two groups are switched off by default. Node.js tools let the assistant write and run scripts. Filesystem tools let it read and write files in one folder you choose, and the write tool overwrites files without warning.

29tools listed in Screaming Frog’s MCP guide
500 URLsfree-version crawl cap, and the free version has no MCP
₹24,790one paid licence a year (£199 at ₹124.57 per pound, 16 Nov 2026)

How do you connect Screaming Frog to Claude Desktop?

You need SEO Spider 24 or later, a paid licence, database storage mode and Claude Desktop. Enable Node.js inside SEO Spider, download Screaming Frog’s .mcpb extension file, install it from Claude’s extension settings, then fully restart Claude.

  1. Check storage. In SEO Spider, open File > Settings > Storage Mode and confirm Database Storage is selected. It’s the default on most installs.
  2. Enable the MCP server. Go to File > Settings > MCP Server and accept the Node.js runtime. Set the working folder here too. Leave Node tools off for your first week.
  3. Pick a mode. STDIO runs the crawler headless in the background. Streamable HTTP keeps the SEO Spider window open so you can watch each action. Start with Streamable: seeing the crawl is how you learn what Claude is really doing.
  4. For Streamable, start the server. Click Start MCP Server in the same settings screen. “MCP Server Active” should appear bottom-left. This mode also needs Node.js installed on your machine.
  5. Install the extension. Download the matching file from the guide (spider-mcp.mcpb or spider-streamable-mcp.mcpb). In Claude Desktop, open Settings > Extensions > Advanced Settings > Install Extension and select it.
  6. Restart properly. Quit Claude completely. On Windows, close it from the system tray. Then check Settings > Developer, where the extension should show as running.

Installed in a custom folder? The .mcpb files assume the default install paths (Program Files (x86) on Windows, Applications on macOS). If you moved SEO Spider, edit the file first or Claude won’t find it.

LM Studio users point the app’s mcp.json at the local address the guide gives, http://localhost:11435/mcp, then switch the tool on in chat. The guide says local models must support tool calling and that Claude does better than them on complex jobs.

Which prompts work best for an Indian website audit?

Prompts that name one job, one output file and one priority rule work best. Ask Claude to save large exports to a file rather than paste them into chat, because Screaming Frog’s guide warns that big reports can overflow the context window. One job per chat keeps answers sharper.

These are our prompts, written for common problems on Indian sites. Swap in your own domain.

1. The Monday triage

“Load my latest crawl of example.in. List the 5 issues hitting the most indexable HTML pages. For each, give the count, 3 sample URLs and the fix in one line. Save the full list to monday-triage.csv.”

2. The festive-sale cleanup

“Bulk export all internal links pointing to 404 or 3xx URLs. Group them by the page template they sit on. Flag any URL containing ‘sale’, ‘diwali’ or ‘offer’.” Seasonal landing pages die every November, and the links to them don’t.

3. The button-link check

“Show pages with uncrawlable internal outlinks. Group by link type and tell me which site section has the most.” SEO Spider 24 now flags links built as span or div elements, JavaScript hrefs and onclick handlers. If your “Shop now” buttons were custom-built on a no-code or React theme, this is the check that matters. You must tick Store under Config > Spider > Crawl for this to work.

4. The language-page check

“Export hreflang issues. List Hindi or other regional-language pages that have no return link or point to a non-200 URL.”

5. The before-and-after

“Compare my last two crawls and summarise what changed: pages added or removed, new non-indexable pages and missing titles.” Run this after any theme update. With the November 2026 core update still rolling out, you want site changes logged separately from ranking swings. Our core update tracker explains why.

Team reviewing a Screaming Frog MCP crawl comparison
A crawl comparison is only useful if someone checks it the same week.

Claude reads the crawl fast. It doesn’t know what your crawler was told to skip.

Where does Claude get a Screaming Frog audit wrong?

Claude gets audits wrong when the crawl configuration hid the data it’s reporting on. In the most detailed public test, it said a site had zero structured data because extraction was switched off in the crawler. The schema was on the pages all along. Check config before trusting any “missing” finding.

That test came from Christopher Jan Benitez, an SEO consultant in the Philippines, who ran the MCP on his own site in June 2026. His crawl covered 2,676 URLs in about ten minutes. It surfaced 81 over-long titles that a single Yoast template change fixed, and 18 broken internal links, 17 of them pointing to one dead newsletter page.

The structured-data miss he caught only by checking Google’s Rich Results Test. His conclusion, roughly: the AI is fast hands, and a human still owns verification. Dan Sharp’s guide says much the same, and adds that it doesn’t recommend using AI to replace an experienced SEO.

Pro tip: Before any audit prompt, ask Claude to “list the crawl configuration used for this crawl: rendering, extraction, robots settings and limits”. You’ll spot the blind spots before they become false findings.

Is the Screaming Frog paid licence worth it in India?

The paid licence is worth it if one person audits more than one site of over 500 URLs a month. At ₹24,790 a year, about ₹2,066 a month before any GST, it costs roughly 12 hours of agency time. Single small-site owners can stay on the free version, which has no MCP.

Our maths. Take an in-house SEO executive on ₹8 lakh a year, working 22 days a month at 8 hours. That’s about ₹379 an hour. The licence equals roughly 65 hours of their time a year, or five and a half hours a month. For an agency billing ₹2,000 an hour, it’s about 12 hours a year.

The 500-URL free cap is lower than it sounds. A Shopify store with 300 products, 40 collections and 120 blog posts is already at 460 before tag pages, policy pages and pagination.

Who you areWhat we’d doWhy
Solo owner, site under 500 URLsFree version, no MCPCrawls fit the cap; chat adds little
In-house SEO, one large sitePaid licence, MCP for weekly triageSaves the export-filter-pivot routine
Agency, 5+ client sitesPaid licences (bulk from £189 each), MCP plus scheduled crawlsCrawl comparison by chat pays back fast

One cost sits outside Screaming Frog. The guide warns that Claude Desktop can burn tokens quickly on a free Claude plan, so budget for a paid plan if you’ll use it weekly. It also needs a desktop that stays on: the crawler runs on your machine, not in the cloud.

Who should skip the Screaming Frog MCP for now?

Skip it if you crawl rarely, can’t keep a desktop running during audits, or handle client sites whose contracts restrict sending data to AI tools. Screaming Frog’s guide makes the licensed user responsible for the privacy of data that passes through the MCP server, so read your client agreements first.

India’s DPDP Act makes that last point sharper. Crawl data is mostly public pages, but connected Search Console and GA4 data isn’t. If an audit pulls in form URLs with names or phone numbers in query strings, you’re sending personal data to a third party. Strip those parameters in your crawl config before you connect Claude.

Launchcodex co-founders Tanner Medina and Derick Do list other limits from their own setup: SEO Spider must stay open for the session, and JavaScript rendering and custom extraction settings still need the regular interface. There’s also no list-mode crawling over MCP yet, which Sharp confirmed in a reply under the 24.0 release post.

The strongest case against it: a good SEO already knows which three exports to pull, and the chat layer adds a step where errors can creep in. We’d still use it, but for triage and comparison, not for the final audit you send a client.

Marketer running a weekly SEO crawl check with an AI assistant
A short weekly chat check is easier to keep up than a monthly export marathon.

PingTalks verdict

Buy the licence if you audit more than one site above 500 URLs a month, and use the MCP for weekly triage and before-and-after crawl comparisons. Keep Node tools off until you trust your prompts. Never send a client an MCP-written audit you haven’t spot-checked against the live pages: one wrong setting turns a real site into a “zero schema” report.

If you’re new to crawling, start with our free 60-minute DIY SEO audit, then pair crawl findings with the Search Console features most marketers never use. Broken links from prompt 2 usually point to the problems in our internal linking mistakes guide.

What to do now

  • Check your site’s URL count in a free crawl. Over 500, and the paid licence starts to make sense.
  • Update to SEO Spider 24.3 and confirm database storage under File > Settings > Storage Mode.
  • Install the Streamable HTTP extension first so you can watch what Claude runs.
  • Run prompt 3, the button-link check, on your homepage and top collection pages this week.
  • Strip personal-data query parameters from the crawl before connecting any AI assistant.

Frequently asked questions

Does the Screaming Frog MCP work in the free version?

No. Screaming Frog’s MCP guide says the MCP server is a paid licence feature. The free version still crawls up to 500 URLs but cannot connect to Claude or other AI assistants.

Which AI assistants work with the Screaming Frog MCP?

Screaming Frog documents setup for Claude Desktop and LM Studio. Claude Desktop installs a .mcpb extension, while LM Studio connects to the local server at localhost:11435/mcp. Local models must support tool calling.

Which SEO Spider version do I need for MCP?

You need SEO Spider version 24.0 or later, released on 19 May 2026, with database storage mode switched on. The latest point release in Screaming Frog’s release history is 24.3.

How much does a Screaming Frog licence cost in India?

Screaming Frog charges £199 per licence per year for one to four licences, about ₹24,790 at ₹124.57 per pound on 16 November 2026, before any GST. Bulk pricing starts at £189 each for five to nine licences.

Can Claude replace a technical SEO audit with Screaming Frog MCP?

No. Screaming Frog says it does not recommend using AI to replace an experienced SEO. Claude can misreport issues when the crawl configuration hides data, so findings need checking against live pages.

Is it safe to send client crawl data to Claude?

Screaming Frog makes the licensed user responsible for data privacy when using the MCP server. Check client contracts first and strip personal data such as names or phone numbers in URL parameters from the crawl.

Sources

Kousik BhattacharyaEditor, PingTalks

Digital Evangelist and Entrepreneur at Clickseek Digital. A results-oriented marketing leader with an 18+ year track record driving transformative growth for diverse global businesses. Expert in performance marketing, demand generation, customer acquisition, strategic partnerships, and market expansion within B2B SaaS, Consumer-Tech, Fintech, Travel/Hospitality, and CRM/ITES Solutions sectors. IIM alumnus with a strong analytical background and a string of accolades, including "Top 50 Most Influential E-Commerce Professional of India" and "Top 100 Digital Marketer of India."

More in Technology

See all 18 stories

Two stories a day. Zero noise.

What changed in marketing and AI, why it matters and exactly what to do. In your inbox at 11:00 IST.