New: see if ChatGPT, Perplexity and Claude can read your pages. Scan your site free →
Indexidia
Free site scan

See what keeps your site out of Google and AI answers

Enter your domain. We check your pages live, test every AI crawler, and write the fixes.

FreeNo accountAbout 20 seconds
Title too longSlow image: 2.4 sThin contentSite health62
A scan line reads the page from top to bottom and pins each problem exactly where it sits, then gives the site a health score.
indexidia.com/check
Site scan: goldencrust.example30 pages checked live
AI search
AI Reach
84
of 100
AI crawlers allowed
8/9
GPTBot blocked
Google
Site Health
72%
6 pages with errors
Estimated with problems
212
across the site
✕
Mostly template text · 6 of 30 pages

Little unique text, so Google often skips them.

!
Title too long · 9 of 30 pages

Cut off in Google results. Fixes ready.

What you get

Pages across your whole site

A sample from every page type in your sitemap, checked live.

Template text found

Pages that repeat your other pages, the top reason for "Crawled, not indexed".

AI crawler access

robots.txt and firewall tested for ChatGPT, Perplexity, Claude and Bing.

Fixes written for you

robots.txt, llms.txt, schema, titles and descriptions.

Real measurements

Status, load time, words and unique words for every page.

Scores you can check

Every score shows exactly how it was made.

What a site scan checks

A search engine or AI assistant can only show a page it can reach, read and trust. The Indexidia site scan checks those three things on your real pages, live, the same way a crawler would.

Instead of looking at your homepage only, the scan reads every sitemap file on your site and picks pages from each kind: products, posts, locations, profiles and so on. Problems usually live in one page type, so a sample from every type finds them much faster.

  • HTTP status and redirects for each page
  • Load time, word count and unique words
  • Titles, meta descriptions, headings and canonical tags
  • noindex tags and robots.txt rules
  • Text repeated from your template across many pages
  • Structured data (schema) on each page
  • Access for AI crawlers such as GPTBot, OAI-SearchBot, PerplexityBot and ClaudeBot

Why pages get left out

Most pages that never show up in search have one of a few causes: they are blocked, they are slow or broken, or they look too much like other pages on the same site. Search engines then treat them as low value and skip them. In Google Search Console this often appears as "Crawled - currently not indexed".

AI search adds a second layer. Tools like ChatGPT search and Perplexity use their own crawlers. If your robots.txt or firewall blocks them, your pages cannot be quoted, however good they are.

How the health score is made

Every page gets a level: fine, warning or error. The site health score weighs pages with errors three times more than pages with warnings, so one broken template counts more than a few long titles. The report shows exactly which pages made the score, so you can check it yourself.

Key terms

Indexing
When a search engine stores a page so it can appear in results. A page can be crawled and still not be indexed.
Crawl
A visit by a search engine or AI bot that downloads your page.
Template text
Words repeated on many pages, such as menus and footers. When most of a page is template text, search engines see little unique value.
Canonical tag
A tag that tells search engines which address is the main version of a page.

Every page type, not just your homepage

The scan reads every sitemap file and picks pages from each kind: products, posts, locations, profiles.

  • Pages from every part of your site
  • Live measurements, not old data
  • Shareable report link

Fixes, not just findings

Each scan writes the files your site needs. Copy them, download them, or let Auto-fix apply them.

  • Corrected robots.txt
  • llms.txt from your own pages
  • Shorter titles and new descriptions

How it works

1Enter your domain

No account needed.

2We check it live

Pages, crawlers and content, in about 20 seconds.

3Get your report and fixes

Ranked problems and ready-made fixes.

Site scan: questions

Is the scan really free?

Yes. Up to 5 scans an hour without an account. Create a free account to check every page automatically.

Why only 30 pages?

The free scan samples pages from every part of your site. With an account, Indexidia checks all of them every day.

How long does a scan take?

About 20 seconds for most sites. You can leave the page and come back to the link.

Does it change my site?

No. It only reads your public pages, like a search engine does.

Which search engines does it cover?

Google and Bing, plus AI search: ChatGPT, Perplexity, Claude, Gemini and Copilot.

Will the scan slow down my site?

No. It reads a small sample of pages, one at a time, like a polite crawler.

Related tools

See what keeps your site out of Google and AI answers