Sitemap
Everything we publish, in one place.
121 pages in 23 sections: guides on AI search and Google indexing, features, comparisons, and the API and MCP docs. Search engines get the same list as XML sitemaps.
08Main pages
06AI crawlers
- AI crawlers: who runs each bot, what it collects and how to control it
- ChatGPT-User: what it means when ChatGPT visits your page
- ClaudeBot: Anthropic's training crawler, explained
- GPTBot: what OpenAI's training crawler does and how to control it
- How to check your robots.txt for AI crawlers
- OAI-SearchBot: how OpenAI's search crawler affects your place in ChatGPT search
15AI search optimization (AEO, GEO & AI Overviews)
- AI search optimization: how to get cited in AI answers
- AI visibility tracking: how to measure citations in AI answers
- Bing IndexNow and AI answers: what it reaches and what it doesn't
- ChatGPT SEO: how to rank and get cited in ChatGPT search
- Claude SEO: how Claude finds, reads and cites web pages
- Content freshness: why AI search leans toward what's current (and crawled)
- Generative engine optimization (GEO): a practical guide
- GEO vs AEO vs SEO: what's the difference, and what to do first
- How to get recommended by ChatGPT, Claude and AI agents
- How to rank in Google AI Overviews (and AI Mode)
- LLM SEO: how to optimize content for LLMs
- llms.txt explained: format, examples and whether it helps
- Perplexity SEO: how Perplexity finds and cites your pages
- What is AEO? Answer engine optimization explained
- Where does ChatGPT get its information? How AI search chooses sources
04Backlink indexing
04Bing Webmaster Tools
18Google indexing & pages not indexed
- Google indexing: how it works and how to get pages indexed faster
- 'Crawled - currently not indexed': what it means and how to fix it
- 'Discovered - currently not indexed': why Google hasn't crawled your page
- "Blocked by robots.txt" in Search Console: what it means and how to fix it
- "Blocked due to other 4xx issue": what it means and how to fix it
- "Indexed, though blocked by robots.txt": what it means and what to do
- "Sitemap could not be read" and "Couldn't fetch": causes and fixes
- Alternate page with proper canonical tag: is it a problem?
- Duplicate without user-selected canonical: what it means and how to fix it
- Duplicate, Google chose different canonical than user: why and how to fix it
- Excluded by 'noindex' tag: find where noindex comes from and remove it
- Google Indexing API: what it's for, quotas and setup
- Google Search Console URL Inspection tool: a complete guide
- How to get Google to crawl your site and recrawl updated pages
- How to submit a URL to Google: 5 ways, from one page to thousands
- Search Console page indexing report: every status explained
- Soft 404 in Google Search Console: what it means and how to fix it
- Why is my website not showing up on Google? Causes and fixes
03Index checking
03IndexNow
14Platforms and CMS indexing
- How to get your website indexed on every platform
- Shopify sitemap and indexing: what Google sees in your store
- Wix sitemap, robots.txt and IndexNow: getting a Wix site indexed
- WordPress indexing: get your site into Google and Bing
- Google Search Console for Shopify: verify your store and submit the sitemap
- IndexNow on WordPress: every way to send it, compared
- Lovable SEO: getting a Lovable site indexed by Google and Bing
- Next.js sitemap, robots.txt and indexing: avoid the stale sitemap
- React SEO: getting a client-rendered React app indexed
- Squarespace sitemap and indexing: what you can and can't control
- Webflow sitemap and indexing: settings that decide what Google sees
- Wix Search Console verification: connect your site to Google
- WordPress robots.txt: what it outputs and how to edit it safely
- WordPress sitemap: find it, fix it and submit it
02SEO client reporting
02SEO for SaaS
06Tool listings
- Best AEO and GEO tools: answer and generative engine optimization software
- Best AI visibility tools for tracking AI Overviews, ChatGPT and Perplexity
- Best indexing tools: Google indexers and backlink indexing services compared
- Google Search Console MCP servers: tools, auth and the indexing gap
- SEO MCP servers: what each one does and how to connect it
- WordPress indexing plugins compared: IndexNow, Bing and Google options
03Works with
05Features
- Client reports: white-label indexing reports your clients can open
- Drip-feed: push links gradually, on your schedule
- FreshlyCited API and MCP server: pushes and index checks from your own tools
- Smart push: ask Google to crawl your fresh pages and new links
- Visibility check: see which pages and links Google has seen
03Use cases
05Comparisons
- FreshlyCited vs IndexLinks: two indexing tools with MCP, compared
- FreshlyCited vs IndexMeNow: how the two indexing services compare
- FreshlyCited vs Microsoft's IndexNow plugin for WordPress
- FreshlyCited vs Rank Math Instant Indexing: what each one actually sends
- FreshlyCited vs SpeedyIndex: tokens, credits and index checks compared
02Docs · Get started
07Docs · Connect a client
03Docs · Concepts
02Docs · Reference
04Docs · Recipes
01Docs · AGENTS.md
01Authors
Found what you were looking for?
Check which of your own pages Google has indexed. It takes ten seconds and no sign-up.
Check my pages free