Skip to content

Complete guidePlatforms and CMS indexing · 14 chapters

How to get your website indexed on every platform

Getting a website indexed takes the same five things on every platform: a sitemap, a verified Google Search Console property, a Bing Webmaster Tools site, robots.txt and noindex settings that don't block the pages you want, and IndexNow where the platform allows it. What changes from WordPress to Shopify to Next.js is where each control lives.

The story · 3 steps
Check my pages freeFree plan: 10 free links to try (once you verify your email), then 100 free checks a month, no card.

In this series

The guide, chapter by chapter

  1. Shopify sitemap and indexing: what Google sees in your store

    How Shopify builds its sitemap, how to edit robots.txt.liquid, hide pages with seo.hidden, and which Search Console statuses are normal to see.Read chapter 1
  2. Wix sitemap, robots.txt and IndexNow: getting a Wix site indexed

    Where Wix puts your sitemap, connecting Search Console and Bing, Wix's built-in IndexNow on Premium, robots.txt, noindex and common gotchas.Read chapter 2
  3. WordPress indexing: get your site into Google and Bing

    Get a WordPress site indexed: core vs plugin sitemaps, Search Console and Bing setup, IndexNow options and the settings that noindex your site.Read chapter 3
  4. Google Search Console for Shopify: verify your store and submit the sitemap

    Verify a Shopify store in Search Console with the theme.liquid tag or a DNS record, submit sitemap.xml, and read a healthy store's statuses.Read chapter 4
  5. IndexNow on WordPress: every way to send it, compared

    Every way to send IndexNow from WordPress: Microsoft's plugin, Rank Math, Yoast, AIOSEO, SEOPress and Cloudflare, and how to test the pings.Read chapter 5
  6. Lovable SEO: getting a Lovable site indexed by Google and Bing

    How Google sees Lovable's two stacks, why the sitemap isn't always there, what its Search Console connector can't do, and the 302 redirect issue.Read chapter 6
  7. Next.js sitemap, robots.txt and indexing: avoid the stale sitemap

    Build a Next.js sitemap with app/sitemap.ts that doesn't go stale, write robots.ts and noindex, verify Search Console and send IndexNow on deploy.Read chapter 7
  8. React SEO: getting a client-rendered React app indexed

    Why client-rendered React apps index slowly, what a Vite build serves, prerendering vs SSR, soft 404s, sitemaps and testing with URL Inspection.Read chapter 8
  9. Squarespace sitemap and indexing: what you can and can't control

    Where Squarespace puts your sitemap, why robots.txt can't be edited, how Hide page from search results works, plus Search Console and Bing setup.Read chapter 9
  10. Webflow sitemap and indexing: settings that decide what Google sees

    Turn on Webflow's auto sitemap, use the Sitemap indexing toggle, keep webflow.io staging out of Google, and connect Search Console and Bing.Read chapter 10
  11. Wix Search Console verification: connect your site to Google

    Verify a Wix site in Search Console with the SEO Setup Checklist, the meta tag or a DNS record, then submit the sitemap and fix common errors.Read chapter 11
  12. WordPress robots.txt: what it outputs and how to edit it safely

    How WordPress builds robots.txt, how to edit it in Yoast, Rank Math or AIOSEO, safe rules for AI crawlers, what Cloudflare adds, and how to test it.Read chapter 12
  13. WordPress sitemap: find it, fix it and submit it

    Find your WordPress sitemap: core /wp-sitemap.xml or the Yoast, Rank Math, AIOSEO and SEOPress URLs, why it can 404, and how to submit it to Google.Read chapter 13
On this page · 11 sections
  1. 01How do website platforms compare for indexing?
  2. 02What does every platform need before Google can index a page?
  3. 03Where does each platform put its sitemap, and do you still need to submit it?
  4. 04How do you connect Google Search Console on each platform?
  5. 05How do you add your site to Bing Webmaster Tools?
  6. 06Should you use robots.txt or noindex to keep a page out of Google?
  7. 07Which platforms support IndexNow?
  8. 08Why can't FreshlyCited send IndexNow for Wix, Shopify, Squarespace or Webflow sites?
  9. 09What's the verify and push checklist for any platform?
  10. 10What nobody can promise, and what you can control
  11. 11Where FreshlyCited fits

A page has to be indexed (in the search engine's index, the library it answers from) before it can show in Google results or in the AI Overviews built on them. This hub compares eight platforms in one table, explains each requirement with links to the platform guides, sets out where IndexNow works, and ends with a checklist.

How do website platforms compare for indexing?

Website platforms differ in four indexing controls: where the sitemap lives, whether you can edit robots.txt, how you noindex a single page, and whether IndexNow is built in. The table sums up each platform guide, with every row re-checked against the platform's own documentation on October 17, 2026.

Platform indexing controls, as of October 2026

Platform

Sitemap URL

robots.txt editable?

Per-page noindex control

IndexNow

Top gotcha

Guide

WordPress

/wp-sitemap.xml (core, 5.5+); SEO plugins replace it, e.g. /sitemap_index.xml

Yes: SEO plugin or a physical file in the site root

SEO plugin setting (core only has the site-wide "Discourage search engines" box)

Plugin or Cloudflare: Microsoft's IndexNow plugin, Rank Math and SEOPress are free

"Discourage search engines" noindexes every page and switches core sitemaps off

Getting WordPress indexed

Shopify

/sitemap.xml, an index with one per domain

Yes, through a robots.txt.liquid theme template

Noindex tag in theme.liquid, the seo.hidden metafield, or Unlisted status for products

App (Bing links the InstaIndex app); nothing native documented

Private mode keeps Google out of the sitemap and blocks verification

Shopify sitemap and indexing guide

Wix

/sitemap.xml, an index of per-type sitemaps

Yes, in the Robots.txt Editor

"Let search engines index this page" toggle

Native, Premium plans only

Search Console connection needs Premium and a connected domain

Wix sitemap, robots.txt and IndexNow

Squarespace

/sitemap.xml (none for trial sites or parking pages)

No

"Hide page from search results" toggle (not on the homepage)

None

The homepage has two URLs, so Search Console flags a harmless canonical alternate

Squarespace indexing guide

Webflow

/sitemap.xml once Auto-generate sitemap is on

Yes, in Site settings → SEO → Indexing

"Sitemap indexing" toggle in Page settings → SEO settings

None

The webflow.io staging copy can be indexed unless Staging indexing is off

Webflow sitemap and staging settings

Next.js

/sitemap.xml from app/sitemap.ts

Yes: app/robots.ts or app/robots.txt

robots in each route's metadata

None built in; you host the key file in public/

sitemap.ts is cached by default, so new pages can miss it until the next deploy

Next.js sitemap and robots.txt

React (client-rendered, e.g. Vite)

None until you add public/sitemap.xml

Yes: public/robots.txt

noindex meta tag (Google may skip rendering once it sees one)

None built in; you host the key file in public/

Every path returns 200 with an empty HTML shell, so missing pages become soft 404s

React SEO for client-rendered apps

Lovable

"Not always" created; check /sitemap.xml

Yes, a file in your project

Tags in your project; Lovable's SEO review flags a site-wide noindex

Not documented

Extra domains redirect to the primary one with a 302

Lovable SEO and indexing

Sources: WordPress sitemaps, Yoast noindex, IndexNow plugin; Shopify sitemap, robots.txt, hiding pages; Wix sitemap, robots.txt, noindex, IndexNow; Squarespace sitemap, hiding pages; Webflow sitemap, indexing; Next.js sitemap, robots; Vite; Google JavaScript SEO; Lovable SEO, domains; Bing IndexNow.

What the live sitemaps returned on October 17, 2026

We requested one public sitemap per hosted platform, plus nextjs.org, at 15:24 UTC on October 17, 2026:

Shell
for u in https://make.wordpress.org/core/wp-sitemap.xml \
         https://www.deathwishcoffee.com/sitemap.xml \
         https://www.yorisbakery.com/sitemap.xml \
         https://www.squarespace.com/sitemap.xml \
         https://university.webflow.com/sitemap.xml \
         https://nextjs.org/sitemap.xml; do
  code=$(curl -s -L -A "Mozilla/5.0" -o body.xml -w "%{http_code}" "$u")
  echo "$code $(grep -o -m1 '<sitemapindex\|<urlset' body.xml | head -1) $(grep -o '<loc>' body.xml | wc -l | tr -d ' ') $u"
done
Text
200 <sitemapindex 16 https://make.wordpress.org/core/wp-sitemap.xml
200 <sitemapindex 7 https://www.deathwishcoffee.com/sitemap.xml
200 <sitemapindex 3 https://www.yorisbakery.com/sitemap.xml
200 <urlset 6350 https://www.squarespace.com/sitemap.xml
200 <urlset 1316 https://university.webflow.com/sitemap.xml
200 <urlset 1142 https://nextjs.org/sitemap.xml

The WordPress, Shopify (Death Wish Coffee) and Wix (Yori's Bakery) sites served a sitemap index, so their third number counts child sitemaps, not pages. Squarespace, Webflow University and nextjs.org served one list of URLs. Either way, submit the top-level address.

What does every platform need before Google can index a page?

Every platform needs the same groundwork before Google can index a page: a sitemap Google can read, a verified Search Console property, crawl rules that let Googlebot in, no stray noindex, and a page worth keeping. Hosted builders do much of this for you. Google's own guidance says "In most cases, the platform submits your new content to search engines automatically" and tells you to "Check your platform's support articles" (Google Search Central).

Automatic isn't fast: the same page says "Crawling can take anywhere from a few days to a few weeks." Our Google indexing guide explains each stage, and why indexing is also the gate for Google's AI Overviews.

Where does each platform put its sitemap, and do you still need to submit it?

Each platform generates its sitemap at a fixed address, shown in the table, but generating a sitemap isn't telling Google about it. Wix submits it when you connect Search Console through its SEO Setup Checklist; everywhere else, add it in Search Console's Sitemaps report and in Bing Webmaster Tools yourself.

Three platform details catch people out:

  • WordPress moves its sitemap when you install an SEO plugin. Yoast SEO and Rank Math use /sitemap_index.xml, All in One SEO /sitemap.xml and SEOPress /sitemaps.xml. Our WordPress sitemap guide shows what each one returned and why /wp-sitemap.xml can 404.
  • Frameworks only publish what you write. Next.js builds the sitemap from app/sitemap.ts; a client-rendered React app needs a file in public/; Lovable says it creates robots.txt with every project "but not always a sitemap."
  • A sitemap is a hint, not a request. Google says "There is no guarantee that a page URL discovered in a sitemap has been or will be crawled or indexed by Google" (Sitemaps report help).

If you submitted an old address after changing plugins or platforms, Search Console will report that the sitemap could not be read. Submit the new URL and remove the old one.

How do you connect Google Search Console on each platform?

You connect Search Console by verifying a property, either a URL-prefix property with an HTML meta tag or a Domain property with a DNS record. Google says DNS "is the only way to verify a Domain property" (Search Console Help). Each platform supports a different mix, as of October 2026:

Platform

Built-in route

Watch for

WordPress

Site Kit by Google, which Google says "can handle verification for you"

Google suggests a second method in case "someone changes a template on your website that omits the tag"

Shopify

Paste Google's HTML tag below <head> in theme.liquid

Shopify says "you need to deactivate private mode" first

Wix

SEO Setup Checklist, or the Site Verification tool

"you must have a Premium plan and a domain connected to your site"

Squarespace

Analytics → Search keywords → Connect

"We don't support the verification method that requires you to import a .txt file"

Webflow

Site settings → SEO → Google site verification field

Publish the site after saving

Next.js

verification: { google: '...' } in the root layout's metadata

Google looks for the tag in the <head> of your "non-logged-in home page"

Lovable

Lovable's Search Console connector

Meta tag only; it can't request indexing

Sources: Shopify, Wix, Squarespace, Webflow, Next.js, Lovable.

Step-by-step guides cover Search Console setup for Shopify and Wix Search Console verification. Once verified, the URL Inspection tool shows Google's view of one page, and the Page indexing report explains why each known URL is or isn't indexed.

How do you add your site to Bing Webmaster Tools?

The quickest route on any platform is to import the site from Search Console after you've verified it there. Bing says imported sites "will be added and get automatically verified in Bing Webmaster Tools," and that "any new sitemap found on your Search Console account will also be imported automatically" (Bing Webmaster Tools help).

Microsoft says "freshness signals directly influence how quickly updates are reflected in search results and AI generated answers" (Bing Webmaster Blog), so keep Bing's copy of your sitemap current too. Our Bing Webmaster Tools guide covers setup and reports, submitting URLs in Bing Webmaster Tools covers manual submission for platforms without IndexNow, and why a site isn't indexed by Bing covers what to check when Bing ignores you.

Should you use robots.txt or noindex to keep a page out of Google?

Use noindex to keep a page out of Google, and robots.txt only to stop crawling. Google says robots.txt "is not a mechanism for keeping a web page out of Google" (Google Search Central), and that "For the noindex rule to be effective, the page or resource must not be blocked by a robots.txt file" (Google Search Central). Block a page and noindex it, and Google never sees the noindex.

Webflow's help center gives the same advice in platform terms: "To ensure that a previously indexed page is not indexed, don't add it in the robots.txt. Instead, use the Sitemap indexing toggle" (Webflow Help Center).

Each mix-up has its own Search Console status:

Our WordPress robots.txt guide walks through the rules line by line, and the crawling-versus-indexing point applies to any platform. If you've just switched off a noindex or fixed a rule, check which of your pages Google has indexed before you change anything else.

Which platforms support IndexNow?

IndexNow (an open "this page changed" notice that Bing and other participating engines accept; Google doesn't use it) is built into Wix, added by plugin or app on WordPress and Shopify, and missing from Squarespace and Webflow. Frameworks such as Next.js can send it with a few lines of code. As of October 2026:

  • Wix: "IndexNow with Wix is only available for sites with a Premium plan," with nothing to set up (Wix Help Center).
  • WordPress: Microsoft's IndexNow plugin (version 1.0.4, 100,000+ active installs) generates and hosts the key for you and "automatically respects noindex directives" (wordpress.org). Our WordPress IndexNow guide compares it with Rank Math, SEOPress, Yoast SEO, All in One SEO and Cloudflare.
  • Shopify: Bing's IndexNow page shows a Shopify card whose link goes to the InstaIndex app in the Shopify App Store (Bing IndexNow). Shopify itself documents no IndexNow feature.
  • Squarespace and Webflow: a search of each help center for "IndexNow" on October 17, 2026 returned no article about it.
  • Next.js, React and Lovable: nothing built in. You host a key file and POST changed URLs; IndexNow accepts "up to 10,000 URLs per post" (IndexNow documentation).

Run one sender per site. The IndexNow FAQ says "Avoid submitting the same URL many times a day unless there are meaningful content changes" (IndexNow FAQ). Our IndexNow explainer covers keys and response codes, and whether IndexNow works with Google explains why it doesn't.

Why can't FreshlyCited send IndexNow for Wix, Shopify, Squarespace or Webflow sites?

FreshlyCited's IndexNow sending needs the IndexNow key file on your own host, and those four platforms don't give you a supported way to put one there. The protocol requires the key file "at the root directory of your website" or in another location on the same host, and a key file's folder limits which URLs it can cover (IndexNow documentation). FreshlyCited checks for that file before it sends anything.

Platform

Can you serve a key file on your domain?

Bing notices on that platform

WordPress

Yes; IndexNow plugins serve it for you

A plugin, or FreshlyCited once the site is verified

Next.js, React

Yes, from public/

Your own script, or FreshlyCited once the site is verified

Lovable

Not documented; ask Lovable to add the file, then open its URL to confirm

The same, once the file is live

Wix

No: for root-level .txt files, "it's currently not possible to add this kind of file to your Wix site"

Wix's own IndexNow (Premium)

Shopify

No documented way to place a file at the domain root

An IndexNow app

Squarespace

No: uploaded file URLs are assigned by Squarespace's CDN and "can't be changed"

Bing sitemap and manual URL submission

Webflow

No documented way; Webflow documents root-level settings only for robots.txt, sitemap.xml and llms.txt

Bing sitemap and manual URL submission

Sources: Wix, Squarespace, Webflow.

On those four platforms, leave Bing to Wix's built-in IndexNow or an app, and use FreshlyCited for the Google side, which is its main job: finding the pages Google hasn't indexed and asking Google to look. Our IndexNow setup docs explain key verification where you can host the file.

What's the verify and push checklist for any platform?

This checklist works on every platform in the table: confirm the live files, the page itself and both consoles, then re-check the pages that matter. Run it after a launch, a migration, a theme or plugin change, or a batch of new pages.

  1. Open /robots.txt in a private window. Nothing you want indexed should be disallowed, and the Sitemap: line should point at your live sitemap.
  2. Open the sitemap and find the new page. It should use your primary domain, not a webflow.io, .squarespace.com or lovable.app address.
  3. View the page source. Look for noindex in a robots meta tag and for a canonical tag that points somewhere else.
  4. Check the site-wide switch. WordPress "Discourage search engines", Wix "Let search engines index your site" (SEO & GEO → SEO Settings), Squarespace "Block Search engine crawlers" (Settings → Crawlers), Shopify private mode, Webflow staging indexing.
  5. Confirm the sitemap in both consoles. Search Console's Sitemaps report should show Success; in Bing Webmaster Tools, submit it or confirm the import.
  6. Inspect your most important URLs. Run a live test in URL Inspection and request indexing for a handful of key pages; our guide to ways to submit a URL to Google compares the options.
  7. Check Bing's side. Where IndexNow runs, Bing's IndexNow report should show the submissions; elsewhere, submit key URLs by hand.
  8. Re-check in a few days. Google says you can "filter the Page indexing report by sitemap to see how many page URLs in this sitemap have been indexed" (Sitemaps report help). Pages left as crawled, currently not indexed need better content, not another push; pages left as discovered, currently not indexed are still waiting for a crawl.

If your whole site is missing rather than a few pages, start with why a website isn't showing up on Google.

What nobody can promise, and what you can control

Nobody can promise that Google will index a page, or when. Google decides what to keep on every platform, Bing makes its own call on every IndexNow notice, and AI answers pick their own sources from what's indexed. Being indexed is the first step; being cited still depends on quality, authority and relevance.

What you control is the list above: a sitemap on the right domain, verified consoles, no accidental noindex or block, one IndexNow sender, and pages worth keeping.

Where FreshlyCited fits

FreshlyCited does steps 6 and 8 at scale, for Google. It checks each URL against Google's index ("Seen by Google" or "Invisible") with a visibility check, pushes only the invisible ones to Google, and re-checks them on days 1, 3 and 7. Only pages in Google's index can be considered for its AI Overviews, which is why the Google side comes first. Index credits are reserved when you submit and used only if the link is indexed; if it's still not indexed after the day-7 re-check, the credit comes back automatically. Pages with a noindex tag, a robots.txt block, a redirect or a canonical pointing elsewhere aren't covered; the pre-flight check flags them so you can skip them free.

It works on every platform in the table, because it only needs a public URL. For sites where you can host an IndexNow key file, such as WordPress, Next.js or React, pushes also go to Bing through IndexNow ("Sent to Bing") at no extra cost, with a per-site off switch. Agencies running client sites across several of these platforms can see how workspaces and reports fit on FreshlyCited for agencies.

Whichever platform your pages live on, check them against Google free: 10 free links to try, then 100 free checks a month, no card needed.

Rakesh Patel

Written by

Founder & CEO, Space-O Technologies · Founder, TextBolt

Rakesh Patel founded Space-O Technologies in 2010 and leads it as CEO, with 25 years of leadership experience; he has overseen the delivery of more than 3,000 mobile app projects. He is also the founder of TextBolt, a business email-to-SMS service, and the author of "Enterprise Mobility Strategy and Solutions" and "A Guide to Open311". Space-O built FreshlyCited to solve the "shipped but not seen" problem on its own and its clients' sites: pages and links that are live but that Google hasn't looked at yet.

Founded Space-O Technologies in 2010 · 25 years of leadership experience · author of 'Enterprise Mobility Strategy and Solutions' and 'A Guide to Open311'

Written for FreshlyCited, which helps Google and Bing find new and updated pages sooner. About FreshlyCited

FAQ

Questions people ask

Do hosted website builders submit my pages to Google automatically?

Partly. They publish a sitemap for you, and Google says platforms often submit new content automatically, but you still connect Search Console yourself and Google still decides what it indexes. Wix is the exception that submits the sitemap when you connect through its SEO Setup Checklist.

Which platform is best for getting indexed?

None has an indexing advantage on its own. What matters is a readable sitemap on the right domain, crawl rules that let Googlebot in, no stray noindex, and pages worth keeping; the platforms only differ in where those controls live.

Can I use IndexNow on a platform that does not support it?

Only if you can serve a key file on your own domain. Frameworks such as Next.js can; Squarespace and Webflow offer no supported way, so there you rely on sitemaps and Bing Webmaster Tools.

Check my pages free.

See which of your pages Google has indexed, free.