WordPress Indexing: Get Your Posts Indexed Faster
WordPress is the world's most common CMS, and indexing on it has characteristic quirks: its own standard blockers, its own sitemap generator, its own "instant indexing" plugins. This guide walks the full chain: base settings, removing blockers, and the main speed lever — bulk URL submission with real bot visits from AGD Index, which works on top of any WordPress setup without Google Cloud or scripts.
Base WordPress indexing setup
Check the master switch
The most frequent reason a WordPress site stays unindexed: Settings → Reading → "Discourage search engines from indexing this site". The checkbox gets set during development and forgotten. It applies noindex to the entire site — homepage included.
Check right now: view your homepage source and search for <meta name='robots' content='noindex... — if present, uncheck the box and request a recrawl.
Permalinks and URL structure
Settings → Permalinks: choose "Post name" (/post-name/). Default URLs like /?p=123 do get indexed, but they create duplicates and click worse in results. After changing the structure — mandatory 301 redirects from old addresses.
Privacy settings
Make sure the site is not in restricted-visibility mode and there is no hosting password (HTTP basic auth closes the site to bots entirely).
Sitemaps for WordPress
Modern WordPress (5.5+) generates a sitemap.xml out of the box — a basic one, by content type. SEO plugins extend it: Yoast SEO and Rank Math build filtered sitemaps (exclude taxonomies, author archives, tags).
Setup:
- Confirm the sitemap is reachable:
your-site.com/sitemap.xml(Yoast:/sitemap_index.xml, Rank Math:/sitemap_index.xml). - Add it in Search Console → Sitemaps.
- Cut the junk: date archives, empty tag archives, media attachment pages.
Check robots.txt: no Disallow: /sitemap.xml and no rules that override the map.
Content duplicates: what to close from indexing
By default WordPress creates many duplicate URLs for one entity:
- category, tag, author, and date archives;
- feed pages (
/feed/); - attachments (image attachment pages);
- pagination (
/page/2/); - parameterized links (search, sort orders).
What to do:
- close tags (unless curated deliberately), date archives, and feed pages from indexing via the SEO plugin's taxonomy settings;
- pagination canonicals must point to themselves, not to page one;
- internal search and utility URLs — into robots.txt (
Disallow: /?s=).
Fewer duplicates — more crawl budget left for your posts. Blockers in detail: Robots.txt and noindex.
Instant indexing plugins — why they no longer work
WordPress plugins can push URLs through the Google Indexing API right after publishing:
- Rank Math — Instant Indexing (free module): set up a Google Cloud service account from the admin, auto-submit new and updated posts;
- Instant Indexing & Check for Google SEO and similar plugins from the directory.
How they work: post published → an URL_UPDATED request goes to the Indexing API → Google queues the URL for crawling. The problem is that the last step no longer happens for regular posts: the Indexing API is officially allowed only for job postings (JobPosting) and livestreams (BroadcastEvent), and Google ignores requests for everything else. Webmasters widely report the method "stopped working".
The Google Cloud service account setup and the plugin itself accomplish nothing now: posts sent through the Indexing API do not enter the crawl queue. The working alternative for WordPress is bulk bot visits (below).
WP-Cron: the hidden indexing brake
WordPress schedules tasks (including plugin notifications) through WP-Cron — it fires on visitor hits. On a low-traffic site publications "hang": the sitemap updates late, plugins notify late.
The fix — system cron on hosting:
*/5 * * * * wget -q -O - https://your-site.com/wp-cron.php
plus the DISABLE_WP_CRON constant in wp-config.php (an administrator's change; keep the default behavior if unsure).
How to submit WordPress posts for indexing in bulk
Situations that need volume, not one-by-one requests:
- after a domain migration or permalink-structure change;
- programmatic pages: thousands of catalog records created by import;
- e-commerce: mass product page updates;
- content networks: dozens of WordPress sites publishing daily.
Workflow:
- Export a clean URL list (from the database, plugins like Export All URLs, or from the sitemap).
- Run the checklist: 200 OK, no noindex, canonical correct (details in why Google is not indexing pages).
- Send the
.txtlist to the AGD Index Telegram bot — a real Googlebot (or Bingbot) visits every URL: one visit = one URL from the file. No Search Console quotas, no Google Cloud setup. - For recurring submissions connect the API: post published → URL submitted automatically.
Tariffs start at 2,000 visits for 10 USDT; new users get a starter bonus.
FAQ
How do I add a WordPress site to Google?
Create a property in Google Search Console (verify via HTML file or an SEO plugin), enable the sitemap, uncheck "Discourage search engines". Then submit the homepage and key URLs for crawling.
Why are my WordPress posts not indexed?
Top reasons: the "discourage search engines" checkbox; noindex from the SEO plugin for a post type; the site blocked in robots.txt; duplicates eating the crawl budget; thin content. Step-by-step diagnostics: why Google is not indexing pages.
Does WordPress need a sitemap plugin?
Since WordPress 5.5 a basic sitemap ships out of the box. A plugin (Yoast, Rank Math) adds filtering: excluding taxonomies, priority control, multisite scenarios.
Do ping services speed up indexing?
An obsolete mechanic: WordPress notifies RPC services nobody reads. The modern equivalent is bot visits.
Is the Indexing API still worth setting up for WordPress?
No — it no longer works for regular posts: Google officially limits the API to job postings and livestreams and ignores requests for everything else. For regular publishing and volume, the working channel is bot visits: they also cover third-party URLs (backlinks) without any Google Cloud setup.
How do I speed up reindexing after updating a post or product?
Update the modified date in the sitemap (plugins do this), request indexing in GSC, or send the updated URL as a bot visit. For hundreds of updated pages — submit a list via AGD Index.
What to read next
- Blockers and noindex on WordPress: Robots.txt and noindex.
- Other platforms: Wix, Tilda, uCoz, Bitrix indexing guide.
- URL lists ready — bot visit tariffs.
Indexing bot for Google and Bing: pages and backlinks
Built for new websites and bulk backlink lists. We send real Googlebot and Bingbot crawler visits straight to your URLs, so pages get discovered instead of waiting for the next natural crawl.
Open Telegram bot