Locking down members-only pages should not mean vanishing from Google. Restrict for WordPress includes a bots and web crawlers whitelisting feature that lets you restrict content without hurting SEO: search engines can still crawl and index your protected pages, while human visitors keep seeing exactly the restrictions you have set. Here is how the feature works and how to enable it.
The problem: restricted content and search rankings
While Restrict is awesome for restricting content to users, restricting access for SEO bots and web crawlers is something that may cost you quite a bit. The content of your website is what drives your search results — if crawlers cannot read a page, it cannot rank for the queries that content would normally attract.
So if all of your best material sits behind a login or membership wall and bots are blocked along with everyone else, your website will inevitably be positioned lower in the search results than you want. That means less organic traffic, and fewer visitors who might have become paying members.
The solution: whitelist SEO bots and web crawlers
Restrict offers a neat feature for bypassing the content restriction for non-human visitors.
To enable it:
- Navigate to the Bots & Web Crawlers area of Restrict.
- Flick the switch to Yes.
That is all — all the restricted content on your website will now be visible to SEO bots and web crawlers, while remaining locked for regular visitors who do not meet your criteria.
What the whitelisting covers
The bypass applies to every kind of restriction Restrict enforces:
- Page and post content restricted with page/post restrictions
- Widgets and menu items
- Content partially protected with Restrict’s shortcodes
- Even whole-site protection via Site Shield, which restricts the entire website to logged-in users
What your visitors will (and will not) notice
Enabling this feature does not affect content restriction for users in any way. Every restriction criterion you have set — logged-in status, roles, capabilities, customer status — is still fully enforced for human visitors. The whole user experience on your website remains unchanged; the only noticeable difference will be in the search results related to your website.
Tips: restrict content without hurting SEO
- Make the restriction message a landing page. Visitors arriving from Google will land on the restricted page and see your restriction message instead of the indexed content. Turn that message into a mini sales page with a clear sign-up path — you can even design it visually with Elementor styled templates.
- Offer an easy way in. Place a login form on a dedicated page (or right in the message flow) so returning members can unlock the content in one step.
- Keep a public teaser. With partial restriction shortcodes you can leave an introduction visible to everyone and lock only the premium part — giving both visitors and search engines useful context on the page.
- You are in good company. Showing full content to crawlers while gating it for readers is the same well-established pattern large publishers use for paywalled articles that still appear in search.
Frequently asked questions
Do I have to enable this feature?
No — it is entirely optional. If you would rather keep your restricted content out of search results altogether (for example, private internal documentation), simply leave the switch off. Enable it when the restricted content is something you actively want people to discover through search, such as premium articles, courses or member resources.
Will someone clicking a search result see the restricted content?
No. Search engines index the content, but when a human visitor clicks through, Restrict evaluates them like any other visitor. If they do not meet your criteria, they see your restriction message — which is exactly why that message deserves a clear call to action.