Before the site goes live, remove the two crawl-blocking measures added during development:
Delete docs/robots.txt (or replace its contents with User-agent: *\nAllow: /)
Remove the noindex meta tag from overrides/main.html in the extrahead block:
After deploying, verify by fetching https://docs.aptrust.org/robots.txt and checking that the noindex tag is gone from the page source. Google Search Console's URL Inspection tool can confirm the page is indexable.
Before the site goes live, remove the two crawl-blocking measures added during development:
Delete docs/robots.txt (or replace its contents with User-agent: *\nAllow: /)
Remove the noindex meta tag from overrides/main.html in the extrahead block:
After deploying, verify by fetching https://docs.aptrust.org/robots.txt and checking that the noindex tag is gone from the page source. Google Search Console's URL Inspection tool can confirm the page is indexable.