Meta Robots Tag

A meta robots tag is an HTML instruction that tells search engine crawlers how a page should be handled, such as whether it may be indexed or followed. A noindex instruction can be useful for certain pages that should not appear in search results. The tag is different from robots.txt, which governs crawler access rather than directly expressing page-level indexing preferences. For an indexing directive to be observed, the crawler generally needs access to the page. A service business should not rely on meta robots tags to protect private customer details or restricted files; access controls are needed for that.