Have you at any time desired to avoid Google from indexing a distinct URL on your web website and exhibiting it in their research motor success pages (SERPs)? If you control internet web sites lengthy sufficient, a day will very likely appear when you require to know how to do this.
The three techniques most generally utilised to prevent the indexing of a URL by Google are as follows:
Utilizing the rel=”nofollow” attribute on all anchor factors made use of to hyperlink to the site to avert the links from currently being adopted by the crawler.
Making google reverse index of a disallow directive in the site’s robots.txt file to prevent the website page from remaining crawled and indexed.
Making use of the meta robots tag with the articles=”noindex” attribute to stop the web site from becoming indexed.
While the dissimilarities in the a few methods seem to be delicate at to start with look, the usefulness can differ greatly relying on which technique you decide on.
Applying rel=”nofollow” to prevent Google indexing
Many inexperienced webmasters attempt to avoid Google from indexing a distinct URL by applying the rel=”nofollow” attribute on HTML anchor factors. They add the attribute to each individual anchor component on their web-site utilised to url to that URL.
Which include a rel=”nofollow” attribute on a url prevents Google’s crawler from next the connection which, in switch, helps prevent them from discovering, crawling, and indexing the target website page. When this method may well work as a short-expression answer, it is not a viable long-time period remedy.
The flaw with this technique is that it assumes all inbound one-way links to the URL will include things like a rel=”nofollow” attribute. The webmaster, having said that, has no way to prevent other internet web sites from linking to the URL with a followed website link. So the odds that the URL will sooner or later get crawled and indexed employing this process is pretty high.
Employing robots.txt to prevent Google indexing
One more popular process applied to avoid the indexing of a URL by Google is to use the robots.txt file. A disallow directive can be extra to the robots.txt file for the URL in query. Google’s crawler will honor the directive which will stop the page from staying crawled and indexed. In some scenarios, on the other hand, the URL can nonetheless show up in the SERPs.
Often Google will exhibit a URL in their SERPs however they have never ever indexed the contents of that web site. If adequate world-wide-web websites url to the URL then Google can normally infer the subject matter of the site from the backlink textual content of all those inbound hyperlinks. As a outcome they will clearly show the URL in the SERPs for related lookups. While applying a disallow directive in the robots.txt file will reduce Google from crawling and indexing a URL, it does not assure that the URL will under no circumstances surface in the SERPs.
Making use of the meta robots tag to avoid Google indexing
If you have to have to prevent Google from indexing a URL whilst also avoiding that URL from staying shown in the SERPs then the most efficient strategy is to use a meta robots tag with a content=”noindex” attribute in the head component of the net web site. Of training course, for Google to basically see this meta robots tag they need to initial be ready to uncover and crawl the page, so do not block the URL with robots.txt. When Google crawls the webpage and discovers the meta robots noindex tag, they will flag the URL so that it will never be demonstrated in the SERPs. This is the most helpful way to prevent Google from indexing a URL and displaying it in their research effects.