Most of us are familiar with bots or crawlers. They are search engine programs which are responsible for crawling and indexing of our website.
Crawlers visit sites and read their pages to index them and provide them to users in search results. they also notify the search engines about updates done on a page.
But, do you know that we can control our pages from crawling and indexing through robots meta tags.
Robots meta tag is a simple line of code which instructs crawlers on how a particular page should be crawled and indexed.
<meta name=“robots” content=“[DIRECTIVES]”>
It will be placed within the head section (<head> ….. </ head>) of your website and page. Therefore, it is also known as Robots Header tags
Difference Between Robots.txt and Robots Meta tag
Robots.txt is a file that contains a few lines of code and is stored in the root directory of a site. It directs crawlers which pages of a site are allowed to crawl & index and which aren’t.
While Robots Meta tags instruct crawlers how to crawl and index specific pages. Through Robots Meta tags you can manage the crawling and indexing of your pages.
Must Read:- How to Add Custom Robots.txt file in blogger
How to Set Up Custom Robots Header Tags on blogger?
In this article, we will look at the process of setting up Custom Robots Header tags in Blogger blogs.
Blogger offers an easy and intuitive way for setting up Custom Robots Header tags in your blog.
In Blogger, you don’t need to manually insert them into your pages, because they are pre-integrated in Blogger as an important SEO setting.
But before going through the entire process, we will know about different directives and their purpose, from which we will deal with in the setting.
Directives and their Purpose
all:- Tells the crawlers that there is no restriction for crawling and indexing pages.
noindex:- Tells the crawler not to show specific pages in the search results.
nofollow:- Instructs the crawler not to follow any link on a page.
none:- Equivalent to both noindex and nofollow directives.
noarchive:- Restricts search engines from showing the cached version of pages in their search results.
nosnippet:- Restricts search engines from showing a text snippet and video preview of a page in the search results.
notranslate:- Restricts search engines from suggesting the translation of the page in their search results.
noimageindex:- Instructs the crawler not to index any image on the page.
unavailable_after:- Instructs the search engines for not showing the page in their search results after a specified date/time. The date/time should be in the RFC 850 format (e.g, Saturday, 27-April-19 15:52:01 UTC ).
Steps to Set up Custom Robots Header tags on Blogger
So, now we will look at the process of setting up custom robot header tags on Blogger. Below are some steps which you have to follow to complete this process on your blogger blog.
Step 1: Go to Blogger.com and sign in into your blog’s dashboard.
Step 2: From your dashboard go to setting >> search preferences. there you will see ” Custom robots header tags” setting under in Crawlers and indexing section. By default the setting is disabled, you will need to enable it by clicking Edit option to the right side of setting.
Step 3: After that, it will ask you to enable the custom robots header tags. Click on “Yes” to enable it.
Step 4: Now, you will see a set of checkboxes. You may find it complicated, but believe me, it’s not. You can easily set them on your own after reading about the “directives and their purpose” (Which I mentioned above). Or, you can also follow the same settings that I have chosen, just look at the image below for the optimal setting.
Step 5: After doing all this, just hit Save changes.
Congrats!! You have all done
- How to Add a Logo in Blogger Blog
- How to Write SEO friendly Blog Posts
- 10 Strategies to Generate Blog Post Ideas
- 10 Proven Ways to Make Money from Blogging
Custom robot header tags are really helpful in SEO, not because I am saying this but Google offers a pre-integrated setting in Blogger to make it easy for you to use them.
Aside from it, be sure to tick the right checkbox, Because even a single wrong tick (like, on noindex checkbox) can disappear your website from search engine result pages (SERPs)
If you are having any issues regarding this topic, please let us know in the comments section below.