How to submit sitemap and robots for your site?
Howdy viewers, do you want to learn getting more traffic with topic “How to submit sitemap and robots for your site?” Do you want the search engine’s to index your site? Yes, I am sure you are and these two concepts are the key important role in the Search Engine Optimization (SEO) and improving SEO is your prime target to achieve the highest possible rank in the search results. You must first understand the working principle of the Search Engine before diving into the article. Please note, submitting sitemap.xml does not guarantee to index your site in the respective search engine webmaster’s but it is a good idea to submit it. It may take some time to index your webpages, don’t worry it will index.
Before diving into the title “How to submit sitemap and robots for your site?”, you must know how does Search Engine work?
How does Search Engine work?
Developer (s) of popular Search Engine has came up with an idea to index and monitor the web pages automatically and so they wrote an Algorithm called Search Algorithm that will do the job on following the three main factors in the ranking.
- Crawler: It is an intelligence system process that processes the fetching of all web pages that is linking to a website and the spider or crawler is a software that is responsible for all the fetching process. Google calls the spider as GoogleBot and Bing calls it Bingbot.
- Indexing: It is a process that creates the index of all fetching web pages that stores in a system database. When a user searches for a word or a keyword in the search engine, it matches the keyword with the fetched web pages in the database and outputs the same in the search results.
- Processing: When a user searches for a keyword, the processing takes the responsibility to match the input string with the database and outputs the results in the search results.
What is a sitemap.xml? -How to submit sitemap and robots for your site?
A sitemap is an XML which contains the list of all web pages of the website in an organized hierarchical fashion that is accessible to the Crawler or user. It is a relationship between web pages and other components available and has the ability to demonstrate navigation, organization, and the labeling system. Google introduced the sitemap protocol (Wikipedia) and is jointly used by the Bing and Yahoo search engines.
How to generate and submit a sitemap.XML file?
Well, generating and submitting the sitemap.xml is super duper easy. You can generate the sitemap online, visit https://www.xml-sitemaps.com/ , enter your website URL, leave the other fields as defaults and click start > wait till the sitemap.xml is processed > download to your computer > upload it to the root directory of the hosting server. If you are using WordPress CMS then you need to download a plugin called Yoast SEO > install and activate it > SEO > XML sitemap > Under General tab click the sitemap XML link.
Before submitting the sitemap and robots you must have to prove your website ownership to the search engine Webmaster. You must have a Gmail account for Google and any email accounts to sign up with Bing and Yahoo. Bing and Yahoo share the common Webmaster.
How to submit the sitemap.xml in Webmasters?
To submit sitemap in Google you must visit the link https://www.google.com/webmasters/ > Search Console > sign in with your Gmail account > Click on your Website > Click on Crawl > Sitemap > Click Add/ Test Sitemap.
To submit sitemap in Bing or Yahoo you must visit the link https://www.bing.com/toolbox/webmaster > Sign in with your valid email id and password (provided during sign up, you will be asked to submit the sitemap.xml during the signup process but you can skip for later submission) > Click on your website > Submit A Sitemap > Submit.
What is a robots.txt? -How to submit sitemap and robots for your site?
It is a plain text file where you write codes to instruct the search engine robots (eg. Googlebot or Bingbot) about the crawling process and index pages for the website or some part of web page. For example, if you have a sensitive web page with images on the myfolder and you don’t want to index then you should instruct the robots.txt file not to index on the search engines with instruction codes. By default, it will permit to index all the web pages, images and other files in associated with the website.
To create a robots.txt, open your notepad (on Windows) or textedit (on Mac) > Write: User-agent: * (next line) Disallow: /myfolder/ > Save the files as robots.txt.
How to submit the robots.txt?
After you create your robots.txt file, go to the root directory of the hosting server > click on the website name (eg. howipro.com) and upload it here. If you don’t know about the root directory then go to your hosting Cpanel > find your domain directory (in my case howipro.com) > upload robots.txt here.
Conclusion- How to submit sitemap and robots for your site?
As a result of the submission of Sitemap.xml and Robots.txt, it is the key responsible for the indexing of your website. These are the two concepts can give you the highest possible rank in the Search Engine search results thus giving you the maximum number of traffic to your site which is very useful for your business and website.