Robots.txt Generator tool
Robot text files help crawling bots identify your crawlable directories across your website. Here you can choose what gets crawled and indexed and what does not. It is adviced that every website contains a robots.txt to help indexing of content by search engines like Google, Bing, CrawlThis and many others.
Tip: Always ping your newly created sitemap with Ping Services like Pingmyblog.info & Kunius.com