Google Is a completely automatic search engine that works by using applications identified as crawlers to explore the internet constantly, seeking pages to include to our index. You usually need not do anything apart from publish your website online. Robots.txt: Just like a stoplight, a robots.txt file supplies internet search https://g.co/kgs/LCBPtAe