Introduction to robots.txt   What is robots.txt? This was a question I didn’t even know to ask when I built my first website. Like most beginners stepping into…