Robots.txt

« Back to Glossary Index

A file used to keep web pages from being indexed or to tell which pages you want a search engine to index.