.Google.com restricts robots.txt assistance to four areas, clarifying its position on in need of support directives.Google just supports four particular robots.txt industries.Unsupported regulations in robots.txt will certainly be actually overlooked.Think about bookkeeping your robots.txt files taking into account this improve.