Why Google indexes blocked websites
Google’s John Mueller answered a question about why Google indexes pages that robots.txt says should not be crawled and why the associated Search Console reports on these crawls can be safely ignored. Bot traffic to query parameter URLs The person who asked the question documented that bots have been linking to non-existent query parameter URLs […]