As soon as crawling People recently observed URLs, they evaluate Every single URL's HTTP reaction code. If your URL returns 404, bots never add the specified URL to their index and also clear away that URL from their index if it absolutely was already indexed earlier. To check your internet s