If these were previously relevant, it may make sense to forward them

brokenheard320@

Therefore, I have a few approaches for you as to what measures can be taken based on the findings from your log files: Page types: Are page types or page regions that are actually unimportant being crawled? Then you should block them in robots.txt and remove the links there. If the links are necessary, you should make them untrackable for Google using a PRG pattern or “nofollow”. Status codes: Does Google crawl many 404 pages more often.


Does Google crawl certain 301 redirects frequently? If these are still linked internally, you should Special Data correct these links. Static URLs: Are static resources like fonts and scripts crawled very frequently (hundreds of times a day)? Then you should probably configure their Http headers differently . During the relaunch: Will URLs be crawled after the relaunch that were not previously crawled? If so, you should check whether these URLs were created intentionally. If there are many products: Are all products crawled? If some are not crawled, you should look for similarities and better link them internally. When should you use log files? The log files give a very honest picture of the health of the site.




Analyzing the log files is extremely important, especially for very large sites where crawling control is particularly important. For smaller sites and sites where there are still many obvious construction sites, it usually makes more sense to look at the log files at a later step. Then it's worth taking a regular look at it - at least after major changes.How do you actually find suitable content marketing topics? No matter whether you do content marketing for customers or are looking for exciting content for your own website : I'll show you 5 methods that will make your topic search easier.