Low crawling rate and incomplete inclusion by search engine spiders are problems for many websites, especially for large websites and new websites. In many forums and websites, I saw people asking how to solve this problem. Many of my SEO clients also asked After asking me this question, I will give you some answers below. Of course, I know Google well personally, so the answers are mainly for Google. Of course, the same rules also apply to SEO optimization of other search engines, including Baidu, Yahoo, etc. .
First of all, Google’s inclusion rate is difficult to calculate for large websites. The number of inclusions may not be the true number due to various reasons, so the inclusion rate we obtained is not accurate for large websites. The webmaster tool provided by Google It may be better, and the information included in it is more credible. However, if your site is really too large, it is really impossible to accurately determine how much it will include. Of course, if you insist on calculating the inclusion rate of the website, for large websites, it is better to randomly select dozens of interfaces, manually check whether each interface is included, and roughly get the inclusion rate through the method of probability. Of course, this is not Probably absolutely accurate.
Spider crawling and inclusion cannot be accurately controlled, but we can use some positive factors to influence it and try to make it better included. The following is a detailed analysis:
1. The importance of domain names. Google's MATT CUTTS recently admitted in an interview that the website's inclusion rate, spider crawling depth and PR are roughly proportional to each other. In other words, the higher the PR, the better your site will definitely be included.
2. Backlinks, PR is based on backlinks, so of course it will become the main reason that affects inclusion. If the content of a site increases rapidly, but the links increase slowly, search engines will think that your site is spammy.
3. Deep links. Deep links are reverse links pointing to content pages. These links will give your internal pages a very good SEO optimization effect. Pages with deep links will be ranked and included very well.
4. Navigation bar and clear hierarchy. For websites, a flat structure is the most reasonable, allowing search engines to easily identify your content and make it easier to include. At the same time, there must be clear navigation so that the most important pages can be viewed no matter where they are. It can be entered within 4 clicks, preferably within 2 clicks, so that search engines will better identify and crawl important pages.
5.xml site map, this is something that must be done. The map of the web page will definitely help your website improve the speed of inclusion and inclusion. There is no doubt that it.
6. Reduce similar content. When building a website, be sure to create as much original content as possible. Search engines can identify similar content very well based on fuzzy matching, so they will not give it high weight. You can look at information theory to have a deeper understanding of how similar web pages are distributed. Regarding the rules of weight, currently search engines such as Baidu basically use information theory as the core of calculations in this area.
7. Unique title. If there are already many articles with the same title, the search engine will consider whether it is necessary to include it, so the title should be as unique as possible.
8. Manually set the update frequency. Manually set the website update frequency when submitting the site map, and try to allow search engines to update the site as quickly as possible.
9. Update, reply, and ping commands, and frequently update and maintain internal pages and homepages, in detail, not as a whole. This will greatly improve the crawler efficiency, and more replies can also improve your first trip. Rate, RSS should be fully utilized, because it can be understood as an automatically generated website map. It is recommended to submit RSS to search engines.
10. Social networks. Although links to social networks like those on campus may use the nofollow tag, Google also has calculation methods for these social networking sites. Adding more content to your website on social networking sites will also improve your web page. Acceptance rate.
This article comes from Dalian SEO: http://www.seo-dalian.com/?p=381
Be sure to keep the link, search for copyright, and investigate any plagiarism.
Thanks to Dalian SEO for your contribution