Speaking of this topic, you may want to ask, why do we need to maintain these spider robots? Can’t I just update the content of my website every day? I don’t care if these spider robots come or not? If your website It's okay if you make it for yourself to watch alone, but our website is not made for you to enjoy at home, but for you to analyze your joy with everyone. So we have to treat these spider robots as distinguished guests and take good care of them. Now let’s talk about how to raise them.
1. Analyze the activities of Baidu and Google spider robots
The simplest way is to look at the server's IIS log, but that is only for people who have their own servers, or is provided on a few space provider websites, and cannot be seen by most websites. So how do you see this precious information? I recommend a source code to everyone: Luzhu CMS. The background of this website source code can clearly record the traces of major search robots. It has the time of each robot's visit, the pages visited, and the detailed data of the visit is analyzed and conducted 24 hours a day. Segment analysis, analysis of each channel, and analysis of the sections of content you have added. It analyzes which channels and sections of your website the major search robots like, and also gives you suggestions for remedying other channels and sections.
Let me give you an example of the detailed activity methods of Baidu and Google. Of course, the methods of each website are different. Now I will give you an example of my website Luzhu website. Baidu's spider robot likes to crawl the homepage of the website the most, and it will crawl once every five minutes. It can also be understood that Baidu uses the homepage of the website as the entry point, and then it discovers that there are differences between the homepage this time and the last time. link, they will immediately crawl to the new link page. Google is different. It will not crawl your homepage so frequently. It has a map for each website. They will continue to crawl every link on your website. Of course, they will not crawl if they have records. From this, it is not difficult to see that Baidu will quickly discover the new content of your website, but Google will not quickly discover your new content. I remember once, after adding a piece of content to my website, I immediately checked the spider crawler records in the background. Baidu crawled through it. I went to Baidu to download the site and it was included. Of course, this content is a soft article written by myself, which is an article that Baidu considers to be original, so it is included very quickly.
2. Don’t revise the website frequently or make few changes
Why do you say this? Baidu and Google will record some information about your website into their databases. The pages crawled this time will be compared and analyzed with the pages crawled last time. Once there is a big difference, they will consider it to be the same For a new website, spider crawling will be suspended for a period of time, which means that your website will immediately enter an observation period. During this period, they will not come often, which means that Baidu and Google will not include you during this period. Your page's authority may also be demoted. I remember that I changed the template of my website once in May. The two templates were very different. It used to be that some pages were included more or less every day. After I changed it, they stopped me for about a week and the included pages were not included. The quantity has also been reduced a lot. This is a comprehensive change on the website. I remember another time this month. I added more than 90 external links in three days, which is a small change on the website. Baidu and Google still did not suspend spiders at the beginning. It crawled until a week later, when I checked the number of included pages, and suddenly there were hundreds of pages missing. The number of IP addresses downloaded from Baidu and Google has also decreased compared with the original number.
3. Website update content should be as original or pseudo-original as possible.
Everyone knows that Baidu and Google like original articles, so if an old guest comes to your home, you must know his favorite dishes and tea. We know that Baidu and Google love this, why don’t we make good use of this. If you often read Sina and some big famous websites, you will find that sometimes they are not necessarily original articles, but in order to satisfy the taste of search spiders, they will also process the articles to some extent, which is pseudo-original. Then again, there is a huge amount of information updated every day on the Internet, so there are so many original works. Just like us, there are good people and bad people. Famous websites are engaging in pseudo-original processing. As small and medium-sized webmasters, why don’t we do this? Baidu and Google's robots are not gods, they are programs written by humans, and they execute them. It is impossible to conduct a complete analysis of every current article under the program. They can only compare whether it is the same and whether it is original. Sometimes there will be many bugs. When we add content to our website, why not add a lot of pseudo-original content to increase the inclusion of our website.
4. Timeliness of website update content
As mentioned before, Baidu and Google will crawl your website several times a day, and we must take advantage of this. Therefore, our own website should also update the content in a timely manner so that they can gain something when they come, and they will come more frequently, so that your inclusion will be more. As mentioned earlier, you can create fake articles when updating website content. If you are not good at creating fake articles, you just need to be diligent. When an article appears on a website, you can update it to your website in a timely manner. Then Baidu and Google may not have included it at the time, and they may mistakenly regard the content on your website as original. If you regularly update the content of your website in a timely manner, even if it is someone else's original work, Baidu and Google will include every page of yours.
To sum up, if our website wants to be included in a large amount by Baidu and Google every day, we must have a deep understanding of the activity time and method of their spiders on your website, do not change the layout, and add some original articles in a timely manner.
The above are some of my own opinions, which are relatively superficial. You are welcome to correct me and communicate with me http://www.luzhuba.cn.