Many webmasters, including myself, want to know how spiders from major search engines visit their websites, and then formulate corresponding countermeasures to increase website traffic.
But I couldn't find a suitable tool on the Internet, so I opened this tool. I hope this tool can help your website.
Introduction to spider crawling trace recording tool:
1. You can freely add, modify and delete major search spiders in the background
2. Check the detailed information of the spider crawling (last visit time, IP address, visited address)
3. Count the number of visits to the website by major search crawlers by (day, week, month, year)
4. Record in detail the traces of spider visits, spider name, last visit time, IP address, visited address
5. Statistics of the total number of visits to each spider
6. Use caching technology to cache the added spiders to achieve faster speeds
Installation notes:
If this program is running on a non-windows platform, please set the data folder permissions to: 777
After the installation is completed to enter the background, please click: Generate cache
Please delete the install folder immediately after the installation is completed
The database is encoded in UTF-8
When establishing a MYSQL database, please select utf8_general_ci encoding
Program installation path: http://your website address/install
Backend path: http://your website address/AdminLogin.php
Expand
