Website spider crawling monitoring plug-in v2.0 20180403

Big release! The crawling record plug-in has been upgraded to 2.0 with full functionality and is available for free. 2.0 comprehensively rewrites the data structure, rewrites the UI interface, adopts a fast paging framework for tens of millions of record sets, adds custom BOT type records, URL rewrites pseudo-static recording methods, manages login permissions, and many other intelligent management options.

The program has 3 files in total

botdb.mdb database file, botconn.asp crawl record call file, botlog.asp crawl log view file.

Normally, place 3 files in the root directory of your website. Then add it to the bottom of the source code of the page you want to monitor crawling on your ASP website to monitor the spider crawling situation of the page.

The monitoring program must be in the same directory as the page you are monitoring. Or people who know the program can change the program path by themselves.

If you want to monitor the whole site page, you can usually add it at the bottom of conn.asp in the root directory of your website system. If there is no conn.asp, it means that the file your website calls the database is not conn.asp. Please consult the system developer of your main site system to ask which file the database calls.

Then access it through your URL such as: http://www.xxx.com/botlog.asp to view the spider crawling log.