21 Industry Network V8.0 version has a new background full site editing function, corrected system backup function, imitating Baidu search engine, imitating Google search engine software spider component including three major functional modules: link collection, web page analysis, and invalid web page scanning;
Automatically identify web page encodings such as GB2312, BIG5, UTF-8, and Unicode;
File type verification prevents the collection of non-text type files;
Spiders can collect dynamic data web pages such as ASP, PHP, and JSP and static web pages such as HTML, SHTML, and XHTML;
Supports the resume collection function. If the collection is terminated due to system, network, etc. failures, the system will prompt you whether to "continue collection" or "end the task" when starting collection next time;
The collection task management function can set up multiple collection tasks to schedule work, and each collection task will be run in sequence;
Expand