21 Industry Network has officially changed its name to PhpSou. The program has added a new search function to automatically call Baidu data to imitate Baidu search engine without data. The spider component of the imitation Google search engine software includes three functional modules: link collection, web page analysis, and invalid web page scanning;
Automatically identify web page encodings such as GB2312, BIG5, UTF-8, and Unicode;
File type verification prevents the collection of non-text type files;
Spiders can collect dynamic data web pages such as ASP, PHP, and JSP and static web pages such as HTML, SHTML, and XHTML;
Supports the resume collection function. If the collection is terminated due to system, network, etc. failures, the system will prompt you whether to "continue collection" or "end the task" when starting collection next time;
The collection task management function can set up multiple collection tasks to schedule work, and each collection task will be run in sequence;
This time, we have fixed the error that the bidding ranking cannot be modified, added friendly links in the background, added background batch deletion of untitled pages, background SQL management tools and provided relevant invalid page deletion statements.
Fixed the issue where the URL submitted by the frontend fails when automatic inclusion is set in the backend. At the same time, a new scheduled capture function is added
Expand