AMR automatic collection system (original universal thief program) v4.1

AMR automatic collection system (formerly the Universal Thief Program) is a web application that fully automatically collects websites. It currently supports more than 95% of website collections.
Compared with other thief programs or collection tools on the market, this program has the following characteristics:
1. Easy to install and use: Just enter the URL information of the target site you want to collect, and the content of the target site will be automatically collected; by configuring replacement rules and modifying CSS, you can customize the website layout and content;
2. Support static generation and update static on demand: only pages visited by users (including search engines) will be collected and static will be generated, which will not cause large traffic pressure on the target site; even if the target site is down, this site will still be work normally;
3. Automatically update the static on demand: Set the static update time in the background, and the static will be automatically updated according to the visitor's access status, keeping it consistent with the content of the target site;
4. Supports collection of multiple sub-domain names: If the target site uses multiple second-level domain names, this site can also automatically collect the site content of all second-level domain names to form a site;
5. Optional image collection: If image collection is enabled, all images of the target site can be automatically collected to the server of this site, which is beneficial to search engine optimization (this function may take up a lot of hard disk space, and it is recommended for users with independent servers or VPS);
6. Break through the picture anti-hotlinking function: Turn on the picture collection function, and even if the other party has the picture anti-hotlinking function, you can easily break through;
7. Supports picture collection from different domain names: For example, large sites such as Taobao and Sina use different domain names for pictures and websites; this program can also collect all pictures, and can also break through hot links;
8. Web page content/advertising can be modified at will: through replacement rules, deletion rules, and node rules, you can replace the website title, advertisements, and specified content with the content you want (html code replacement); you can delete unnecessary content;
9. Support regular expression replacement and deletion; support Xpath syntax replacement, deletion, addition or modification of node elements;
10. Supports custom invocation of RSS feeds: the program has built-in Baidu Top Ranking calling rules, which can easily display Baidu Top Rankings anywhere on the web page and form an aggregated search within the site;
11. Support in-site aggregate search: In-site aggregate search can search for content within the site. If the content does not exist on the site, you can customize the search data source to directly collect data from other websites; and supports Chinese word segmentation!
12. You can easily create aggregated search engines, price comparison websites, and shopping search websites: Through the aggregated search function on the site, you can customize N search data sources, and by customizing display templates, you can create aggregated search engines, price comparison websites, and shopping search websites. ;
13. You can use this program to help the enterprise website generate static pages and improve the security of the enterprise website: for general dynamic websites, you can plug in this program to automatically generate static pages, and the static pages can be updated regularly according to the settings;
14. Support proxy server collection to avoid target sites blocking IP addresses;
15. Extraction rules and multi-site collection function: Through this function, multiple target sites can be easily integrated into one website! The purpose of the extraction rules is to extract the content of the Nth party website and fill it into your website, so that it can be seamlessly connected with your current website. You can use your previous website to publish the content yourself and use the AMR system to collect the entire content. website to realize automatic content updating; since the web page content is composed of the content of multiple websites, it is also equivalent to original content.
This is a heavyweight article originality tool;
16. You can set a non-static address: This function is mainly for the search page. If the search page is made static and different keywords are searched, the displayed results will be the same, so the search page must be added to the non-static list.
17. Powerful advertising management function: Built-in advertising extraction rules can currently match commonly used advertising codes. Users only need to replace the advertising codes of corresponding sizes.
18. The error page automatically performs 301 redirection: If you change the target site, the address included in the original search engine will report an error, which can easily lead to the K site; now if you access a page that does not exist, a friendly error page will be prompted. And it will automatically jump to the homepage of the website after 5 seconds (the weight will also be transferred to the homepage), telling the search engine that the original page no longer exists, allowing it to delete the included index, reducing the risk of being K!

Installation instructions

AMR automatic collection system V4.1 requirements: Your server must support asp.net2.0 and must use MSSQL2005 or above database version.
Attached windows.netframework2.0
32-bit download address: http://uwz.cc/10P
64-bit download address: http://uwz.cc/10Q

For specific installation steps, please join the forum for help instructions: http://www.amr-lab.net/showtopic-222.html

Upgrade instructions

First, please back up the database and web.config file, and then do the following:
Please unzip the program package. Except for web.config, install.aspx, Setup2000.sql, and Setup2005.sql, upload all other files to the root directory of the website. Run your URL/upgrade and follow the prompts to import the upgrade script!
Modify the web.config file and delete or comment out this line.
Note: If you have modified the template on your site, please back it up yourself.

Program update list

Features added in version V4.1:
A new automatic translation function is added to make the collected content truly original!
Added system variable embed code to facilitate template customization;

Optimized items:
External link hijacking function: The external link hijacking function is added, which can easily turn external links into internal links and place advertisements. Use it with [AMRweb proxy system: http://uwz.cc/11H] for the best effect! Friends who understand can refer to the go.aspx file and modify it yourself!
Add URL matching to the default node rules;

Bugs fixed:
Aggregate search related word search to remove redundant html code;
The image does not have a mimetype. The problem of judging that the refer does not belong to this site. The problem of changing the background password is incorrect. The problem of automatic update failure when the html is incomplete.

4. Copyright Statement
The AMR acquisition system is developed by the AMR automatic acquisition laboratory amr-lab.net and enjoys independent intellectual property rights.
When you use the AMR automatic collection system, you accept the "AMR Automatic Collection System License Agreement" by default. See http://www.amr-lab.net/showtopic-220.html License Agreement

5. Version differences
The AMR collection system has eight versions: free, trial, basic authorized, lifetime authorized, basic, standard, advanced and supreme. The free version is free to use. The commercial version has more functions and after-sales service. Friends can choose according to their needs.
To view the functions, charges and service differences of each version, see http://www.amr-lab.net/showtopic-223.html for the free version and paid version function list and quotation

6. Contact us
QQ groups: 124867090, 147976428, 4624706 (please contact the group owner for software purchase, usage consultation, customized development, etc.)
Official website: http://www.amr-lab.net
Official Weibo: http://weibo.com/AmrLab

7. Application fields
1. Taobao customer site: By collecting existing Taobao customer sites, or a certain sub-site of Taobao, you can quickly build your own Taobao customer site. You only need to make a jump with a Taobao customer link on the purchase page. ; After that, the content will be updated automatically every day, and the webmaster will just sit back and wait to collect the money!
2. Aggregated search site: You can create a personalized search engine by customizing multi-channel search data sources; and you can embed Baidu Ranking data on designated pages to update website content in real time!
3. Enterprise website content update: The biggest headache for a company website is content update. Generally, they choose to recruit an employee to add articles, which costs a large amount of employment fees every year; the AMR collection system can be seamlessly connected with the existing enterprise website. You can use this system to collect the latest trends in the industry! Since the content is updated in real time, Baidu ranking will rise quickly!
4. Price comparison network: You can easily create a price comparison network by customizing the search interfaces of multiple malls; all you need to do is to design a template and combine the fetched data; don’t forget to apply for an alliance ID. Waiting to receive sales commission!
5. Movie sites, beauty pictures, flash games... as long as they are not sites that require users to log in and register, our system can be easily built, isn't it awesome?