WeChat_Article

WeChat_Article

Crawl WeChat public account articles

Bilibili video demonstration: https://www.bilibili.com/video/BV1vN411D7Y3/

Note, unless you want to resume downloading from a breakpoint, delete conf.ini and url.json in the directory and start again! ! ! !

How to use:

1. Download and unzip Chrome.rar ;
2. Download and unzip default.zip;
3. Put the decompressed Chrome into the decompressed default;
4. Enter the default directory and run main.exe ;
5. Fill in the information and click " Start ".
6. If you want to modify the UI, you can install this: Qt Designer

---

Background knowledge:

When writing articles using an official account, you can search for articles from other official accounts to achieve the purpose of crawling all articles from a specified official account.

---

Program principle:

Log in through selenium to obtain tokens and cookies, and then automatically crawl and download them.

• Prerequisites for use:
  1. Apply for a free WeChat public account and a personal subscription account (https://mp.weixin.qq.com)

---

Update record:

1. Download article text content to txt
2. Download article image
3. Save the HTML file and point the image link locally
4. Add download by time range
5. Add cookie to log in. If unsuccessful, log in with Selenium browser.
6. Added remember password function
7. Fix some problems, such as requests stuck
8. Add download by keyword
9. Multi-threading optimizes download speed
10. Added breakpoint resume function (may contain bugs, recommended not to use)
11. Plan to add backup public account function (not yet completed)
12. Download in PDF format
13. There is no need to download Chrome manually, it will be downloaded automatically when it is started.

---

Instructions for use:

Create a virtual environment

conda create -n wechat python=3.9 -y

Enter virtual environment

conda activate wechat

Install third-party libraries

pip install -r requirements.txt

For mac users, an error may be reported when installing pyqt5. You can try:

brew install pyqt@5
cp -r   /opt/homebrew/Cellar/pyqt@5/5.15.7_2/lib/python3.9/site-packages/ *   /Users/songxf/miniconda3/envs/wechat/lib/python3.9/site-packages/   

Then you can import:

import PyQt5

run script

python main.py

Package exe (generated under dist)

pyinstaller -F -w -i icon.ico main.py

Other notes:

• If the crawling interval is too fast, it is easy to encounter " frequent access " or " freq_control ". At this time, you can delete cookie.json , re-run the software, and continue running with a different account ;
• Qt is too big after packaging. Will anyone convert it to Tkinter?

Welcome to follow the WeChat public account: xfxuezhang

---

reward

If this project helps you, welcome to buy me a drink??