awesome python login model Download - awesome python login model Source code download

awesome python login model

Python

1.0.0

Download

`?Life is fantastic?!~`

Master

" Did you know all your doors were locked? " - Riddick (The Chronicles of Riddick)

_{Created by @kris}

portal

4G proxy
Exception handling callback, directly hook all functions, and class? Let's go...

?Website login model

Some crawler sample programs, as well as simulated login programs. The simulated login is based on selenium, and some simulated login is based on js reverse engineering. It is continuously updated. If you have any questions, you can directly submit Issues. You are welcome to submit PR. If you pass the test, you can directly merge. All programs in this article are written using python3 :-)

About

Simulated login basically uses direct login or selenium+webdriver. Some websites are very difficult to log in directly, such as QQ space, bilibili, etc. It is relatively easy if selenium is used.

Although selenium is used when logging in, for efficiency, we can maintain the cookies obtained after logging in, and then call requests or scrapy to collect data, so that the speed of data collection can be guaranteed.

WebDriver

Chrome FireFox

Completed

catalog

Test

Please touch here to view test images

Informations

To thank you for your support, I am going to write a set of free crawler tutorials to ensure that you can crawl most websites on the market after learning it. Tutorial address

tips of pull request

Everyone is welcome to pull request?

Problems

Regarding verification codes: None of the methods used in this project deal with verification codes. The difficulty of identifying complex verification codes is still relatively high at present. In my opinion, the best way to do a crawler is to avoid verification codes as much as possible.
Code invalidation: Due to changes in website strategy or style, the code becomes invalid. Please submit an issue to me. If you have solved it, you can submit a PR. Thank you!
Part of the code is being optimized. . .
If this repo is helpful to everyone, remember to star it.