PySipder crawler program v0.3.10

PySipder is a Python crawler program.

PySipder Features

Use Python to write scripts and provide a powerful API

Python 2&3

Powerful WebUI and script editor, task monitoring and project management and result viewing

Support JavaScript pages

Backend system support: MySQL, MongoDB, SQLite, Postgresql

Supports task priority, retries, regular crawling, etc.

Distributed architecture