Kemono scraper

Kemono-scraper

A simple downloader to download images from kemono.su

Flag option

Cookie file

only needed if you want to download favorite creators or posts

--cookie PATH cookie file, default is cookies.txt (value separate by whitespace) syntax:

Domain	Include subdomains	Path	Secure	Expiry	Name	Value
.kemono.su	FALSE	/	TRUE	1706755572	kemono_auth

you can get cookies easily by using Chrome extension Get cookies.txt LOCALLY

Windows

Windows can detect the cookie file automatically (Not supported in no_cookies_detection version)

--cookie-browser string which browser to use, default is chrome (supported: chrome, firefox, edge , opera, vivaldi)

Download Options

--link []: download link, separate by comma

--creator [:]: download creators, separate by comma

--banner bool: download banner, default is false (kemono only)

--fav-site string: specify the website to get favorites from (kemono or coomer), separated by comma

--fav-creator bool: download favorite creator, default is false

--fav-post bool download favorite post, default is false

Post Filter Options

--first int: download first n post

--last int: download last n post

--date YYYYMMDD: download post on date

--date-before YYYYMMDD: download post before date

--date-after YYYYMMDD: download post after date

--update YYYYMMDD: download post updated on date

--update-before YYYYMMDD: download post updated before date

--update-after YYYYMMDD: download post updated after date

Image Filter Options

--extension-only []: download post with extension, separate by comma

--extension-exclude []: download post without extension, separate by comma

--max-size string: download post with size less than max-size (e.g. 1 MB, 1KB, 1.5 gb, etc.)

--min-size string: download post with size greater than min-size (e.g. 1 MB, 1KB, 1.5 gb, etc.)

Downloader options

--output PATH: output path

--template : The template for customizing download paths, where you can use the following keywords to specify different parts of the path:

• : creator service
• : creator name
• : post title
• : file index
• : file name
• : file hash
• : file extension

For example:

[] //-

--image-template The template for customizing image file, --template should be set first.

--video-template The template for customizing video file, --template should be set first.

--audio-template The template for customizing audio file, --template should be set first.

--archive-template The template for customizing archive file, --template should be set first.

--content bool: download content, default is false

--overwrite bool: overwrite existing file

--async bool: download posts asynchronously, may cause the file order is not the same as the post order, can be used with --with-prefix-number, default false

--max-download-parallel int: max download file concurrent, default is 3, async mode only

--with-prefix-number bool: add prefix number to file name _, default false

--name-rule-only-index bool: only use index as file name, default false

--download-timeout int: download timeout in seconds, default 1800

--retry int: retry times, default 3

--retry-interval number: retry interval in seconds, default 10. The number can be specified as either an int or float type

--rate-limit int: rate limit in request/s, default 2

--proxy string: proxy url, default is empty, support socks5, http, https (e.g. socks5://proxy:1080)

Config File

config file is in ./config.yaml

Options in config file are the same as command-line flag options, but will be overridden by flags (if both exists). Usually used for setting the default settings for the scraper.

banner: true
async: true
max-download-parallel: 5
output: ./downloads
template: "[] //"
image-template: "[] //"
video-template: "[] //video/"
retry: 10
retry-interval: 15
# proxy: socks5://proxy:1080

Build from Source

Cloning the repository:

git clone https://github.com/elvis972602/Kemono-scraper
cd Kemono-scraper/main

Download all the dependencies:

go mod tidy

Build the project:

go build

• No cookies detection:

go build -tags=no_cookies_detection

Features

With Kemono-scraper, you can implement a Downloader to take advantage of features such as multi-connection downloading, resume broken downloads, and more.