A tool for scraping files from imageboards’ threads.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
Alexander Andreev 986fdbe7a7 Handling of no arguments passed. 2 months ago
scrapthechan Handling of no arguments passed. 2 months ago
.gitignore Initial commit with all the files. 6 months ago
CHANGELOG.md Updated changelog. 2 months ago
COPYING Initial commit with all the files. 6 months ago
Makefile Version is changed to 0.4.0. 2 months ago
README.md Updated changelog and readme. 2 months ago
setup.cfg Added support for lolifox.cc. Fixed User-Agent usage, so it applied correctly everywhere now. 4 months ago
setup.py Initial commit with all the files. 6 months ago

README.md

This is a tool for scraping files from imageboards' threads.

It extracts the files from a JSON representation of a thread. And then downloads 'em in a specified output directory or if it isn't specified then creates following directory hierarchy in a working directory:

<imageboard name>
|-<board name>
  |-<thread>
    |-[!op.txt]
    |-...
  |-...

Usage

scrapthechan [OPTIONS] (<url> | <imageboard> <board> <thread>)

<url> -- URL of a thread.

<imageboard> <board> <thread> -- imageboard name, board name and thread ID separately. E.g. 4chan b 1100500.

-o, --output-dir -- output directory where all files will be dumped to.

--no-op -- by default OP's post will be saved in a !op.txt file. This flag disables this behaviour. An exclamation mark ! in a name is for so this file will be on the top of a directory listing.

-v, --version prints the version of the program, and -h, --help prints help for a program.

Supported imageboards