Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, mirroring, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST requests and responses, as well as most other HTTP-level data.
hoardy-web-sas
?hoardy-web-sas
is a very simple archiving server for the Hoardy-Web
browser extension (also there).
I.e. this is the thing you run and then paste the URL of into Server URL
setting in Hoardy-Web
.
This thing is less than 200 lines of pure Python that only uses the Python's standard library and nothing else. You could be running it already.
hoardy-web-sas
exists?This was made for easy Quickstart (also there) that also does reliable archiving.
On a conventional POSIX system or on a Windows system with configured PATH
environment variable, install it with:
and run as
Alternatively, on a Windows system with unconfigured PATH
, install with:
and run as
Alternatively, run without installing:
Alternatively, on a system with Nix package manager
Though, in this case, you’ll probably want to do the first command from the parent directory, to install everything all at once.
usage: hoardy_web_sas.py [-h] [--version] [--host HOST] [--port PORT] [--root ROOT] [--uncompressed] [--default-profile NAME] [--ignore-profiles] [--no-print-cbors]
Simple archiving server for Hoardy-Web. Dumps each request to `<ROOT>/<profile>/<year>/<month>/<day>/<epoch>_<number>.wrr`.
optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--host HOST listen on what host/IP (default: 127.0.0.1)
--port PORT listen on what port (default: 3210)
--root ROOT path to dump data into (default: pwebarc-dump)
--uncompressed dump new archivals to disk without compression; the default is to try to compress each new archive first
--default-profile NAME
default profile to use when no `profile` query parameter is supplied by the extension (default: `default`)
--ignore-profiles ignore `profile` query parameter supplied by the extension and use the value of `--default-profile` instead
--no-print-cbors don't print parsed representations of newly archived CBORs to stdout even if `cbor2` module is available