Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST
requests and responses, as well as most other HTTP
-level data.
hoardy-web-sas
?hoardy-web-sas
is a very simple archiving server for the Hoardy-Web
Web Extension browser add-on (also on GitHub).
I.e. this is the thing you run and then paste the URL of into the Server URL
setting of the Hoardy-Web
add-on.
This is not the most feature-rich thing for doing that, hoardy-web serve
(also on GitHub) is much more powerful. But, hoardy-web serve
is not at all simple and it depends on quite a lot of things. Meanwhile, this hoardy-web-sas
thing is less than 300 lines of pure Python that only uses the Python's standard library and nothing else. You could be running it already.
hoardy-web-sas
exists?This was made for easy Quickstart (also there) that also does reliable archiving.
Install Python 3
:
python3
via your package manager. Realistically, it probably is installed already.On a Windows system with unconfigured PATH
, install with:
and run as
On a conventional POSIX system or on a Windows system with configured PATH
environment variable, install it with:
and run as
Alternatively, run without installing:
Alternatively, on a system with Nix package manager
Though, in this case, you’ll probably want to do the first command from the parent directory, to install everything all at once.
usage: hoardy-web-sas [-h] [--version] [--host HOST] [--port PORT] [-t ROOT] [--compress | --no-compress] [--default-bucket NAME] [--ignore-buckets] [--no-print]
A simple archiving server for the `Hoardy-Web` Web Extension browser add-on: listen on given `--host` and `--port` via `HTTP`, dump each `POST`ed `WRR` dump to `<--archive-to>/<bucket>/<year>/<month>/<day>/<epoch>_<number>.wrr`.
options:
-h, --help show this help message and exit
--version show program's version number and exit
--host HOST listen on what host/IP; default: `127.0.0.1`
--port PORT listen on what port; default: `3210`
-t ROOT, --to ROOT, --archive-to ROOT, --root ROOT
path to dump data into; default: `pwebarc-dump`
--compress compress new archivals before dumping them to disk; default
--no-compress, --uncompressed
dump new archivals to disk without compression
--default-bucket NAME, --default-profile NAME
default bucket to use when no `profile` query parameter is supplied by the extension; default: `default`
--ignore-buckets, --ignore-profiles
ignore `profile` query parameter supplied by the extension and use the value of `--default-bucket` instead
--no-print, --no-print-cbors
don't print parsed representations of newly archived CBORs to stdout even if `cbor2` module is available