software/hoardy-web/./extension/README.amo.html

Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST requests and responses, as well as most other HTTP-level data.

Files

Raw Source

Contents

<code>Hoardy-Web</code> passively captures and collects dumps of <code>HTTP</code> requests and responses as you browse the web, and then archives them using one or more of the following methods:

<ul>
<li>by saving them into your browser’s local storage, which is the default;</li>
<li>by submitting them to your own private archiving server via <code>HTTP</code>, like
<ul>
<li>the advanced archival+replay server <a href="https://oxij.org/software/hoardy-web/tree/master/tool/"><code>hoardy-web serve</code></a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/tool/">GitHub</a>) or</li>
<li>the simple archiving-only server <a href="https://oxij.org/software/hoardy-web/tree/master/simple_server/"><code>hoardy-web-sas</code></a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/simple_server/">GitHub</a>);</li>
</ul>
</li>
<li>by generating fake-Downloads containing bundles of those dumps, making your browser simply save them to your <code>Downloads</code> directory.</li>
</ul>

<code>Hoardy-Web</code> produces dumps in a very simple, yet efficient, <a href="https://oxij.org/software/hoardy-web/tree/master/doc/data-on-disk.md"><code>WRR</code> file format</a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/doc/data-on-disk.md">GitHub</a>).

Moreover, <code>Hoardy-Web</code> implements:

<ul>
<li>UI indicators that help in ensuring good and complete website captures,</li>
<li>optional post-capture machinery that helps in archiving only select subsets of captured data;</li>
<li>archival+replay integration when used in combination with an <a href="https://oxij.org/software/hoardy-web/tree/master/tool/">advanced archiving+replay server like <code>hoardy-web serve</code></a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/tool/">GitHub</a>);</li>
<li>capture of <code>DOM</code> snapshots;</li>
<li>inspection of captured <code>HTTP</code> traffic, similar to browser’s own <code>Network Monitor</code> (except browser-wise, i.e., it can capture <code>HTTP</code> requests even when a page generates them when its tab/window closes; which a surprising number of websites does to prevent their web traffic from being inspected with <code>Network Monitor</code>);</li>
<li>some generally useful web browsing features (like per-tab <code>Work offline</code> mode).</li>
</ul>

In other words, this extension implements an in-browser half of your own personal private passive <a href="https://web.archive.org/">Wayback Machine</a> that archives everything you see, including <code>HTTP POST</code> requests and responses (e.g. answer pages of web search engines), as well as most other <code>HTTP</code>-level data (<code>AJAX</code>, <code>JSON RPC</code>, etc).

For more information see <a href="https://oxij.org/software/hoardy-web/tree/master/README.md">project’s documentation</a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/README.md">GitHub</a>) and <a href="https://oxij.org/software/hoardy-web/tree/master/extension/page/help.org">extension’s <code>Help</code> page</a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/extension/page/help.org">GitHub</a>) (also distributed with the extension itself, available via the “Help” button from its popup UI), especially the <a href="https://oxij.org/software/hoardy-web/tree/master/extension/page/help.org#faq">“Frequently Asked Questions” section there</a> (also on <a href="https://github.com/Own-Data-Privateer/hoardy-web/tree/master/extension/page/help.org#faq">GitHub</a>).

Also, note that:

<ul>
<li><code>Hoardy-Web</code> <strong>DOES NOT</strong> send any of your captured web browsing data anywhere, unless you explicitly configure it to do so.</li>
<li><code>Hoardy-Web</code> <strong>DOES NOT</strong> send any telemetry anywhere.</li>
<li>Both of the above statements will apply to <strong>all future versions</strong> of <code>Hoardy-Web</code>.</li>
</ul>

<code>Hoardy-Web</code> was previously known as “Personal Private Passive Web Archive” aka <code>pWebArc</code>.