update docs builder to use myst-parser and autodoc2

Author: pirate

Contents.rst

@@ -1,5 +1,8 @@
-Intro
-#####
+Contents
+########
+
+Overview
+########
 
 .. toctree::
     :maxdepth: 1
@@ -11,49 +14,46 @@ Getting Started
 ###############
 
 .. toctree::
-    :maxdepth: 2
+    :maxdepth: 1
 
     Quickstart.md
     Install.md
     Docker.md
-
-
-General
-#######
+    Configuration.md
+    Security-Overview.md
 
 .. toctree::
     :maxdepth: 2
 
     Usage.md
-    Configuration.md
-    Troubleshooting.md
-    Security-Overview.md
+
+Guides
+######
+
+.. toctree::
+    :maxdepth: 1
+
+    Setting-Up-Storage.md
+    Setting-up-Authentication.md
+    Setting-up-Search.md
     Publishing-Your-Archive.md
     Scheduled-Archiving.md
     Chromium-Install.md
-    Upgrading-or-Merging-Archives.md
+    Upgrading.md
+    Merging-Collections.md
+    Troubleshooting.md
 
 
 API Reference
 #############
 
 .. toctree::
-    :maxdepth: 1
-
-    Configuration Options <Configuration.md>
-    Data Folder Layout <Usage.md>
-    Command Line Interface <Usage.md>
-    Web Interface <Usage.md>
-    Python API <modules>
-    REST API <modules>
-
-.. - [Configuration Options](Configuration.md)
-.. - [Data Folder Layout](Configuration.md)
-.. - [Command Line Interface](Usage.md)
-.. - [Web Interface](Usage.md)
-.. - [Python API](modules)
-.. - REST API (Coming soon...)
+    :maxdepth: 3
 
+    Filesystem <https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#disk-layout>
+    SQL API <https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#sql-shell-usage>
+    REST API <https://demo.archivebox.io/api>
+    Python API <apidocs/index>
 
 Meta
 ####

Merging-Collections.md

@@ -1,4 +1,4 @@
-## Merging two or more existing archives
+# Merging Collections
 
 Two or more existing ArchiveBox collection dirs can be merged together by simply combining the contents of `archive/*` and re-running `archivebox init` to pull the new Snapshots into the index.
 
@@ -121,4 +121,4 @@ See here [Troubleshooting: Database](https://github.com/ArchiveBox/ArchiveBox/wi
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#large-archives
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overview#output-folder
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#python-shell-usage
-- https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#sql-shell-usage
+- https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#sql-shell-usage

Security-Overview.md

@@ -1,3 +1,5 @@
+# Security Overview
+
 > *💬 We offer [consulting services](https://docs.monadical.com/s/archivebox-consulting-services) to set up, secure, and maintain ArchiveBox on your preferred hosting environment.*  
 > <sub>We use this revenue (from corporate clients who can afford to pay) to support open source development and keep ArchiveBox free.</sub>
 

Setting-Up-Storage.md

@@ -1,3 +1,5 @@
+# Setting Up Storage
+
 > *💬 We offer [consulting services](https://docs.monadical.com/s/archivebox-consulting-services) to set up, secure, and maintain ArchiveBox on your preferred storage provider.*  
 > <sub>We use this revenue (from corporate clients who can afford to pay) to support open source development and keep ArchiveBox free.</sub>
 
@@ -296,4 +298,4 @@ docker compose run archivebox /bin/bash 'ls -lah /data/archive/ | tee /data/arch
 
 - [IPFS](https://github.com/djdv/go-filesystem-utils/pull/40) / [Peergos](https://github.com/peergos/peergos) / [GlusterFS](https://github.com/calavera/docker-volume-glusterfs)
 - [DigitalOcean Block Storage Volumes](https://github.com/djmaze/dobs-volume-plugin) / [Linode Block Storage Volumes](https://github.com/linode/docker-volume-linode)
-- [More volume plugins...](https://docs.docker.com/engine/extend/legacy_plugins/#volume-plugins)
+- [More volume plugins...](https://docs.docker.com/engine/extend/legacy_plugins/#volume-plugins)

Setting-up-Authentication.md

@@ -1,3 +1,5 @@
+# Setting Up Authentication
+
 > *💬 We offer [consulting services](https://docs.monadical.com/s/archivebox-consulting-services) to set up, integrate, and maintain ArchiveBox with your org's auth & hosting.  
 > If you need support, advanced development to capture difficult sites, audit logging, and more, we can provide it!*  
 > <sub>We use this revenue (from corporate clients who can afford to pay) to support open source development and keep ArchiveBox free.</sub>
@@ -240,4 +242,4 @@ curl -X 'GET' \
 
 - The ArchiveBox API auth implementation: [`archivebox/api/auth.py`](https://github.com/ArchiveBox/ArchiveBox/blob/dev/archivebox/api/auth.py#:~:text=API_AUTH_METHODS) + [`archivebox/api/v1_auth.py`](https://github.com/ArchiveBox/ArchiveBox/blob/dev/archivebox/api/v1_auth.py)
 - The [`django-ninja` auth documentation](https://django-ninja.dev/guides/authentication/) (which powers our API)
-- The [Swagger auth documentation](https://swagger.io/docs/specification/authentication/) for the interactive API Docs UI
+- The [Swagger auth documentation](https://swagger.io/docs/specification/authentication/) for the interactive API Docs UI

Setting-up-Search.md

@@ -1,3 +1,5 @@
+# Setting Up Search
+
 ## How to Search in ArchiveBox
 
 You can search your ArchiveBox data in a number of ways:
@@ -253,4 +255,4 @@ archivebox config --set FTS_SQLITE_MAX_LENGTH=1000000000
 * [#1320 Troubleshooting: Sonic backend Error: ENDED authentication_failed doesn't contain protocol(NUMBER)](https://github.com/ArchiveBox/ArchiveBox/pull/1320)
 
 - [#1139 Feature Request: Add AI-assisted summarization, tagging, search, and more using LLMs / RAG](https://github.com/ArchiveBox/ArchiveBox/issues/1139)
-- [#1358 Django Admin general improvements: tree view, better filters, better sorting, custom pages, etc.](https://github.com/ArchiveBox/ArchiveBox/issues/1358)
+- [#1358 Django Admin general improvements: tree view, better filters, better sorting, custom pages, etc.](https://github.com/ArchiveBox/ArchiveBox/issues/1358)

Upgrading.md

@@ -1,4 +1,4 @@
-## Upgrade your ArchiveBox collection to a new version
+# Upgrading Versions
 
 ```bash
 # cd /path/to/your/archivebox/data
@@ -127,15 +127,15 @@ More info:
 - https://aur.archlinux.org/packages/archivebox
 - https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/misc/archivebox/default.nix
 
----
+<hr/>
 
 ## Merge two or more existing archives
 
 See [[Merging Collections]]...
 
 <br/>
 
----
+<hr/>
 
 ## Related Documents
 
@@ -144,4 +144,4 @@ See [[Merging Collections]]...
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#large-archives
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overview#output-folder
 - https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#python-shell-usage
-- https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#sql-shell-usage
+- https://github.com/ArchiveBox/ArchiveBox/wiki/Usage#sql-shell-usage

apidocs/archivebox/archivebox.__main__.md

@@ -0,0 +1,47 @@
+# {py:mod}`archivebox.__main__`
+
+```{py:module} archivebox.__main__
+```
+
+```{autodoc2-docstring} archivebox.__main__
+:allowtitles:
+```
+
+## Module Contents
+
+### Data
+
+````{list-table}
+:class: autosummary longtable
+:align: left
+
+* - {py:obj}`__package__ <archivebox.__main__.__package__>`
+  - ```{autodoc2-docstring} archivebox.__main__.__package__
+    :summary:
+    ```
+* - {py:obj}`ASCII_LOGO_MINI <archivebox.__main__.ASCII_LOGO_MINI>`
+  - ```{autodoc2-docstring} archivebox.__main__.ASCII_LOGO_MINI
+    :summary:
+    ```
+````
+
+### API
+
+````{py:data} __package__
+:canonical: archivebox.__main__.__package__
+:value: >
+   'archivebox'
+
+```{autodoc2-docstring} archivebox.__main__.__package__
+```
+
+````
+
+````{py:data} ASCII_LOGO_MINI
+:canonical: archivebox.__main__.ASCII_LOGO_MINI
+:value: <Multiline-String>
+
+```{autodoc2-docstring} archivebox.__main__.ASCII_LOGO_MINI
+```
+
+````