feat: Implement Autonomys Auto Drive storage integration with comprehensive API supportFeature/autonomys by moonpyt · Pull Request #60 · XSpoonAi/spoon-toolkit

moonpyt · 2026-02-02T04:39:17Z

Summary

This PR implements a complete integration with Autonomys Auto Drive API, providing a comprehensive SDK for file storage, object management, and download operations.

Features Implemented

📤 Upload Functionality

Small File Upload: Direct upload for files via UploadFileSmallTool
Large File Upload: Chunked upload with sequential chunk processing via UploadFileLargeTool
Auto Method Selection: UploadFileTool automatically selects upload method based on file size
MIME Type Support: Automatic MIME type detection from file extensions with manual override option
Upload Status Tracking: GetUploadStatusTool for monitoring upload progress

📥 Download Functionality

Direct Download: DownloadObjectTool and StreamDownloadTool for downloading objects by CID
Public Object Download: DownloadPublicObjectTool and StreamDownloadPublicObjectTool for public objects
Async Download: Support for large file downloads via async download endpoints
- CreateAsyncDownloadTool: Initiate async downloads
- GetAsyncDownloadStatusTool: Check download status
- ListAsyncDownloadsTool: List all async downloads
- DismissAsyncDownloadTool: Dismiss completed downloads

📋 Object Management

Object Listing:
- GetRootObjectsTool: Get root objects with pagination
- GetSharedRootObjectsTool: Get shared root objects
- GetDeletedRootObjectsTool: Get deleted root objects
Object Search: SearchObjectsTool with user/global scope support
Object Metadata: GetObjectMetadataTool and GetObjectStatusTool for object information
Object Lifecycle:
- PublishObjectTool: Publish objects
- UnpublishObjectTool: Unpublish objects
- DeleteObjectTool: Delete objects
- RestoreObjectTool: Restore deleted objects
Object Sharing: ShareObjectTool for sharing objects with publicId
Object Summary: GetObjectSummaryTool for object summaries

🔐 Account Management

Account Info: GetAccountInfoTool (renamed from Subscription to align with API)

Technical Details

Architecture

Provider Pattern: AutoDriveProvider as the core API client
Tool Classes: 25 tool classes covering all API endpoints
Error Handling: Custom AutoDriveAPIError for API-specific errors
Streaming Support: Streaming downloads for large files to avoid memory issues

Key Implementation Details

MIME Type Detection: Comprehensive mapping from file extensions to MIME types (13,000+ mappings)
Chunked Upload: Sequential chunk uploads with retry mechanism and resume support
Base URL Handling: Separate base URLs for main API (mainnet.auto-drive.autonomys.xyz) and public downloads (public.auto-drive.autonomys.xyz)
Header Management: Proper Content-Type and Accept headers for different endpoints
Configurable Auth Provider: X-Auth-Provider header is configurable via environment variable

File Structure

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e2c8484add

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector · 2026-02-02T04:40:45Z

spoon_toolkits/storage/autonomys_auto_drive/base.py

+    api_key = os.environ.get('AUTONOMYS_AUTO_DRIVE_API_KEY', 'apikey')
+    auth_provider = os.environ.get('AUTONOMYS_AUTO_DRIVE_AUTH_PROVIDER', 'apikey')
+
+    if not api_key:


Fail fast when AUTONOMYS_AUTO_DRIVE_API_KEY is unset

If the environment variable is missing, get_provider() silently falls back to the literal 'apikey', so the if not api_key guard never triggers. This means a misconfigured environment will attempt API calls with a placeholder key and return confusing auth errors instead of the explicit configuration error promised by the docstring. This only occurs when the env var is unset, but in that case the tools won’t give the intended guidance.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-02-02T04:40:45Z

spoon_toolkits/storage/autonomys_auto_drive/provider.py

+                async with download_client.stream("GET", endpoint) as response:
+                    if response.status_code == 200:
+                        content = b""
+                        async for chunk in response.aiter_bytes():
+                            content += chunk


Avoid buffering whole file in streaming download

The streaming download method builds the full payload in memory by concatenating chunks (content += chunk) and then returns the full bytes object. For large files, this defeats the advertised streaming behavior and can exhaust memory, especially since StreamDownloadTool is intended for large files. This issue only manifests for large downloads, but in that case it will behave the same as a non‑streaming download.

Useful? React with 👍 / 👎.

veithly · 2026-02-03T07:43:21Z

🔧 Bug Fix Applied

I've identified and fixed an issue with the async download status endpoint:

Problem

get_async_download_status was using incorrect endpoint path:

❌ Wrong: /api/downloads/async/{download_id}/status
✅ Correct: /api/downloads/async/{download_id} (no /status suffix)

Fix

The fix has been pushed to branch feature/autonomys (commit 1fee3f5):

Removed incorrect /status suffix from endpoint path
Added stream_download() alias for backward compatibility
Updated docstrings to clarify that download_id must be UUID, not CID

Test Results (All Passing ✅)

account_info: ✅ PASS
root_objects: ✅ PASS
shared_objects: ✅ PASS
deleted_objects: ✅ PASS
search: ✅ PASS
upload: ✅ PASS
download: ✅ PASS
stream: ✅ PASS
metadata: ✅ PASS
status: ✅ PASS
async_ops: ✅ PASS

@moonpyt Please merge this fix or cherry-pick commit 1fee3f5 into your PR branch.

…tream_download alias - Remove incorrect /status suffix from async download status endpoint - Add stream_download() as alias for download_object_stream() for backward compatibility - Clarify that download_id must be UUID, not CID - Update docstrings with correct API endpoint information

moonpyt added 3 commits January 30, 2026 22:24

add autonomys tool

13126c3

modify autonomys

66415b7

chore: remove old autonomys_auto_drive module

e2c8484

chatgpt-codex-connector bot reviewed Feb 2, 2026

View reviewed changes

moonpyt merged commit 9bd7baa into XSpoonAi:main Feb 4, 2026
1 check passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

feat: Implement Autonomys Auto Drive storage integration with comprehensive API supportFeature/autonomys#60

feat: Implement Autonomys Auto Drive storage integration with comprehensive API supportFeature/autonomys#60
moonpyt merged 4 commits intoXSpoonAi:mainfrom
moonpyt:feature/autonomys

moonpyt commented Feb 2, 2026

Uh oh!

chatgpt-codex-connector bot left a comment

Uh oh!

chatgpt-codex-connector bot Feb 2, 2026

Uh oh!

chatgpt-codex-connector bot Feb 2, 2026

Uh oh!

veithly commented Feb 3, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Comments

Conversation

moonpyt commented Feb 2, 2026

Summary

Features Implemented

📤 Upload Functionality

📥 Download Functionality

📋 Object Management

🔐 Account Management

Technical Details

Architecture

Key Implementation Details

File Structure

Uh oh!

chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector bot Feb 2, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector bot Feb 2, 2026

Choose a reason for hiding this comment

Uh oh!

veithly commented Feb 3, 2026

🔧 Bug Fix Applied

Problem

Fix

Test Results (All Passing ✅)

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants