docs: refresh GAP-ANALYSIS + COMPARISON against 0.5.0.dev0 surface#257
Merged
Merged
Conversation
The previous versions (2026-03) scored soul-protocol against the 0.2.2 vision baseline and a 2026-03-08 head-to-head. Most of what they listed as missing has shipped through 0.3.x (spec/runtime split, journal, decision traces, retrieval vocabulary), 0.4.0 (multi-user souls, open- string layers + domain isolation, trust chain), and 0.5.0.dev0 (memory update primitives, soul-aware evals, autonomous optimize, graph traversal + typed ontology, dedup-aware writes, trust-chain hardening). GAP-ANALYSIS.md now reads as "what's actually missing today" rather than "what's missing from the 0.2.2 vision": - Status header pinning to 0.5.0.dev0 - Section 2 lists shipped capabilities with a `since` column grounded in CHANGELOG + src/ - Section 3 names real gaps (mock-only eternal providers, no vector DB backends, no persistent graph backend, no conformance suite yet, no streaming sync, no mobile / browser runtime) - Section 4 separates intentional deferrals (orchestration moved to pocketpaw in 0.3.3, framework adapters as out-of-scope) - Track-by-track summary maps each lane to next likely step COMPARISON.md adds the dimensions 0.4/0.5 introduced — trust chain, multi-user attribution + domain isolation, soul-aware evals, autonomous optimization, graph traversal + typed ontology, dedup-aware writes — and refreshes the prose for each competitor. The benchmark snapshot is preserved but flagged as predating the 0.5 surface; the "where each competitor wins" rows stay honest (Mem0's vector ecosystem, Letta's context-window paging, LangChain's framework breadth, Cognee's persistent graph DB, OpenAI Memory's zero-config). Test plan: read each section against CHANGELOG and src/ to verify every shipped claim points at a real PR or file, and every gap was confirmed by current code rather than copied from the old doc.
Issues (must fix)
Heads up
Please update your PR to address these points. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Both
docs/GAP-ANALYSIS.mdanddocs/COMPARISON.mdwere March 2026 vintage and scored against the 0.2.2 baseline. Most of what they listed as missing has since shipped — the 0.3.x spec/runtime split, the 0.4.0 identity bundle (multi-user souls, open-string layers + domain isolation, trust chain), and the 0.5.0.dev0 wave (memory update primitives, soul-aware evals, autonomous optimize, graph traversal + typed ontology, dedup-aware writes, trust-chain hardening). The docs needed a rewrite to match.GAP-ANALYSIS.md
Restructured around what a reader actually wants to know today.
sincecolumn. Identity / access control, trust chain (with all the 0.5.0.dev0 hardening — timestamp monotonicity, strict canonical JSON, key rotation allow-list, payload summaries, structured logging, touch-time pruning), memory primitives (confirm/update/supersede/forget/purge/reinstate,note()), graph traversal + typed ontology, evals / optimize / diff, journal + decision traces, CLI / MCP surface, doc surface.soul rotate-keysCLI yet, full trust-chain archive deferred to 0.5.x.COMPARISON.md
Refreshed the head-to-head against Mem0, MemGPT / Letta, LangChain Memory, Cognee, OpenAI Memory.
Test plan
CHANGELOG.md[Unreleased]+[0.4.0]andsrc/soul_protocol/{spec,runtime,cli,eval,optimize}/.runtime/eternal/providers/,runtime/embeddings/,runtime/memory/graph.py,runtime/trust/manager.py,runtime/crypto/keystore.py) rather than copied from old doc.Notes
devbecause the new content describes 0.5.0.dev0 features that only exist ondev(main is still at 0.4.0). Doc will land onmainwith the next release cut.