Add NLP capabilities with local models - adds multi-lingual support and improves evaluation results#507

Open

tmuskal wants to merge 47 commits intoMemPalace:developfrom

Commits on Apr 9, 2026

Add negation detection and provider registry for NLP capabilities
tmuskal
committed
Merge branch 'main' of https://github.com/tmuskal/mempalace
tmuskal
committed
Merge branch 'main' of https://github.com/tmuskal/mempalace
tmuskal
committed
feat: add PySBD and SpaCy NLP providers with tests for sentence segmentation and entity extraction
tmuskal
committed
Add SLM, WTPSplit, and GLiNER providers with comprehensive tests
tmuskal
committed
feat: add NLP integration tests for pySBD, spaCy, GLiNER, and WTPSplit
tmuskal
committed
feat: add optional NLP dependencies for basic, full, and SLM configurations
tmuskal
committed
feat: implement NLP-based sentence splitting and entity detection
tmuskal
committed
feat: enhance entity extraction with NLP NER provider support
tmuskal
committed
feat: implement NLP classification for memory extraction scoring
tmuskal
committed
feat: add NLP triple extraction functionality to process_file
tmuskal
committed
feat: add tests for NLP feature flag functionality in various modules
tmuskal
committed
fix: resolve CI failures for NLP integration

tmuskal
and
claude
committed
fix: don't set NLP env vars globally in test-nlp CI job

tmuskal
and
claude
committed
fix: update spaCy sentence segmentation test to handle model limitations
tmuskal
committed
fix: enhance entity code generation and update NLP config tests for environment handling
tmuskal
committed
fix: update CI workflow to enhance NLP feature flag testing and add speed benchmarks
tmuskal
committed
fix: update NLP provider benchmark to include self-test mode and improve quality evaluation
tmuskal
committed
feat: add NLP-enhanced retrieval modes to LongMemEval benchmark

tmuskal
and
claude
committed
fix: add tests/__init__.py for benchmark imports

tmuskal
and
claude
committed
fix: add timeouts to benchmark-speed CI job

tmuskal
and
claude
committed
fix: narrow speed benchmark scope and add continue-on-error

tmuskal
and
claude
committed

Commits on Apr 10, 2026

Commits on Apr 11, 2026

Commits on Apr 12, 2026

Merge branch 'develop' into main
tmuskal
authored

Commits on Apr 14, 2026

Merge branch 'develop' into main
tmuskal
authored