Skip to content

festnoze/common_tools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

______ Common tools ______

Presentation

**Common tools** contains a bunch of helpers methods of common usage, which are embeded into this package to keep the code factorized and ease their reusability.

Includes

The provided tools range from:
  • Low-level helpers, like for: string, json or file management.

  • To higher level AI tools (which will be in a separate library in the future), including:

    • LLM querying tools (including: output parsing, fallbacks, paralellization and batching) powered by Langchain,

    • rag toolbox, including:

      • A complete and modulable injection pipeline with: metadata handling, chunking, embedding, vector database creation, and querying.

      • A complete and modulable inference pipeline with: pre-treatment (query translation, multi-querying,metadata extraction & pre-filtering), hybrid search (BM25 & vector search), and post-treatment.

    • Agents & tools.

Tips:

  • Look into setup.py file, the required packages are listed in: install_requires section.
  • To install locally this package from another project, execute from the terminal: pip install -e C:/Dev/squad-ai/CommonTools

About

All common tools for IA, RAG, and misc. purposes

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages