Feature/summary #17
Merged
Feature/summary #17
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Add new models: OpenAI GPT3.5-Turbo and Azure OpenAI. Azure OpenAI allows for the embeddings model to be from a different endpoint * Parser for the API generation and correction response * add models, prompts and add to tests * Changes: - Change in base.py from prompts, formatting the prompt - Change in test_prompts adding a new symbol to delete * add data for examples --------- Co-authored-by: Miguel Lopez <[email protected]>
- New task added. New prompts added: - json-summarizer in spanish and english json_summarizer.py: - New model class for JSON summarization task. TODO: Fix the example and delete commented code __init__.py: - Added the new model in the init script promptmeteo/parsers/__init__.py: - New option for new type of task (json summarization). - TODO: We must change it to use a new parser for JSON treatment.
prompts. New prompt for anthropic claude added and name changing for gpt 3.5 models. pyproject.toml. Added boto3 in the requirements to connect with aws. __init__.py. Name changing of the task json_info_extraction.py: - New file replacing json_summarizer.py with the new naming /models/__init__.py: - New model provider added for Bedrock /models/bedrock.py: - Class for Bedrock models. - Only anthropic claude v2 integrated - By the moment, huggingface embeddings /parsers/__init__.py: - Name changing of the parser /tasks/task_builder.py: - Name changing and summarization task included for new development.
- Added Summarizer class json_info_extraction.py: - Changes in the example and code comments. - json_fields parameter removed due to it is implicit in fields_description summarizer.py: - New class for Summarization task parsers/__init__.py: - New parser added for summarization task (dummy parser) new prompts for anthropic claude summarization and minor changes in prompts tests/tools/dictionary_checker: - 'sample' word added in spanish dictionary because is a keyword for injecting.
- Change for region selection
…nd .prompts modification
Codecov ReportAttention:
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #17 +/- ##
==========================================
- Coverage 85.01% 84.98% -0.04%
==========================================
Files 41 44 +3
Lines 1395 1525 +130
==========================================
+ Hits 1186 1296 +110
- Misses 209 229 +20
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New features added: