Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: fix etl endpoint package #549

Merged
merged 1 commit into from
Feb 28, 2025
Merged

fix: fix etl endpoint package #549

merged 1 commit into from
Feb 28, 2025

Conversation

IcyKallen
Copy link
Contributor

@IcyKallen IcyKallen commented Feb 28, 2025

Fixes #

🤖 AI-Generated PR Description (Powered by Amazon Bedrock)

Description

This pull request includes changes to multiple files across different directories. The primary changes are:

  1. source/infrastructure/lib/model/model-construct.ts: This file has been modified, likely to update the infrastructure code related to the model deployment.

  2. source/lambda/job/dep/llm_bot_dep-0.1.0-py3-none-any.whl: There is an error with this file, which appears to be a Python wheel package. This issue needs to be investigated and resolved.

  3. source/lambda/job/dep/llm_bot_dep/loaders/pdf.py: This Python file, responsible for loading PDF files, has been modified.

  4. source/model/etl/code/main.py: Changes have been made to the main Python file responsible for the ETL (Extract, Transform, Load) process of the model.

  5. source/model/etl/code/requirements.txt: The requirements file for the ETL process has been updated, likely to include new dependencies or update existing ones.

The motivation behind these changes is to enhance the model deployment infrastructure, improve the PDF loading capabilities, and update the ETL process for the model. No specific dependencies have been mentioned, but the changes to the requirements.txt file suggest that new dependencies may be required.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

File Stats Summary

File number involved in this PR: 4, unfold to see the details:

The file changes summary is as follows:

Files
Changes
Change Summary
source/model/etl/code/requirements.txt 2 added, 1 removed The code changes add the 'requests' library to the list of dependencies.
source/infrastructure/lib/model/model-construct.ts 1 added, 1 removed The code change updates the naming convention of the knowledge base model from "knowledge-base-model-20250228" to "knowledge-base-model-0228".
source/model/etl/code/main.py 1 added, 1 removed The code change updates the retrieval of the API key from the secret data, now using the "key" field instead of "api_key".
source/lambda/job/dep/llm_bot_dep/loaders/pdf.py 41 added, 24 removed The code changes add several new parameters to the invoke_etl_model function, including model_provider, model_id, api_secret_name, and api_url. It also refactors the process_pdf function to use a dictionary for passing parameters to invoke_etl_model, allowing for easier extensibility.

@IcyKallen IcyKallen merged commit 5af5fc2 into gcr-custom Feb 28, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant