Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Enable Additional Amazon Bedrock Model: amazon.nova-pro #1377

Open
1 of 2 tasks
cindyytong opened this issue Feb 20, 2025 · 2 comments
Open
1 of 2 tasks

[Feature]: Enable Additional Amazon Bedrock Model: amazon.nova-pro #1377

cindyytong opened this issue Feb 20, 2025 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@cindyytong
Copy link
Contributor

cindyytong commented Feb 20, 2025

Checklist

  • I've searched for similar issues and couldn't find anything matching
  • I've discussed this feature request in the K8sGPT Slack and got positive feedback

Is this feature request related to a problem?

None

Problem Description

Hello There:

We are POCing the use of K8sGPT with an Amazon Bedrock backend. We have explored the output of the current supported model amazon.titan-text-express which was released back in 2023.

The analyze suggestions with this model have not been helpful. Using the AWS chat playground we have been able to manually test out the amazon.nova-pro-v1 model and have had better success with the answers generated when compared with the amazon.titan-text-express model.

We have a hard requirement to use an Amazon foundation model in our exploration which means currently we are limited to only using k8sgpt with amazon.titan-text-express.

Can we please add amazon.nova-pro-v1 as an additional Bedrock model. From my limited understanding of this code, it looks like it will only require adding the additional model here

Note: I was not able to join the K8SGPT Slack space because I was prompted by Slack that I need a k8sgpt.com email address when clicking on the link. Apologies if this is not the right procedure.

Solution Description

Add here and additional Amazon Bedrock Model of amazon.nova-pro-v1

Benefits

Advantage of adding the additional Nova Model:

Excerpt from this model comparison

Best for: Long-form content and complex document processing
Strengths:
1. Much larger context windows (up to 300K tokens)
2. Specialized for long-form content
3. Advanced text processing capabilities

Enabling more Amazon Bedrock model especially for teams that are using EKS is beneficial because it allows for easier integration of cross AWS region and product context

Potential Drawbacks

No response

Additional Information

Thank you

@cindyytong
Copy link
Contributor Author

I have raised a PR for this request. TY

@AlexsJones
Copy link
Member

Happy to help get this in - do you need assistance?

@AlexsJones AlexsJones added the enhancement New feature or request label Mar 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Proposed
Development

No branches or pull requests

2 participants