|
| 1 | +--- |
| 2 | +title: Amazon Web Services (RKE) |
| 3 | +layout: default |
| 4 | +nav_order: 4 |
| 5 | +parent: Deployment |
| 6 | +grand_parent: TrustGraph Documentation |
| 7 | +--- |
| 8 | + |
| 9 | +# Amazon Web Services (RKE) Deployment |
| 10 | + |
| 11 | +Deploy TrustGraph on Amazon Web Services using RKE2 Kubernetes and AWS Bedrock integration. |
| 12 | + |
| 13 | +## Overview |
| 14 | + |
| 15 | +TrustGraph provides a complete AWS deployment solution using **Pulumi** (Infrastructure as Code) that automatically provisions and configures an RKE2 Kubernetes cluster with AWS Bedrock LLM integration for a production-ready TrustGraph deployment. |
| 16 | + |
| 17 | +## What You Get |
| 18 | + |
| 19 | +The AWS deployment includes: |
| 20 | + |
| 21 | +- **RKE2 Kubernetes cluster** with 1 server and multiple agent nodes |
| 22 | +- **IAM roles and policies** with Bedrock access permissions |
| 23 | +- **EBS CSI driver** for persistent storage provisioning |
| 24 | +- **Complete TrustGraph stack** deployed and configured |
| 25 | +- **AWS Bedrock integration** with Claude 3.5 Haiku (configurable) |
| 26 | +- **Mistral Nemo Instruct** endpoint configured |
| 27 | +- **Secrets management** for secure credential handling |
| 28 | +- **Monitoring and observability** with Grafana |
| 29 | +- **Web workbench** for document processing and Graph RAG |
| 30 | + |
| 31 | +## Deployment Method |
| 32 | + |
| 33 | +The deployment uses **Pulumi**, an Infrastructure as Code tool that: |
| 34 | + |
| 35 | +- Has an open-source license |
| 36 | +- Uses general-purpose programming languages (TypeScript/JavaScript) |
| 37 | +- Provides testable infrastructure code |
| 38 | +- Offers retryable deployments |
| 39 | +- Supports local or S3 state management |
| 40 | + |
| 41 | +## Architecture |
| 42 | + |
| 43 | +**Kubernetes Platform**: RKE2 (Rancher Kubernetes Engine 2) |
| 44 | +**Node Configuration**: t3a.xlarge instances (configurable) |
| 45 | +**Default Setup**: 3 nodes, Amazon Linux 2023 |
| 46 | +**Network**: Custom VPC with configurable CIDR blocks |
| 47 | +**Storage**: EBS volumes with automatic provisioning |
| 48 | +**LLM Service**: AWS Bedrock with multiple model options |
| 49 | + |
| 50 | +## Quick Process Overview |
| 51 | + |
| 52 | +1. **Install Pulumi** and dependencies |
| 53 | +2. **Configure AWS credentials** via `.aws/credentials` |
| 54 | +3. **Set up Bedrock model access** in AWS console |
| 55 | +4. **Customize configuration** in `Pulumi.STACKNAME.yaml` |
| 56 | +5. **Deploy** with `pulumi up` |
| 57 | +6. **Wait for initialization** (~30 seconds after pods are running) |
| 58 | +7. **Access services** via port-forwarding |
| 59 | + |
| 60 | +## Configuration Options |
| 61 | + |
| 62 | +Customizable settings include: |
| 63 | + |
| 64 | +- **Environment**: dev, staging, production |
| 65 | +- **Region**: us-west-2 (default, configurable) |
| 66 | +- **VPC CIDR**: 172.38.0.0/16 |
| 67 | +- **Node type**: t3a.xlarge (configurable) |
| 68 | +- **Node count**: 3 (configurable) |
| 69 | +- **AMI**: Amazon Linux 2023 |
| 70 | + |
| 71 | +## Access Points |
| 72 | + |
| 73 | +Once deployed, you'll have access to: |
| 74 | + |
| 75 | +- **TrustGraph API**: Port 8088 |
| 76 | +- **Web Workbench**: Port 8888 (document processing, Graph RAG) |
| 77 | +- **Grafana Monitoring**: Port 3000 |
| 78 | + |
| 79 | +## Bedrock Integration |
| 80 | + |
| 81 | +The deployment includes AWS Bedrock integration with: |
| 82 | + |
| 83 | +- **Default Model**: Claude 3.5 Haiku |
| 84 | +- **Alternative Models**: Mistral Nemo Instruct and others |
| 85 | +- **Model Access**: Requires enabling specific models in Bedrock console |
| 86 | +- **Secure Access**: IAM roles and policies automatically configured |
| 87 | + |
| 88 | +## Complete Documentation |
| 89 | + |
| 90 | +For detailed step-by-step instructions, configuration options, and troubleshooting, visit: |
| 91 | + |
| 92 | +**[TrustGraph AWS RKE Deployment Guide](https://github.com/trustgraph-ai/pulumi-trustgraph-aws-rke)** |
| 93 | + |
| 94 | +The repository contains: |
| 95 | +- Complete Pulumi deployment code |
| 96 | +- RKE2 cluster configuration |
| 97 | +- AWS Bedrock integration setup |
| 98 | +- Detailed setup instructions |
| 99 | +- Troubleshooting guides |
| 100 | +- Customization options |
| 101 | + |
| 102 | +## Important Notes |
| 103 | + |
| 104 | +**Storage Cleanup**: The EBS CSI driver doesn't automatically clean up volumes on teardown. Manual cleanup may be required in the EC2 console. |
| 105 | + |
| 106 | +**Initialization Time**: Allow ~30 seconds after all pods are running for application initialization to complete. |
| 107 | + |
| 108 | +**Bedrock Access**: Ensure you have enabled the required models in your AWS Bedrock console before deployment. |
| 109 | + |
| 110 | +## Next Steps |
| 111 | + |
| 112 | +After deployment, you can: |
| 113 | +- Load documents through the web workbench |
| 114 | +- Test Graph RAG queries with Bedrock models |
| 115 | +- Monitor processing through Grafana |
| 116 | +- Scale the cluster by adjusting node count |
| 117 | +- Integrate with other AWS services |
0 commit comments