This repository was archived by the owner on May 15, 2025. It is now read-only.
This repository was archived by the owner on May 15, 2025. It is now read-only.
OpenShift Dev Environment - Full Gateway+GIE Stack Deployment with VLLM and VLLM-P2P mode #72
Description
We currently have an OpenShift deployment for development fully set up in GIE with a vLLM simulator. The purpose of this task is to add an option to run with a real vLLM, and also with vLLM and LMCache using a Redis server in P2P mode.
Metadata
Metadata
Assignees
Labels
No labels