agentgateway integrates with llm-d-scheduler through the EPP proto spec and is a GAIE conformant gateway. The integration is well documented upstream but details are lacking in the agentgateway docs. The integration should be highlighted in the integration guides and/or in the current k8s inference routing docs.
agentgateway integrates with llm-d-scheduler through the EPP proto spec and is a GAIE conformant gateway. The integration is well documented upstream but details are lacking in the agentgateway docs. The integration should be highlighted in the integration guides and/or in the current k8s inference routing docs.