[Automated] Draft docs (agentgateway): llm: check if format supports guards before attempting response guard - #1127
Open
github-actions[bot] wants to merge 1 commit into
Open
github-actions[bot] wants to merge 1 commit into
github-actions[bot] wants to merge 1 commit into
Conversation
…guards before attempting response guard Signed-off-by: GitHub Action <action@github.com>
Deploying agentproxy with
|
| Latest commit: |
04a0015
|
| Status: | ✅ Deploy successful! |
| Preview URL: | https://be68aa71.agentproxy.pages.dev |
| Branch Preview URL: | https://pr-tracker-draft-agentgatewa-4ksx.agentproxy.pages.dev |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
agentgateway/agentgateway#3555 — llm: check if format supports guards before attempting response guard
Docs versions:
standalone/main,kubernetes/mainWhat changes for users: Response guards are skipped when the request input format does not support prompt guards. The request side already had this support check; the response side now follows the same boundary.
What the docs now say: The standalone prompt guards overview and Kubernetes guardrails overview now state that response guards run only when the request input format supports prompt guards.
Not verified: No cluster; the steps are unrun.
How
agentgateway-3555was drafted, and what was not verifiedDetectroute types withpromptGuardconfigured causes connection close / panic agentgateway#3552Plan, and what changed it
Why a documentation change is necessary
The pull request adds
req.input_format.supports_prompt_guard()before applying a response prompt guard. The PR body says the check existed only on the request side, while both target pages said response guards could reject or mask responses without naming the input-format boundary. A reader configuring response guards could expect them to run on traffic whose format cannot support prompt guards.What changed on disk
content/docs/standalone/main/documentation/llm/prompt-guards/overview.md— Added the response-guard input-format boundary.content/docs/kubernetes/main/documentation/llm/guardrails/overview.md— Added the response-guard input-format boundary.How to verify this change
What was not verified
The configuration was not applied to a cluster, so every command in this diff is unrun. The dossier does not name a concrete input format that returns
supports_prompt_guard() == false, so the exact traffic shape for the unsupported-format check was not verified.How the pages were chosen (triage report)
Draft a documentation change
agentgateway/agentgateway#3555 — llm: check if format supports guards before attempting response guard
agentgateway/websiteDetectroute types withpromptGuardconfigured causes connection close / panic agentgateway#3552Warnings
Draft branch:
pr-tracker-draft-agentgateway-3555