-
Notifications
You must be signed in to change notification settings - Fork 28
Add issue-detection-triage skill reference #64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1 +1,3 @@ | ||
| .DS_Store | ||
| skills/langfuse/references/.env | ||
| skills/langfuse/references/.env2 | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -22,7 +22,7 @@ This skill helps you use Langfuse effectively across all common workflows: instr | |
|
|
||
| Follow these principles for ALL Langfuse work: | ||
|
|
||
| 1. **Documentation First**: NEVER implement based on memory. Always fetch current docs before writing code (Langfuse updates frequently) See the section below on how to access documentation. | ||
| 1. **Documentation First**: NEVER implement based on memory. Always fetch current docs before writing code (Langfuse updates frequently). See the section below on how to access documentation. | ||
| 2. **CLI for Data Access**: Use `langfuse-cli` when querying/modifying Langfuse data. See the section below on how to use the CLI. | ||
| 3. **Best Practices by Use Case**: Check the relevant reference file below for use-case-specific guidelines before implementing | ||
| 4. **Use latest Langfuse versions**: Unless the user specified otherwise or there's a good reason, always use the latest version of Langfuse SDKs/APIs. Even if you're only creating a plan for another agent to execute, be explicit about the exact version to use. | ||
|
|
@@ -38,6 +38,7 @@ Follow these principles for ALL Langfuse work: | |
| - upgrading or migrating Langfuse SDKs to the latest version: references/sdk-upgrade.md | ||
| - judge calibration (LLM-as-a-Judge reliability, simple accuracy checks, advanced split-based validation, confusion matrices, and metric ingestion): references/judge-calibration.md | ||
| - systematic error analysis — reading traces, building failure taxonomy, deciding what to fix: references/error-analysis.md | ||
| - issue detection triage — find production problems and rank them P0–P3: references/issue-detection-triage.md | ||
| - setting up CI/CD experiment gates with `langfuse/experiment-action`: references/ci-cd.md | ||
| - submitting feedback about this skill: references/skill-feedback.md | ||
|
|
||
|
|
@@ -73,7 +74,7 @@ If not set, ask the user to set them in their shell or a `.env` file (do not ask | |
|
|
||
| ### Detailed CLI Reference | ||
|
|
||
| For common workflows, tips, and full usage patterns, see [references/cli.md](references/cli.md). | ||
| For common workflows, tips, pagination, and endpoint preferences, see [references/cli.md](references/cli.md). Use-case-specific CLI recipes live in the relevant reference file. | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. If not necessary I'd discard this change. |
||
|
|
||
| ## 2. Langfuse Documentation | ||
|
|
||
|
|
||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -57,4 +57,4 @@ export LANGFUSE_BASE_URL=https://cloud.langfuse.com | |
| - Prefer `metrics` over `legacy-metrics-v1s` for the same reason | ||
| - Prefer `scores` over `legacy-score-v1s` for list/get operations | ||
| - For broad trace queries, `traces list` can time out on Langfuse Cloud — use `observations list` (with `--trace-id` if you're traversing from a known trace) instead. See the [Observations API docs](https://langfuse.com/docs/api-and-data-platform/features/observations-api) for the v1 → v2 mapping. | ||
| - Pagination: legacy v1 endpoints use `--limit` and `--page`; modern endpoints (`observations`, `metrics`, `scores`) use cursor-based pagination — pass `--limit`, then thread `meta.cursor` from the response into the next request's `--cursor` | ||
| - Pagination: `traces` and `scores` use `--limit` + `--page` (starts at 1; `meta.totalPages` tells you how many pages). `observations` uses cursor-based pagination — pass `--limit`, then thread `meta.cursor` (NOT `meta.nextCursor`) from the response into the next request's `--cursor`. `metrics` takes a query object and has no pagination flags. | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Was this change intentional or just the agent changing something because it did something wrong? Not sure if we should be so specific (e.g. " |
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would discard this