Add reusable CI workflow, testing all skills #136
+4,761
−10
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This adds a Puppeteer-based rendering workflow for complex HTML slides that don't convert well using the html2pptx approach. New Scripts: - scripts/render-slides.js: Render HTML slides to PNG at 2x scale - scripts/create-from-images.js: Create PPTX from rendered images with support for diagram overlays via JSON config New Configuration: - package.json: Node.js dependencies (pptxgenjs, puppeteer) - pyproject.toml: Python dependencies via uv (markitdown, defusedxml, python-pptx) CI/CD: - .github/workflows/test-pptx-skill.yml: GitHub Actions workflow with: - Node.js workflow tests (render slides, create PPTX) - Python dependency tests - Integration test with markitdown PPTX extraction Tests: - test/test-workflow.js: Automated tests for render and create scripts - test/slides/test-slide.html: Test fixture with gradient, SVG, flexbox Documentation: - SKILL.md: Added "Image-Based Workflow" section with setup instructions, workflow guide, and diagram overlay examples The image-based workflow addresses issues with html2pptx not handling: - Complex SVG diagrams - CSS gradients and advanced styling - Intricate flexbox/grid layouts 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Add package-lock.json for Node.js dependencies - Add uv.lock for Python dependencies 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
- architecture-slide.html: System architecture with SVG diagrams - metrics-slide.html: Dashboard with KPIs and charts - diagram-overlay.html: Standalone diagram for overlay testing - Enhanced test-workflow.js with 6 comprehensive tests - Updated .gitignore to exclude node_modules and .venv Test slides represent the kind of complex HTML that Claude would generate when asked to create professional presentations. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Job 1: Validate SKILL.md format for all skills - Checks frontmatter exists and has required fields (name, description) - Validates name matches directory and uses lowercase-hyphens - Warns on short descriptions or body content - Job 2: Generate skill zips for Claude installation - Creates downloadable .zip files for each skill - Uploads as artifacts for easy access - Summarizes zip sizes in GitHub step summary - Job 3: Test skill upload with Claude API - Uploads pptx skill to Claude API to validate format - Cleans up test skill after validation - Only runs when ANTHROPIC_API_KEY secret is available - Job 4: Test skill installation with Claude Code - Installs skill to ~/.claude/skills/ - Uses claude-code-action to verify skill is accessible - Reports installation status in step summary 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Add id-token: write permission for OIDC - Change 'prompt' to 'direct_prompt' (correct parameter name) - Add github_token for API access 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
The Claude Code action requires ANTHROPIC_API_KEY secret to be configured. Using continue-on-error so the CI still passes when secrets aren't available. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
Created skill-ci.yml as a reusable workflow that can be used by any
repository implementing a Claude skill:
Features:
- Validates SKILL.md format (frontmatter, required fields, naming)
- Generates installable .zip files (uploaded as artifacts)
- Tests skill upload with Claude API (optional)
- Tests skill with Claude Code action (optional)
Usage for single-skill repos:
jobs:
test:
uses: anthropics/skills/.github/workflows/skill-ci.yml@main
with:
skill_path: "."
secrets:
ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
Usage for multi-skill repos:
jobs:
test:
uses: anthropics/skills/.github/workflows/skill-ci.yml@main
with:
skill_path: "skills"
multi_skill: true
test_skill_name: "my-skill"
secrets:
ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude Opus 4.5 <[email protected]>
Comprehensive README explaining: - Quick start for single and multi-skill repos - All configurable inputs and secrets - SKILL.md format requirements - Example repository structures - Troubleshooting guide 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
Better discoverability for skill developers. Includes: - Quick start example - What the CI does - Configuration options table - Multi-skill repo example 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
The Claude API rejects skill zips that contain nested zip files. Add exclusions for: - .zip files (could be accidentally committed or created during build) - skill-zips/ directory (the output directory, which could be picked up by rglob when skill_path is ".") 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
Include the GitHub run ID in the skill display_title to prevent 'cannot reuse an existing display_title' errors when previous test runs failed to clean up properly. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
The Claude API requires SKILL.md to be at the top level of the zip file. Previously, multi-skill repos were creating zips with paths like 'skills/pptx/SKILL.md' instead of just 'SKILL.md'. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
The Claude API expects a top-level folder containing all skill files. The zip structure should be: pptx/SKILL.md pptx/ooxml/... Not just SKILL.md at the root or skills/pptx/SKILL.md. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
- Output skill_names_json from validation job for matrix use - Use matrix strategy in test-claude-api to test all 16 skills in parallel - Each skill is uploaded and validated against the Claude API - Claude Code test continues to use first skill (more interactive/expensive) 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
Temporarily uses robtaylor/claude-code-action@main which includes support for push events. This will be reverted once PR #772 is merged to anthropics/claude-code-action. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds a comprehensive CI workflow that tests all skills in the repository:
Jobs
Validate SKILL.md Format - Checks all skills have valid SKILL.md frontmatter
name,descriptionGenerate Skill Zips - Creates downloadable .zip files for each skill
Test with Claude API - Validates skill format with Claude API
ANTHROPIC_API_KEYsecret is availableTest with Claude Code - Integration test with Claude Code
~/.claude/skills/🤖 Generated with Claude Code