feat(ci): add nvd-api-cvehistory - #207
Merged
Merged
Conversation
Register vuls-data-raw-nvd-api-cvehistory in the fetch / archive / backup / gc / restore matrices, alongside the existing nvd-api-* raw sources. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Contributor
There was a problem hiding this comment.
Pull request overview
Registers the new raw source nvd-api-cvehistory (NVD CVE Change History API 2.0) across the repository’s GitHub Actions pipeline so it participates in the same fetch/archive/backup/gc/restore flows as the other nvd-api-* sources.
Changes:
- Adds
nvd-api-cvehistoryto the NVD API fetch workflow (workflow_dispatchchoices) and thefetch-allNVD API matrix. - Adds
vuls-data-raw-nvd-api-cvehistoryto archive, backup (daily/weekly/monthly), GC, and restore target lists. - Adds a
gc-raw.ymlentry forvuls-data-raw-nvd-api-cvehistorywith the same pack settings as othernvd-api-*images.
Reviewed changes
Copilot reviewed 10 out of 10 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| .github/workflows/fetch-nvd-api.yml | Adds nvd-api-cvehistory as an allowed workflow_dispatch target for the NVD API fetch workflow. |
| .github/workflows/fetch-all.yml | Extends the fetch-nvd-api job matrix to include nvd-api-cvehistory. |
| .github/workflows/archive-raw.yml | Adds nvd-api-cvehistory to the raw archive matrix. |
| .github/workflows/archive.yml | Adds vuls-data-raw-nvd-api-cvehistory to the archived image list. |
| .github/workflows/backup-daily.yml | Includes vuls-data-raw-nvd-api-cvehistory in daily raw backups. |
| .github/workflows/backup-weekly.yml | Includes vuls-data-raw-nvd-api-cvehistory in weekly raw backups. |
| .github/workflows/backup-monthly.yml | Includes vuls-data-raw-nvd-api-cvehistory in monthly raw backups. |
| .github/workflows/gc.yml | Adds vuls-data-raw-nvd-api-cvehistory to the GC target list. |
| .github/workflows/gc-raw.yml | Adds a GC raw pack configuration entry for vuls-data-raw-nvd-api-cvehistory. |
| .github/workflows/restore-all.yml | Adds vuls-data-raw-nvd-api-cvehistory to the restore-all image list. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Register
nvd-api-cvehistory(NVD CVE Change History API 2.0) as a raw source in the CI matrices.fetch-nvd-api.yml: addnvd-api-cvehistoryto theworkflow_dispatchchoicesfetch-all.yml: add it to thefetch-nvd-apijob matrixarchive-raw.yml/archive.yml: archive targetsbackup-daily.yml/backup-weekly.yml/backup-monthly.yml: raw backup targetsgc-raw.yml:tag+pack-threads: 2/pack-windowMemory: 4g(same as the othernvd-api-*entries)gc.yml/restore-all.yml: raw target listsWhy
MaineK00n/vuls-data-update#899 adds
vuls-data-update fetch nvd-api-cvehistory, which collects every CVE change event (~2.2M events as of now) from https://services.nvd.nist.gov/rest/json/cvehistory/2.0. This PR wires the resultingvuls-data-raw-nvd-api-cvehistoryimage into the same fetch / archive / backup / gc / restore flows the othernvd-api-*sources already use.How
Follows the same shape as #202 (alma-updateinfo / rocky-updateinfo): one entry per matrix, inserted after
nvd-api-cvein the alphabetically sorted lists and appended to thenvd-apifetch matrices.extract-*.ymlis intentionally untouched — there is no extractor for CVE change history yet (nvd-api-cpematchis likewise absent from those matrices).Testing
.github/workflows/*.ymlparse cleanly (yaml.safe_load)Notes / prerequisites
fetch-nvd-api.ymlstarts withdotgit pull ghcr.io/<repo>:vuls-data-raw-nvd-api-cvehistory, so the Initialize workflow must be run once withkind=raw,target=nvd-api-cvehistorybefore the first fetch.main. This workflow checks outMaineK00n/vuls-data-updateatref: main. feat(fetch/nvd/api/cvehistory): add CVE change history fetcher MaineK00n/vuls-data-update#899 targetsnightly, so the job will fail with an unknown command until that lands inmain.archive-raw.ymluses a 1024MB layer threshold; depending on the compressed size this may trip the check. Worth measuring after the first successful fetch and adjusting the threshold / gc parameters if needed.Checklist
vuls-data-raw-nvd-api-cvehistoryimage initializedvuls-data-update fetch nvd-api-cvehistoryavailable onmain