Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignoring corrupted files errors during ingest #79

Open
Hgherzog opened this issue Dec 10, 2024 · 2 comments
Open

Ignoring corrupted files errors during ingest #79

Hgherzog opened this issue Dec 10, 2024 · 2 comments

Comments

@Hgherzog
Copy link
Collaborator

Some GCS files for sentinel 2 such as gs://gcp-public-data-sentinel-2/tiles/18/L/VQ/S2A_MSIL1C_20220823T151721_N0400_R125_T18LVQ_20220823T203046.SAFE/GRANULE/L1C_T18LVQ_A037445_20220823T152332/IMG_DATA/T18LVQ_20220824T151721_TCI.jp2 are actually an xml metadata file not a jp2 and thus can't be ingested. We want to check for this issue during the prepare phase. Until that is possible we will simply ignore errors during ingest and just continue as if it didn't happen.

@Hgherzog
Copy link
Collaborator Author

Hgherzog commented Feb 7, 2025

@favyen2 pretty sure youa dressed this can you confirm

@favyen2
Copy link
Collaborator

favyen2 commented Feb 7, 2025

No, I fixed a different issue. I have another fix for images that say OPER instead of MSIL1C and should not be used that I still need to create PR for, but that is also separate from this one, somehow I haven't run into this particular problem yet. Did this issue come up again?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants