Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support data sources containing cloud-optimized geotiffs #18

Open
favyen2 opened this issue May 8, 2024 · 1 comment
Open

Support data sources containing cloud-optimized geotiffs #18

favyen2 opened this issue May 8, 2024 · 1 comment
Assignees

Comments

@favyen2
Copy link
Collaborator

favyen2 commented May 8, 2024

Some data sources may point to stores of "Cloud-Optimized" GeoTIFFs that support range requests. Reads of arbitrary portions of these data sources are possible.

For these data sources, it would be ideal to avoid downloading the entire GeoTIFF. Instead, the user should be able to specify that only needed portions of the GeoTIFF should be read. However, this is different from our current ingestion process, where we read entire items; we could represent each block of the GeoTIFF as a different item, but this is far from ideal.

Changes:

  • Implement a specialized tile store for cloud-optimized GeoTIFFs. The tile store says that the item is already present if it is present in the data source. The tile store reads and re-projects the data on the fly when requested.
  • Adjust tile store API so that tile store is responsible for keeping track of the different projections. Currently, the projection is simply encoded in a layer, and the tile store is not actually aware of it.
@favyen2 favyen2 self-assigned this May 8, 2024
@favyen2
Copy link
Collaborator Author

favyen2 commented May 16, 2024

I think this needs more thought. The data source should be able to serve images directly to materialization rather than going through ingestion. Some data sources like ones serving WebMercator tiles might support materialization only, no ingestion.

favyen2 pushed a commit that referenced this issue May 30, 2024
This also adds concept for XyzTiles dataset. Related to #18.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant