Skip to content

[Hubs] Ingest GCP billing data #1544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
flanakin opened this issue Apr 28, 2025 · 0 comments
Open

[Hubs] Ingest GCP billing data #1544

flanakin opened this issue Apr 28, 2025 · 0 comments
Assignees
Labels
Help wanted ✨ Extra attention is needed Status: 🔄️ In progress Implementation is currently in progress Tool: FinOps hubs Data pipeline solution Type: Feature 💎 Idea to improve the product

Comments

@flanakin
Copy link
Collaborator

📝 Scenario

As a hub admin, I need to connect my hub to Google Cloud in order to monitor GCP and Microsoft Cloud costs in a single pane of glass

💎 Solution

Create a pipeline to ingest FOCUS cost data from Google Cloud Storage into the ingestion container.

📋 Tasks

### Required tasks
- [x] Create base pipeline
- [x] Upload files 
- [ ] Add the linked service and dataset -- #1542 
- [ ] Add the trigger
- [ ] Add onboarding doc
- [ ] Update marketing page
- [ ] Update hubs overview doc
- [ ] Validation -- We will need help from others. Please leave a comment if you can help!
### Stretch goals
- [ ] Add file uploading to the hub-storage module -- #1543 
- [ ] Change file uploading to use the hub-storage module
- [ ] How can columns be customized (e.g., add custom x_ResourceGroupName column)

🙋‍♀️ Ask for the community

We could use your help:

  1. Please vote this issue up (👍) to prioritize it.
  2. Leave comments to help us solidify the vision.
@flanakin flanakin added Help wanted ✨ Extra attention is needed Status: 🔄️ In progress Implementation is currently in progress Type: Feature 💎 Idea to improve the product labels Apr 28, 2025
@flanakin flanakin added the Tool: FinOps hubs Data pipeline solution label Apr 28, 2025
@flanakin flanakin added this to the Cross-cloud support milestone Apr 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Help wanted ✨ Extra attention is needed Status: 🔄️ In progress Implementation is currently in progress Tool: FinOps hubs Data pipeline solution Type: Feature 💎 Idea to improve the product
Projects
None yet
Development

No branches or pull requests

2 participants