Skip to content

Commit 8a9c3d7

Browse files
authored
Add GCS destination (#184)
1 parent 9ddec25 commit 8a9c3d7

File tree

8 files changed

+24
-5
lines changed

8 files changed

+24
-5
lines changed

mint.json

+1
Original file line numberDiff line numberDiff line change
@@ -277,6 +277,7 @@
277277
"process-data/destinations/amazon-s3",
278278
"process-data/destinations/azure-blob",
279279
"process-data/destinations/elastic-bulk",
280+
"process-data/destinations/gcs",
280281
"process-data/destinations/http",
281282
"process-data/destinations/opentelemetry",
282283
"process-data/destinations/splunk",

process-data/destinations/amazon-s3.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebarTitle: Amazon S3
99
To set up an Amazon S3 destination:
1010

1111
1. In AWS, ensure the AWS Policy contains the statements required to perform a `PutObject` operation. For more information, see the AWS documentation on [policies and permissions](https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies.html), [access keys](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html), and the [`PutObject` operation](https://docs.aws.amazon.com/AmazonS3/latest/API/API_PutObject.html).
12-
2. In Axiom, create an Amazon S3 destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations.mdx).
12+
2. In Axiom, create an Amazon S3 destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
1313
3. Configure the following:
1414
- **Access key ID**. For more information on access keys, see the [Amazon documentation](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html).
1515
- **Secret access key**. For more information on access keys, see the [Amazon documentation](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_access-keys.html).

process-data/destinations/axiom.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ To set up an Axiom destination:
1010

1111
1. Create a destination dataset in Axiom where you want to route data.
1212
2. Create an Axiom API token with permissions to update the destination dataset.
13-
3. Create an Axiom destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations.mdx).
13+
3. Create an Axiom destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
1414
4. Configure the following:
1515
- In **Dataset**, enter the name of the destination dataset.
1616
- In **API Token**, enter the Axiom API token.

process-data/destinations/azure-blob.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebarTitle: Azure Blob
99
To set up an Azure Blob destination:
1010

1111
1. In Azure, create a service principal account with authorization to perform a `Put Blob` operation. For more information, see the Azure documentation on [creating a service principal](https://learn.microsoft.com/en-us/entra/identity-platform/howto-create-service-principal-portal) and on [authorizing a `Put Blob` operation](https://learn.microsoft.com/en-us/rest/api/storageservices/put-blob?tabs=microsoft-entra-id#authorization).
12-
2. In Axiom, create an Azure Blob destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations.mdx).
12+
2. In Axiom, create an Azure Blob destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
1313
3. Configure the following:
1414
- In **URL**, enter the path to the storage account.
1515
- In **Format**, specify the format in which Axiom sends data to the destination.

process-data/destinations/elastic-bulk.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ sidebarTitle: Elastic Bulk
99
To set up an Elastic Bulk destination:
1010

1111
1. In Elastic, ensure your account has the index privileges to use the create action. For more information, see the [Elastic documentation](https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html#docs-bulk-api-prereqs).
12-
2. In Axiom, create an Elastic Bulk destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations.mdx).
12+
2. In Axiom, create an Elastic Bulk destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
1313
3. Configure the following:
1414
- In **URL**, enter the path to the Elastic Bulk API where you want to route data. For example, enter `https://api.elastic-cloud.com/` if you use Elastic Cloud.
1515
- In **Index**, enter the Elastic index.

process-data/destinations/gcs.mdx

+17
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
---
2+
title: 'Google Cloud Storage destination'
3+
description: 'This page explains how to set up a Google Cloud Storage destination.'
4+
sidebarTitle: Google Cloud Storage
5+
---
6+
7+
[Google Cloud Storage](https://cloud.google.com/storage) is a scalable, secure, and durable object storage service for unstructured data.
8+
9+
To configure a Google Cloud Storage destination:
10+
11+
1. In Google Cloud Storage, create a service account. For more information, see the [Google documentation](https://developers.google.com/workspace/guides/create-credentials#create_a_service_account).
12+
1. Create credentials for the service account in JSON format. For more information, see the [Google documentation](https://developers.google.com/workspace/guides/create-credentials#create_credentials_for_a_service_account).
13+
1. In Axiom, create a Google Cloud Storage destination. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
14+
1. Configure the following:
15+
- In **Bucket**, enter the bucket name. For more information on retrieving bucket metadata in Google Cloud Storage, see the [Google documentation](https://cloud.google.com/storage/docs/getting-bucket-metadata).
16+
- In **Credentials JSON**, enter the credentials you have previously created for the service account.
17+
- Optional: In **Format**, specify the format in which Axiom sends data to the destination.

process-data/destinations/manage-destinations.mdx

+1
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ To set up a destination:
2020
- [Axiom](/process-data/destinations/axiom)
2121
- [Azure Blob](/process-data/destinations/azure-blob)
2222
- [Elastic Bulk](/process-data/destinations/elastic-bulk)
23+
- [Google Cloud Storage](/process-data/destinations/gcs)
2324
- [HTTP](/process-data/destinations/http)
2425
- [OpenTelemetry Traces](/process-data/destinations/opentelemetry)
2526
- [Splunk](/process-data/destinations/splunk)

process-data/destinations/opentelemetry.mdx

+1-1
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ sidebarTitle: 'OpenTelemetry Traces'
88

99
To set up an OpenTelemetry Traces destination:
1010

11-
1. Create an OpenTelemetry Traces destination in Axiom. For more information, see [Manage destinations](/process-data/destinations/manage-destinations.mdx).
11+
1. Create an OpenTelemetry Traces destination in Axiom. For more information, see [Manage destinations](/process-data/destinations/manage-destinations).
1212
1. In **URL**, enter the path to the OpenTelemetry destination where you want to route data.
1313
1. In **Format**, specify the format in which Axiom sends data to the destination.
1414
1. Optional: In **Headers**, specify any headers you want Axiom to send to the destination.

0 commit comments

Comments
 (0)