warcannon queryAthena command doesn't exist

[agamm]

It is written in the docs but isn't implemented in the CLI.

[c6fc]

Use populateAthena with the query execution id

…

On Mon, Aug 14, 2023, 10:51 AM Agam More ***@***.***> wrote: It is written in the docs but isn't implemented in the CLI. — Reply to this email directly, view it on GitHub <#20>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABDAN45SEVPGXEWMAC7WBTXVJQQVANCNFSM6AAAAAA3QATUE4> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[agamm]

Yeah but how can I create the execution id? from the docs it seems like it is part of the cli to use the SQL for athena.

I tried manually editing and running athena_query.sh but it's not working i'm getting things like:

[+] Populating athena with database ╷
│ Warning: No outputs found
│ 
│ The state file either has no outputs defined, or all the defined outputs are empty. Please define an output in your configuration
│ with the `output` keyword and run `terraform refresh` for it to become available. If you are using interpolation, please verify the
│ interpolated value is not empty. You can use the `terraform console` command to assist.
╵ and workgroup ╷
│ Warning: No outputs found

I also tried manually logging into Athena but there there is no s3 bucket connected either.

[c6fc]

Use the console

…

On Mon, Aug 14, 2023, 11:07 AM Agam More ***@***.***> wrote: Yeah but how can I create the execution id? from the docs it seems like it is part of the cli to use the SQL for athena. — Reply to this email directly, view it on GitHub <#20 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABDAN4FPFG6GNJR3WR6HK3XVJSN5ANCNFSM6AAAAAA3QATUE4> . You are receiving this because you commented.Message ID: ***@***.***>

[agamm]

Use the console
…
On Mon, Aug 14, 2023, 11:07 AM Agam More @.> wrote: Yeah but how can I create the execution id? from the docs it seems like it is part of the cli to use the SQL for athena. — Reply to this email directly, view it on GitHub <#20 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABDAN4FPFG6GNJR3WR6HK3XVJSN5ANCNFSM6AAAAAA3QATUE4 . You are receiving this because you commented.Message ID: @.>

I tried, as I've edited in the last comment, it wants me to connect an S3 Bucket, when I do create an s3 I get: TABLE_NOT_FOUND: line 1:91: Table 'awsdatacatalog.warcannon_commoncrawl.ccindex' does not exist

[c6fc]

Use the warcannon Athena workspace that deploy created for you.

…

On Mon, Aug 14, 2023, 11:26 AM Agam More ***@***.***> wrote: Use the console … <#m_-7073144828665659628_> On Mon, Aug 14, 2023, 11:07 AM Agam More *@*.*> wrote: Yeah but how can I create the execution id? from the docs it seems like it is part of the cli to use the SQL for athena. — Reply to this email directly, view it on GitHub <#20 (comment) <#20 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABDAN4FPFG6GNJR3WR6HK3XVJSN5ANCNFSM6AAAAAA3QATUE4 <https://github.com/notifications/unsubscribe-auth/AABDAN4FPFG6GNJR3WR6HK3XVJSN5ANCNFSM6AAAAAA3QATUE4> . You are receiving this because you commented.Message ID: @.*> I tried, as I've edited in the last comment, it wants me to connect an S3 Bucket, when I do create an s3 I get: TABLE_NOT_FOUND: line 1:91: Table 'awsdatacatalog.warcannon_commoncrawl.ccindex' does not exist — Reply to this email directly, view it on GitHub <#20 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABDANY66A3E4S5IIBLSQE3XVJUUTANCNFSM6AAAAAA3QATUE4> . You are receiving this because you commented.Message ID: ***@***.***>

[agamm]

Thanks, but it still doesn't work (even after warcannon deploy -y and I even tried warcannon populate 2023-23

TABLE_NOT_FOUND: line 1:91: Table 'awsdatacatalog.warcannon_commoncrawl.ccindex' does not exist

[c6fc]

Are you using the warcannon workspace in the Athena console?

…

On Mon, Aug 14, 2023, 11:49 AM Agam More ***@***.***> wrote: Thanks, but it still doesn't work (even after warcannon deploy -y and I even tried warcannon populate 2023-23 TABLE_NOT_FOUND: line 1:91: Table 'awsdatacatalog.warcannon_commoncrawl.ccindex' does not exist — Reply to this email directly, view it on GitHub <#20 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABDANZQIZYHCQBTQCP4R5TXVJXNBANCNFSM6AAAAAA3QATUE4> . You are receiving this because you commented.Message ID: ***@***.***>

[agamm]

Yes:

[c6fc]

I'll test it tomorrow when I'm done traveling

…

On Mon, Aug 14, 2023, 11:59 AM Agam More ***@***.***> wrote: Yes: [image: image] <https://user-images.githubusercontent.com/1269911/260546529-88427e83-d02d-498e-91b6-18f5fba308e9.png> — Reply to this email directly, view it on GitHub <#20 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AABDAN7RHS7XGNIIDFDHINTXVJYRHANCNFSM6AAAAAA3QATUE4> . You are receiving this because you commented.Message ID: ***@***.***>

[agamm]

I think there isn't the table (if you look at the left bottom side). I'll try to create it manually.

EDIT:
I've created the table and partitioned it like in populate_athena.sh, and after running the query when I try to warcannon populateAthena myidhere I get:

 warcannon populateAthena 328a968f-283a-4ef5-9507-xxx
[*] Loading job. Please wait...
[+] Loader completed successfully. Received response:
{"errorType":"string","errorMessage":"No queryExecutionId specified. Use a payload like {\"queryExecutionId\": \"ed8488d3-df35-40dd-80cd-fbfe722dc7d3\"}","trace":[]}

[agamm]

@c6fc Did my last comment help?