API that uses AWS Athena to query NCCS data archives
Query Structure:
{
"User": {
"name": name,
"email": email
},
"variables": [
"column 1",
"column 2"
],
"filters": {
"column 1" : [
"value 1",
"value 2"
]
}
}
A lambda function:
- Creates an SQL Query from "variables" and "filters"
- Executes the SQL Query on a parquet file
- Outputs the result to an NCCS bucket
- Sends the email provided with the query an update letting them know their data is ready
Architecture: link