Skip to content

Commit fda5ccc

Browse files
authored
Enable embedding always (#128)
When turned on, embedding (compute + storage) accounts for a small fraction of one percent of all inference costs. Considering the fixed infrastructure costs as well, the cost of embedding is a negligible cost. So we will now always compute embeddings for all documents submitted for redaction, whether we currently need it or not. This will give us more information if we need it in the future, with really no downside even if we never need them.
1 parent 8e3c669 commit fda5ccc

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

terraform/app_config.tf

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,8 @@ host = "${local.mssql_fqdn}"
1717
database = "${azurerm_mssql_database.main.name}"
1818
EOF
1919

20-
# Add an embedding configuration when the research environment is enabled.
21-
embedding_config = !var.enable_research_env ? "" : <<EOF
20+
# Config for embedding model
21+
embedding_config = <<EOF
2222
[experiments.embedding]
2323
[experiments.embedding.client]
2424
azure_endpoint = "${local.openai_endpoint}"

0 commit comments

Comments
 (0)