Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

out_azure_kusto: OTEL logs not showing up correctly with in_opentelemetry plugin #10065

Open
dceravigupta opened this issue Mar 10, 2025 · 1 comment

Comments

@dceravigupta
Copy link
Contributor

dceravigupta commented Mar 10, 2025

I'm trying to send my application OTEL logs using fluent-bit to an Azure Kusto database but seems like each OTEL logs is getting split into multiple logs rows when it finally getting ingested into kusto.

I'm noticing this behavior with other output plugins as well like stdout. For example -

[62] v1_logs: [[-1.000000000, {"schema"=>"otlp", "resource_id"=>0, "scope_id"=>11}], {"resource"=>{"attributes"=>{"telemetry.sdk.name"=>"opentelemetry", "telemetry.sdk.language"=>"dotnet", "telemetry.sdk.version"=>"1.8.1", "service.name"=>"unknown_service:dotnet"}}, "schema_url"=>"", "scope"=>{"name"=>"Microsoft.Extensions.HttpClient.Logging.Internal.HttpLoggingHandler"}}]
[63] v1_logs: [[1741372257.966227535, {"otlp"=>{"observed_timestamp"=>1741372257825108400, "timestamp"=>1741372257825108400, "severity_number"=>17, "severity_text"=>"Error", "attributes"=>{"resolved_host"=>"<some url>.com", "httpMethod"=>"GET", "httpHost"=>"<removed>", "httpPath"=>"<removed>", "duration"=>274, "{OriginalFormat}"=>"{httpMethod} {httpHost}/{httpPath}", "httpStatusCode"=>401}, "trace_flags"=>0}}], {"message"=>"GET <removed>"}]
[64] v1_logs: [[-2.000000000, {}], {}]
@dceravigupta
Copy link
Contributor Author

@edsiper wondering is it similar to #10002 which you are tracking? And is the plan to take care for it all the output plugins?

@dceravigupta dceravigupta changed the title out_azure_kusto: Logs not showing up correctly with in_opentelemetry plugin out_azure_kusto: OTEL logs not showing up correctly with in_opentelemetry plugin Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant