feat(logs): periodically remove unused entry from dict by TheSafo · Pull Request #49494 · DataDog/datadog-agent

TheSafo · 2026-04-16T23:38:10Z

What does this PR do?

Motivation

Describe how you validated your changes

Additional Notes

TheSafo · 2026-04-16T23:38:36Z

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

This stack of pull requests is managed by Graphite. Learn more about stacking.

agent-platform-auto-pr · 2026-04-16T23:45:47Z

Go Package Import Differences

Baseline: a903409
Comparison: 018191a

binary	os	arch	change
agent	linux	amd64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
agent	linux	arm64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
agent	windows	amd64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
agent	darwin	amd64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
agent	darwin	arm64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
iot-agent	linux	amd64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
iot-agent	linux	arm64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
heroku-agent	linux	amd64	+11, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust/flatbuffers/patterns +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/google/flatbuffers/go
cluster-agent	linux	amd64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
cluster-agent	linux	arm64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
cluster-agent-cloudfoundry	linux	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
cluster-agent-cloudfoundry	linux	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
dogstatsd	linux	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
dogstatsd	linux	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
process-agent	linux	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
process-agent	linux	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
process-agent	windows	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
process-agent	darwin	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
process-agent	darwin	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
heroku-process-agent	linux	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
security-agent	linux	amd64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
security-agent	linux	arm64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
security-agent	windows	amd64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
system-probe	linux	amd64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
system-probe	linux	arm64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
system-probe	windows	amd64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
system-probe	darwin	amd64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
system-probe	darwin	arm64	+10, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc +github.com/DataDog/datadog-agent/pkg/trace/log
otel-agent	linux	amd64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
otel-agent	linux	arm64	+9, -0 +github.com/DataDog/agent-payload/v5/statefulpb +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering +github.com/DataDog/datadog-agent/pkg/logs/patterns/clustering/merging +github.com/DataDog/datadog-agent/pkg/logs/patterns/eviction +github.com/DataDog/datadog-agent/pkg/logs/patterns/processor +github.com/DataDog/datadog-agent/pkg/logs/patterns/tags +github.com/DataDog/datadog-agent/pkg/logs/patterns/token +github.com/DataDog/datadog-agent/pkg/logs/patterns/tokenizer/rust +github.com/DataDog/datadog-agent/pkg/logs/sender/grpc
privateactionrunner	linux	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
privateactionrunner	linux	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
privateactionrunner	windows	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
privateactionrunner	darwin	amd64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb
privateactionrunner	darwin	arm64	+1, -0 +github.com/DataDog/agent-payload/v5/statefulpb

agent-platform-auto-pr · 2026-04-17T00:05:58Z

Files inventory check summary

File checks results against ancestor a9034095:

Results for datadog-agent_7.79.0~devel.git.460.01f3062.pipeline.108341187-1_amd64.deb:

Detected file changes:

1 Added files:

opt/datadog-agent/embedded/lib/libpatterns.so (1.62 MiB)

TheSafo mentioned this pull request Apr 16, 2026

fix(logs): send delete on tag eviction #49493

Draft

TheSafo changed the title ~~tag~~ jsaf/ttl-sweep Apr 16, 2026

DDuongNguyen mentioned this pull request Apr 17, 2026

feat(logs): max template size limit + json_as_raw raw bypass #49552

Draft

TheSafo changed the base branch from jsaf/evict-correctly to graphite-base/49494 April 17, 2026 21:22

TheSafo changed the base branch from graphite-base/49494 to jsaf/evict-correctly April 17, 2026 21:22

TheSafo changed the base branch from jsaf/evict-correctly to graphite-base/49494 April 17, 2026 21:22

TheSafo force-pushed the jsaf/ttl-sweep branch from 5aaebf4 to 01f3062 Compare April 17, 2026 21:23

TheSafo changed the base branch from graphite-base/49494 to yoon/max-template-raw-bypass April 17, 2026 21:23

TheSafo force-pushed the jsaf/ttl-sweep branch from 01f3062 to 5d623f8 Compare April 20, 2026 20:15

This was referenced Apr 20, 2026

local proto plus servic #49628

Draft

better json #49672

Draft

TheSafo force-pushed the jsaf/ttl-sweep branch from 5d623f8 to 9ad8c29 Compare April 21, 2026 21:30

DDuongNguyen changed the base branch from yoon/max-template-raw-bypass to graphite-base/49494 April 23, 2026 16:12

DDuongNguyen force-pushed the graphite-base/49494 branch from 0bb9291 to 899a7e2 Compare April 23, 2026 16:12

DDuongNguyen force-pushed the jsaf/ttl-sweep branch from 9ad8c29 to 5aaebf4 Compare April 23, 2026 16:12

DDuongNguyen changed the base branch from graphite-base/49494 to 04-10-feat_logs_wire_stateful_encoding_into_log_agent_pipeline April 23, 2026 16:13

DDuongNguyen mentioned this pull request Apr 23, 2026

fix(logs): staging fidelity fixes — tabs, newlines, Unicode positions, UTF-8 safety #49810

Draft

tag

018191a

TheSafo changed the base branch from 04-10-feat_logs_wire_stateful_encoding_into_log_agent_pipeline to graphite-base/49494 April 24, 2026 13:51

TheSafo force-pushed the jsaf/ttl-sweep branch from 5aaebf4 to 018191a Compare April 24, 2026 13:53

TheSafo changed the base branch from graphite-base/49494 to yoon/max-template-raw-bypass April 24, 2026 13:53

TheSafo changed the title ~~jsaf/ttl-sweep~~ feat(logs): periodically remove unused entry from dict Apr 24, 2026

This was referenced May 4, 2026

flat-log-encoding #50321

Draft

extedned json nesting #50347

Draft

jsaf/flatten-json-encoding-values #50349

Draft

json presence #50402

Draft

inflight fixes #50530

Draft

jsaf/updated-inflight-eviction #50557

Draft

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(logs): periodically remove unused entry from dict#49494

feat(logs): periodically remove unused entry from dict#49494
TheSafo wants to merge 1 commit intoyoon/max-template-raw-bypassfrom
jsaf/ttl-sweep

TheSafo commented Apr 16, 2026

Uh oh!

TheSafo commented Apr 16, 2026 •

edited

Loading

Uh oh!

agent-platform-auto-pr Bot commented Apr 16, 2026 •

edited

Loading

Uh oh!

agent-platform-auto-pr Bot commented Apr 17, 2026 •

edited

Loading

1 Added files:

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

TheSafo commented Apr 16, 2026

What does this PR do?

Motivation

Describe how you validated your changes

Additional Notes

Uh oh!

TheSafo commented Apr 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

agent-platform-auto-pr Bot commented Apr 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Go Package Import Differences

Uh oh!

agent-platform-auto-pr Bot commented Apr 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Files inventory check summary

Results for datadog-agent_7.79.0~devel.git.460.01f3062.pipeline.108341187-1_amd64.deb:

Detected file changes:

1 Added files:

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

TheSafo commented Apr 16, 2026 •

edited

Loading

agent-platform-auto-pr Bot commented Apr 16, 2026 •

edited

Loading

agent-platform-auto-pr Bot commented Apr 17, 2026 •

edited

Loading