Merge branch 'master' into pr-4941

* master: (523 commits)
  DI: relax upper bound for reported long method duration (#5113)
  Change development guide to use Ruby 3.4 by default (#5112)
  Fix exception in RC on OpenFeature::Engine absence
  [🤖] Update Latest Dependency: https://github.com/DataDog/dd-trace-rb/actions/runs/19996135509
  [🤖] Update System Tests: https://github.com/DataDog/dd-trace-rb/actions/runs/19996155319
  Add ruby guikld to all dsm files
  add DSM to codeowners
  feat: add process tags to traces (#5033)
  DEBUG-3558 DI: chunk snapshot payloads (#5086)
  CI: enable push_to_test_optimization unless this is a pull request from a fork
  fix steep checks
  [🤖] Lock Dependency: https://github.com/DataDog/dd-trace-rb/actions/runs/19827679824
  [🤖] Lock Dependency: https://github.com/DataDog/dd-trace-rb/actions/runs/19827296218
  Add test to verify consumer backlog serialization with kafka_commit tag
  Remove one diagnostic output
  Install rubygems
  Add diagnostic steps
  Use default rubygems+bundler for each Ruby version
  Revert "Disable profiling specs for 4.0"
  Use git `datadog-ruby_core_source` having 4.0
  ...

Author: p

.cursor/rules/architecture.mdc

@@ -0,0 +1,38 @@
+---
+description:
+globs:
+alwaysApply: false
+---
+# Architecture and Design
+
+This library provides tools to get visibility into the performance and security of Ruby applications.
+This includes distributed tracing, profiling, app & api protection, dynamic instrumentation, metrics emission, open feature, etc.
+
+## Project Structure
+
+- @lib/datadog/appsec - app & api protection implementation (formely known as appsec)
+- @lib/datadog/appsec/contrib - app & api protection integrations with third-party libraries
+- @lib/datadog/core - glue and shared code
+- @lib/datadog/di - dynamic instrumentation
+- @lib/datadog/open_feature - an implementation of OpenFeature Provider https://openfeature.dev/docs/reference/sdks/server/ruby
+- @lib/datadog/profiling - profiling
+- @lib/datadog/tracing - distributed tracing
+- @lib/datadog/tracing/contrib - distributed tracing integrations with third-party libraries
+- @spec/ - Library test suite
+- @ext/datadog_profiling_native_extension - native extension for profiling
+- @ext/libdatadog_api - native extension for libdatadog apis
+- @docs/ - Developer documentation. Includes API documentation, upgrade guides, etc.
+
+## Integration Pattern
+
+Each framework integration follows a common pattern:
+1. `patcher.rb` - Modifies framework behavior
+2. `integration.rb` - Describes the integration
+3. `ext.rb` - Constants specific to the integration
+4. `configuration/settings.rb` - Integration-specific settings
+
+## Native Extensions
+
+The library uses native extensions which requires using Ruby C API.
+
+The native extension is in `ext/` directory and compiled for each Ruby version.

.cursor/rules/code-style.mdc

@@ -0,0 +1,40 @@
+---
+description:
+globs:
+alwaysApply: true
+---
+
+## Ruby usage
+
+- We use Ruby 2.5 syntax
+- Use exceptions for exceptional cases, not for control flow.
+- Implement proper error logging and user-friendly messages.
+
+## Type checking
+
+- RBS is used for static type checking
+- Type definitions are in the `sig/` directory
+- Update type definitions when modifying code
+- Run `bundle exec rake steep:check` to verify type correctness
+- Always run `bundle exec rake steep:check` after any update to RBS files
+- When deleting Ruby files, delete corresponding RBS file. Run `bundle exec rake rbs:clean` to make sure that there are no unnecessary RBS files.
+- Avoid using `untyped` type, use it only when it is not feasible to derive the correct type
+- Do not write types like `(nil | Type)`, use `Type?` instead
+- See [StaticTypingGuide.md](mdc:docs/StaticTypingGuide.md) for details
+
+## Code Quality
+
+- @standardrb is used for code style enforcement
+- Run `bundle exec standardrb` to check code quality
+- Ensure all code passes style checks before submitting
+
+## Commands
+
+- %steep run `bundle exec rake steep:check`. If there are typechecking errors, examine and fix them.
+- %rbs for the files the current context examine the current changes and fix (or create) corresponding rbs files
+
+## Commits and Pull Requests
+
+When creating a pull request and committing code, follow the [PULL_REQUEST_TEMPLATE.md](mdc:.github/PULL_REQUEST_TEMPLATE.md) template.
+
+When submitting a pull request that includes a significant amount of AI-generated code, this must be disclosed using the specific repository label "AI Generated" and at the top of the description.

.cursor/rules/testing.mdc

@@ -0,0 +1,28 @@
+---
+description: when editing or running tests
+globs:
+alwaysApply: false
+---
+# Testing Guidelines
+
+## Writing Tests
+
+- Tests are written using [RSpec](mdc:https:/rspec.info)
+- Test files should mirror the structure of `lib`
+- All changes should be covered by corresponding tests
+- If new files in the repository are created, run `git add -A` before running tests (otherwise `release_gem_spec.rb` will fail)
+- Do not use `instance_variable_set` and `instance_variable_get` in tests, use mocking when needed
+- Do not make changes to `release_gem_spec.rb` if not asked
+- Do not use focused tests feature (fit, fdescribe)
+
+## Running Tests
+
+- Run core library tests: `bundle exec rake test:main`
+- Run a specific test/file from core library tests: `bundle exec rspec <relative path to the file>`
+
+## Appraisal Groups
+
+- Dependency configurations are managed with [Appraisal](mdc:https:/github.com/thoughtbot/appraisal)
+- Group definitions are in `Appraisals`
+- Generate gemfiles with `bundle exec appraisal generate`
+- Install dependencies with `bundle exec appraisal install`

.env

@@ -3,6 +3,8 @@ DD_AGENT_HOST=testagent
 DD_API_KEY=00000000000000000000000000000000
 DD_METRIC_AGENT_PORT=8125
 DD_TRACE_AGENT_PORT=9126
+OTLP_HTTP_PORT=4318
+OTLP_GRPC_PORT=4317
 
 # Values are used for proxying from APM Test Agent to real Datadog Agent
 DD_REAL_AGENT_HOST=ddagent

.github/CODEOWNERS

@@ -14,17 +14,21 @@ lib/datadog/opentelemetry.rb @DataDog/apm-sdk-capabilities-ruby
 lib-injection/ @DataDog/lang-platform-ruby
 lib/datadog/profiling/ @DataDog/profiling-rb @DataDog/ruby-guild
 lib/datadog/profiling.rb @DataDog/profiling-rb @DataDog/ruby-guild
+lib/datadog/data_streams/ @DataDog/data-streams-monitoring @DataDog/ruby-guild
+lib/datadog/data_streams.rb @DataDog/data-streams-monitoring @DataDog/ruby-guild
 ext/ @DataDog/profiling-rb @DataDog/ruby-guild
 
 # RBS signatures
-sig/datadog/appsec/ @DataDog/asm-ruby
-sig/datadog/appsec.rbs @DataDog/asm-ruby
-sig/datadog/tracing/ @DataDog/apm-idm-ruby @DataDog/apm-sdk-capabilities-ruby
-sig/datadog/tracing.rbs @DataDog/apm-idm-ruby @DataDog/apm-sdk-capabilities-ruby
-sig/datadog/opentelemetry/ @DataDog/apm-sdk-capabilities-ruby
-sig/datadog/opentelemetry.rbs @DataDog/apm-sdk-capabilities-ruby
+sig/datadog/appsec/ @DataDog/asm-ruby @DataDog/ruby-guild
+sig/datadog/appsec.rbs @DataDog/asm-ruby @DataDog/ruby-guild
+sig/datadog/tracing/ @DataDog/apm-idm-ruby @DataDog/apm-sdk-capabilities-ruby @DataDog/ruby-guild
+sig/datadog/tracing.rbs @DataDog/apm-idm-ruby @DataDog/apm-sdk-capabilities-ruby @DataDog/ruby-guild
+sig/datadog/opentelemetry/ @DataDog/apm-sdk-capabilities-ruby @DataDog/ruby-guild
+sig/datadog/opentelemetry.rbs @DataDog/apm-sdk-capabilities-ruby @DataDog/ruby-guild
 sig/datadog/profiling/ @DataDog/profiling-rb @DataDog/ruby-guild
 sig/datadog/profiling.rbs @DataDog/profiling-rb @DataDog/ruby-guild
+sig/datadog/data_streams/ @DataDog/data-streams-monitoring @DataDog/ruby-guild
+sig/datadog/data_streams.rbs @DataDog/data-streams-monitoring @DataDog/ruby-guild
 
 # Specs
 spec/datadog/appsec/ @DataDog/asm-ruby
@@ -34,3 +38,4 @@ spec/datadog/opentelemetry/ @DataDog/apm-sdk-capabilities-ruby
 spec/datadog/opentelemetry_spec.rb @DataDog/apm-sdk-capabilities-ruby
 spec/datadog/profiling/ @DataDog/profiling-rb @DataDog/ruby-guild
 spec/datadog/profiling_spec.rb @DataDog/profiling-rb @DataDog/ruby-guild
+spec/datadog/data_streams/ @DataDog/data-streams-monitoring @DataDog/ruby-guild

.github/actions/build-test/action.yml

@@ -30,6 +30,12 @@ runs:
     env:
       COVERAGE_DIR: coverage/versions/${{ inputs.alias }}/${{ inputs.container-id }}
 
+  - name: Display debug info
+    if: ${{ !cancelled() }}
+    shell: bash
+    run: |
+      df -h
+
   - name: Debug with SSH connection
     if: ${{ failure() && runner.debug == '1' }}
     uses: mxschmitt/action-tmate@7b6a61a73bbb9793cb80ad69b8dd8ac19261834c # v3.19.0

.github/actions/bundle-cache/action.yml

@@ -29,12 +29,12 @@ runs:
         bundle lock
         echo "lockfile=$LOCKFILE" >> "$GITHUB_OUTPUT"
     - name: Upload lockfile
-      uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4.6.2
+      uses: actions/upload-artifact@330a01c490aca151604b8cf639adc76d48f6c5d4 # v5.0.0
       with:
         name: ${{ steps.lockfile.outputs.lockfile }}
         path: "*.lock"
     - name: Restore cache
-      uses: actions/cache/restore@5a3ec84eff668545956fd18022155c47e93e2684 # v4.2.3
+      uses: actions/cache/restore@0057852bfaa89a56745cba8c7296529d2fc39830 # v4.3.0
       id: restore-cache
       with:
         key: bundle-${{ runner.os }}-${{ runner.arch }}-${{ steps.ruby-alias.outputs.ruby-alias }}-${{ hashFiles('*.lock') }}
@@ -44,7 +44,7 @@ runs:
       run: bundle install
     - if: steps.restore-cache.outputs.cache-hit != 'true'
       name: Save cache
-      uses: actions/cache/save@5a3ec84eff668545956fd18022155c47e93e2684 # v4.2.3
+      uses: actions/cache/save@0057852bfaa89a56745cba8c7296529d2fc39830 # v4.3.0
       with:
         key: "${{ steps.restore-cache.outputs.cache-primary-key }}"
         path: "/usr/local/bundle"

.github/actions/bundle-restore/action.yml

@@ -15,12 +15,12 @@ runs:
   using: composite
   steps:
   - name: Download lockfile
-    uses: actions/download-artifact@d3f86a106a0bac45b974a628896c90dbdf5c8093 # v4.3.0
+    uses: actions/download-artifact@018cc2cf5baa6db3ef3c5f8a56943fffe632ef53 # v6.0.0
     with:
       name: ${{ inputs.lockfile }}
 
   - name: Restore cache
-    uses: actions/cache/restore@5a3ec84eff668545956fd18022155c47e93e2684 # v4.2.3
+    uses: actions/cache/restore@0057852bfaa89a56745cba8c7296529d2fc39830 # v4.3.0
     id: restore-cache
     with:
       key: "${{ inputs.cache-key }}"

.github/forced-tests-list.cfg

@@ -10,3 +10,6 @@
 
 # Example :
 # tests/parametric/test_config_consistency.py::Test_Stable_Config_Default::test_config_precedence
+
+tests/test_config_consistency.py::Test_Config_HttpClientErrorStatuses_FeatureFlagCustom
+tests/test_config_consistency.py::Test_Config_HttpServerErrorStatuses_FeatureFlagCustom