Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Warning is observed huge number of times 'input V2 factory.CheckConfig failed to clone config before checking it. Original config will be checked, it might trigger an input duplication warning: failed to get 'id': missing field accessing 'id'' #42763

Open
Sunanda533 opened this issue Feb 19, 2025 · 1 comment
Labels
needs_team Indicates that the issue/PR needs a Team:* label

Comments

@Sunanda533
Copy link

Hi,
There is one small clarification needed regarding the below warning.
Actually, when autodiscover is enabled and tried to deploy the service, we see the below warning repeated continuously with huge number of occurrences.
Warning:
input V2 factory.CheckConfig failed to clone config before checking it. Original config will be checked, it might trigger an input duplication warning: failed to get 'id': missing field accessing 'id'
Configuration used:

filebeat.inputs:
    - type: log
      paths:
      - /var/lib/docker/containers/**/*.log
      - /var/log/pods/**/*.log
      fields:
        logplane: "app-logs"
      fields_under_root: true
      tail_files: true
      close_timeout: "5m"
      id: "ls_id"
    filebeat.autodiscover:
      providers:
      - type: kubernetes
        namespace: "testnamespace"
        hints.enabled: true
        add_resource_metadata:
          deployment: false
          cronjob: false
          namespace:
            enabled: false
          node:
            enabled: false
        include_annotations:
        hints.default_config:
          type: container
          paths:
            - /var/log/pods/${data.kubernetes.namespace}_${data.kubernetes.pod.name}_${data.kubernetes.pod.uid}/${data.kubernetes.container.name}/*.log
        templates:
        appenders:
          - type: config
            config:
              fields:
                logplane: "app-logs"
              fields_under_root: true
              close_timeout: "5m"
              processors:
              - decode_json_fields:
                  fields: ["message"]
                  target: "json"
                  max_depth: 1
              - drop_event:
                  when:
                    or:
                      - not.or:
                          - equals:
                              kubernetes.labels.app: "loggen"
              - drop_fields:
                  fields:
                    - "kubernetes.annotations"
                  ignore_missing: true
    output.logstash:
      hosts: "logstash:5044"
      ssl.certificate_authorities: "${TRUSTED_INTERNAL_ROOT_CA_PATH}/ca.crt"
      ssl.certificate: "${LT_CLIENT_CERT_PATH}/${CERT}"
      ssl.key: "${LT_CLIENT_CERT_PATH}/${KEY}"
      ssl.verification_mode: "full"
      ssl.renegotiation: "freely"
      ssl.supported_protocols: ["TLSv1.2", "TLSv1.3"]
      ssl.cipher_suites: []
      bulk_max_size: 2048
      worker: 1
      pipelining: 0
      ttl: 30
      queue.mem:
        flush.timeout: 1s
    filebeat.registry.flush: 5s
    logging.level: "info"
    logging.metrics.enabled: false
    http.enabled: true
    http.host: localhost
    http.port: 5066

We just enabled autodiscover and deployed the service, then we observe huge number of warnings even though we did not add any filestream input.
Can you please let us know in which scenario this warning will be observed and what is the expected behavior and also how to avoid this warning to proceed further.

Thanks & regards,
Sunanda N.

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Feb 19, 2025
@botelastic
Copy link

botelastic bot commented Feb 19, 2025

This issue doesn't have a Team:<team> label.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs_team Indicates that the issue/PR needs a Team:* label
Projects
None yet
Development

No branches or pull requests

1 participant