Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alertmanager goroutine leak test flakes #9852

Open
seizethedave opened this issue Nov 8, 2024 · 0 comments
Open

Alertmanager goroutine leak test flakes #9852

seizethedave opened this issue Nov 8, 2024 · 0 comments

Comments

@seizethedave
Copy link
Contributor

seizethedave commented Nov 8, 2024

Describe the bug

I encountered a test flake in CI unrelated to my PR.
Here's the CI job.

--- FAIL: TestDistributor_DistributeRequest (21.47s)
    leak.go:14: found unexpected goroutines:
        [Goroutine 427 in state chan receive, with github.com/oklog/run.(*Group).Run on top of the stack:
        github.com/oklog/run.(*Group).Run(0xc00095cf10)
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:43 +0x251
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).Run(0xc0009de850)
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:108 +0x505
        created by github.com/grafana/mimir/pkg/alertmanager.(*Alertmanager).ApplyConfig in goroutine 217
        	/__w/mimir/mimir/pkg/alertmanager/alertmanager.go:544 +0x228b
         Goroutine 353 in state select, with github.com/prometheus/alertmanager/inhibit.(*Inhibitor).run on top of the stack:
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).run(0xc0009de850, {0x2cb9b58, 0xc001197900})
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:[65](https://github.com/grafana/mimir/actions/runs/11733801665/job/32688750912#step:8:66) +0x1d9
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).Run.func1()
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:102 +0x47
        github.com/oklog/run.(*Group).Run.func1({0xc0004e5340?, 0xc00119f1e0?})
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:38 +0x3a
        created by github.com/oklog/run.(*Group).Run in goroutine 427
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:37 +0xa5
        ]
--- FAIL: TestMultitenantAlertmanager_loadAndSyncConfigs (0.94s)
    leak.go:14: found unexpected goroutines:
        [Goroutine 427 in state chan receive, with github.com/oklog/run.(*Group).Run on top of the stack:
        github.com/oklog/run.(*Group).Run(0xc00095cf10)
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:43 +0x251
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).Run(0xc0009de850)
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:108 +0x505
        created by github.com/grafana/mimir/pkg/alertmanager.(*Alertmanager).ApplyConfig in goroutine 217
        	/__w/mimir/mimir/pkg/alertmanager/alertmanager.go:544 +0x228b
         Goroutine 353 in state select, with github.com/prometheus/alertmanager/inhibit.(*Inhibitor).run on top of the stack:
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).run(0xc0009de850, {0x2cb9b58, 0xc00119[79](https://github.com/grafana/mimir/actions/runs/11733801665/job/32688750912#step:8:80)00})
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:65 +0x1d9
        github.com/prometheus/alertmanager/inhibit.(*Inhibitor).Run.func1()
        	/__w/mimir/mimir/vendor/github.com/prometheus/alertmanager/inhibit/inhibit.go:102 +0x47
        github.com/oklog/run.(*Group).Run.func1({0xc0004e5340?, 0xc00119f1e0?})
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:38 +0x3a
        created by github.com/oklog/run.(*Group).Run in goroutine 427
        	/__w/mimir/mimir/vendor/github.com/oklog/run/group.go:37 +0xa5
        ]

Environment

  • GitHub actions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant