Skip to content

Add logs for storage pools reordering#10419

Merged
DaanHoogland merged 4 commits intoapache:4.22from
scclouds:add-logs-storage-pool-reordering
Apr 14, 2026
Merged

Add logs for storage pools reordering#10419
DaanHoogland merged 4 commits intoapache:4.22from
scclouds:add-logs-storage-pool-reordering

Conversation

@julien-vaz
Copy link
Copy Markdown
Contributor

Description

Since the storage pool reordering process was lacking logs for troubleshooting, some debug level log messages were added and trace level log messages were changed to the debug level. Also, the log messages were rewritten according to the new Log4j2 syntax.

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)
  • build/CI
  • test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

How Has This Been Tested?

  1. A volume was created;
  2. Its disk offering was changed;
  3. It was verified that the log messages were properly being displayed.

@boring-cyborg
Copy link
Copy Markdown

boring-cyborg Bot commented Feb 18, 2025

Congratulations on your first Pull Request and welcome to the Apache CloudStack community! If you have any issues or are unsure about any anything please check our Contribution Guide (https://github.com/apache/cloudstack/blob/main/CONTRIBUTING.md)
Here are some useful points:

@codecov
Copy link
Copy Markdown

codecov Bot commented Feb 18, 2025

Codecov Report

❌ Patch coverage is 20.00000% with 24 lines in your changes missing coverage. Please review.
✅ Project coverage is 17.62%. Comparing base (7324ef4) to head (7be068d).
⚠️ Report is 77 commits behind head on 4.22.

Files with missing lines Patch % Lines
...torage/allocator/AbstractStoragePoolAllocator.java 20.00% 24 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff            @@
##               4.22   #10419   +/-   ##
=========================================
  Coverage     17.62%   17.62%           
- Complexity    15668    15669    +1     
=========================================
  Files          5917     5917           
  Lines        531255   531253    -2     
  Branches      64951    64947    -4     
=========================================
+ Hits          93639    93641    +2     
+ Misses       427077   427075    -2     
+ Partials      10539    10537    -2     
Flag Coverage Δ
uitests 3.70% <ø> (ø)
unittests 18.69% <20.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link
Copy Markdown
Contributor

@DaanHoogland DaanHoogland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

one general remark on these changes; I see only trace and debug logs, but if axtra logs are really needed I would expect at least hight level logging to be added (info and higher) were considerations made to do this? (DEBUG should not be on in production environments in principle, unless trouble shooting is going on)

@julien-vaz
Copy link
Copy Markdown
Contributor Author

Alright, I've just changed the level of logs on reordering methods, @DaanHoogland

Copy link
Copy Markdown
Contributor

@DaanHoogland DaanHoogland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

makes mostly sense, just one info i'd like to question.

@julien-vaz
Copy link
Copy Markdown
Contributor Author

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@julien-vaz a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link
Copy Markdown

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ debian ✔️ suse15. SL-JID 12691

Copy link
Copy Markdown
Contributor

@DaanHoogland DaanHoogland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clgtm

Copy link
Copy Markdown
Member

@bernardodemarco bernardodemarco left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clgtm

@github-actions
Copy link
Copy Markdown

This pull request has merge conflicts. Dear author, please fix the conflicts and sync your branch with the base branch.

@JoaoJandre
Copy link
Copy Markdown
Contributor

@julien-vaz could you fix the conflicts?

@julien-vaz
Copy link
Copy Markdown
Contributor Author

@julien-vaz could you fix the conflicts?

Sure!

@julien-vaz julien-vaz force-pushed the add-logs-storage-pool-reordering branch from 53c59bf to 04e69aa Compare June 4, 2025 21:26
@sureshanaparti sureshanaparti added this to the 4.21.0 milestone Jun 5, 2025
@sureshanaparti
Copy link
Copy Markdown
Contributor

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link
Copy Markdown

Packaging result [SF]: ✔️ el8 ✔️ el9 ✖️ debian ✔️ suse15. SL-JID 13617

@DaanHoogland
Copy link
Copy Markdown
Contributor

@blueorangutan test

@blueorangutan
Copy link
Copy Markdown

@DaanHoogland a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

@blueorangutan
Copy link
Copy Markdown

[SF] Trillian test result (tid-13481)
Environment: kvm-ol8 (x2), Advanced Networking with Mgmt server ol8
Total time taken: 57861 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10419-t13481-kvm-ol8.zip
Smoke tests completed. 141 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

@DaanHoogland
Copy link
Copy Markdown
Contributor

@sureshanaparti , do you think we need anymore testing on this? (/me not convinced)

@julien-vaz
Copy link
Copy Markdown
Contributor Author

julien-vaz commented Jun 23, 2025

I've just built the packages locally, so I'm triggering the Blue Orangutan again.

@julien-vaz
Copy link
Copy Markdown
Contributor Author

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@julien-vaz a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Julien Hervot de Mattos Vaz and others added 2 commits February 12, 2026 08:38
…ocator/AbstractStoragePoolAllocator.java

Co-authored-by: dahn <daan.hoogland@gmail.com>
Copy link
Copy Markdown
Collaborator

@erikbocks erikbocks left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clgtm

@erikbocks
Copy link
Copy Markdown
Collaborator

Hello, @borisstoyanov and @rajujith

The conflicts were solved, can we move forward with this PR? I think it is ready to be merged.

@DaanHoogland
Copy link
Copy Markdown
Contributor

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@DaanHoogland a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@sureshanaparti
Copy link
Copy Markdown
Contributor

@julien-vaz @erikbocks can you check the build errors.

Error:  testregisterBackupForVMwithOutSsid(org.apache.backup.networker.NetworkerClientTest)  Time elapsed: 0.387 s  <<< FAILURE!
...
Error:    NetworkerClientTest.testregisterBackupForVMwithOutSsid:637 No requests exactly matched. Most similar request was:  expected:<

@blueorangutan
Copy link
Copy Markdown

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 16813

@erikbocks
Copy link
Copy Markdown
Collaborator

@sureshanaparti I runned the tests locally and no problem was found. I will trigger the build again.

@erikbocks erikbocks closed this Feb 12, 2026
@erikbocks erikbocks reopened this Feb 12, 2026
@sureshanaparti
Copy link
Copy Markdown
Contributor

@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@sureshanaparti a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan
Copy link
Copy Markdown

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 17450

@DaanHoogland
Copy link
Copy Markdown
Contributor

@blueorangutan test

@blueorangutan
Copy link
Copy Markdown

@DaanHoogland a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

@blueorangutan
Copy link
Copy Markdown

[SF] Trillian test result (tid-15857)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 49952 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10419-t15857-kvm-ol8.zip
Smoke tests completed. 147 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File
test_03_ping_in_ssvm_success Failure 15.39 test_diagnostics.py
test_05_ping_in_cpvm_success Failure 15.43 test_diagnostics.py
test_04_extract_Iso Failure 1.07 test_iso.py

@blueorangutan
Copy link
Copy Markdown

[SF] Trillian test result (tid-15860)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 49500 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr10419-t15860-kvm-ol8.zip
Smoke tests completed. 149 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test Result Time (s) Test File

@DaanHoogland
Copy link
Copy Markdown
Contributor

@sureshanaparti , I think this is ready for merge. Only logging and integration tests pass in the lab, GHA don’t all pass, but that seems like a more generic issue than this PR. What do you think?

@sureshanaparti
Copy link
Copy Markdown
Contributor

@sureshanaparti , I think this is ready for merge. Only logging and integration tests pass in the lab, GHA don’t all pass, but that seems like a more generic issue than this PR. What do you think?

agree @DaanHoogland

@DaanHoogland DaanHoogland merged commit 161b417 into apache:4.22 Apr 14, 2026
36 of 49 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in Apache CloudStack 4.22.1 Apr 14, 2026
dhslove added a commit to dhslove/ablestack-cloud that referenced this pull request Apr 21, 2026
Source Apache commits:\n- 161b417 Add logs for storage pools reordering (apache#10419)\n\nChange summary:\n- expand allocator logging around pool reordering, shuffle, disk provisioning, and search boundaries\n- route userconcentratedpod_random through the random reorder path\n\nFunctional impact:\n- improves observability when debugging storage allocator decisions\n- preserves random pool reordering behavior for legacy userconcentratedpod_random configurations\n\nConflict handling:\n- apache cherry-pick conflicted in reorderStoragePoolsBasedOnAlgorithm because local/main had drifted\n- resolved by keeping the apache condition and updated logging behavior\n\nVerification:\n- conflict markers removed and resolved allocator method inspected\n- mvn/mvnw not available in this workspace, so module compile could not be run
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.