tests: try dracut on Debian too

[marmarek]

It isn't default there, but it is available, so test it too.

QubesOS/qubes-issues#8649

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2024112705-4.3&flavor=pull-requests

Test run included the following:

• Escape application names for GMarkup qubes-desktop-linux-menu#51 (QubesOS/qubes-desktop-linux-menu@feccd44)
• Fix up GPT partition tables automatically qubes-linux-utils#119 (QubesOS/qubes-linux-utils@f785c4b)
• Retire old qubes-vm-create dialog qubes-manager#393 (QubesOS/qubes-manager@210f867)
• tests: try dracut on Debian too #638 (d23f7e1)
• Make "multimedia" devices more detailed qubes-core-admin-client#322 (QubesOS/qubes-core-admin-client@95a2f69)
• Add dracut config to the Debian package too qubes-core-agent-linux#536 (QubesOS/qubes-core-agent-linux@e9e5b81)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025021804-4.3&flavor=update

• system_tests_basic_vm_qrexec_gui_zfs

  • switch_pool: Failed (test died)
    # Test died: command 'dnf install -y ./zfs-release.rpm' failed at /...

• system_tests_audio

  • TC_20_AudioVM_PipeWire_debian-12-xfce: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: too short audio, expected 10s, got 0.00013605442176...

• system_tests_kde_gui_interactive

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...

  • gui_keyboard_layout: Failed (test died)
    # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...

Failed tests

5 failures

• system_tests_basic_vm_qrexec_gui_zfs

  • switch_pool: Failed (test died)
    # Test died: command 'dnf install -y ./zfs-release.rpm' failed at /...

• system_tests_audio

  • TC_20_AudioVM_PipeWire_debian-12-xfce: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: too short audio, expected 10s, got 0.00013605442176...

  • [unstable] TC_20_AudioVM_PipeWire_fedora-40-xfce: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: too short audio, expected 10s, got 0.00013605442176...

• system_tests_kde_gui_interactive

  • gui_keyboard_layout: wait_serial (wait serial expected)
    # wait_serial expected: "echo -e '[Layout]\nLayoutList=us,de' | sud...

  • gui_keyboard_layout: Failed (test died)
    # Test died: command 'test "$(cd ~user;ls e1*)" = "$(qvm-run -p wor...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/129058#dependencies

15 fixed

• system_tests_whonix@hw7

  • whonixcheck: fail (unknown)
    Whonixcheck for sys-whonix failed...

  • whonixcheck: unnamed test (unknown)

• system_tests_suspend@hw1

  • suspend: unnamed test (unknown)
  • suspend: Failed (test died)
    # Test died: no candidate needle with tag(s) 'SUSPEND-FAILED' match...

• system_tests_whonix

  • whonixcheck: fail (unknown)
    Whonixcheck for sys-whonix failed...

  • whonixcheck: unnamed test (unknown)

• system_tests_suspend

  • suspend: unnamed test (unknown)
  • suspend: Failed (test died)
    # Test died: no candidate needle with tag(s) 'SUSPEND-FAILED' match...

• system_tests_qrexec

  • TC_00_Qrexec_whonix-workstation-17: test_070_qrexec_vm_simultaneous_write (failure)
    exited with non-zero code 125; stderr: b"dd: error writing 'standa...

• system_tests_audio

  • TC_20_AudioVM_Pulse_whonix-workstation-17: test_223_audio_play_hvm (failure)
    AssertionError: too short audio, expected 10s, got 7.33528344671201...

  • TC_20_AudioVM_PipeWire_whonix-workstation-17: test_226_audio_playback_pipewire (failure)
    AssertionError: too short audio, expected 10s, got 9.19027210884353...

  • TC_20_AudioVM_PipeWire_whonix-workstation-17: test_251_audio_playback_audiovm_pipewire_late_start (failure)
    AssertionError: too short audio, expected 10s, got 9.22900226757369...

• system_tests_basic_vm_qrexec_gui_btrfs

  • TC_03_QvmRevertTemplateChanges: test_000_revert_linux (error)
    subprocess.CalledProcessError: Command '['sha1sum', '/var/lib/qubes...

• system_tests_kde_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'clipboard-paste-notif...

Unstable tests

Details

• system_tests_audio@hw1

  TC_20_AudioVM_Pulse_fedora-40-xfce/test_223_audio_play_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_224_audio_rec_muted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_224_audio_rec_muted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_225_audio_rec_unmuted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_225_audio_rec_unmuted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_PipeWire_whonix-workstation-17/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)

  • job 115623 AssertionError: too short audio, expected 10s, got 9.34507936507936...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_fedora-40-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_PipeWire_fedora-40-xfce/test_260_audio_mic_enabled_switch_audiovm (2/5 times with errors)

  • job 116847 AssertionError: too short audio, expected 10s, got 0.00013605442176...
  • job 117586 AssertionError: too short audio, expected 10s, got 0.00013605442176...
  TC_20_AudioVM_PipeWire_whonix-workstation-17/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)

  • job 115623 AssertionError: too short audio, expected 10s, got 9.05353741496598...

• system_tests_pvgrub_salt_storage

  TC_41_HVMGrub_debian-12-xfce/test_000_standalone_vm (1/5 times with errors)

  • job 115648 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  TC_41_HVMGrub_fedora-40-xfce/test_000_standalone_vm (1/5 times with errors)

  • job 115648 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  TC_41_HVMGrub_debian-12-xfce/test_010_template_based_vm (1/5 times with errors)

  • job 115648 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  TC_41_HVMGrub_fedora-40-xfce/test_010_template_based_vm (1/5 times with errors)

  • job 115648 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

• system_tests_usbproxy

  TC_20_USBProxy_core3_fedora-40-xfce/test_070_attach_not_installed_front (1/5 times with errors)

  • job 117582 NameError: name 'santizied_stderr' is not defined

• system_tests_network_updates

  VmUpdates_debian-12-xfce/test_020_updates_available_notification (1/5 times with errors)

  • job 117610 subprocess.CalledProcessError: Command '/usr/lib/qubes/upgrades-sta...

• system_tests_basic_vm_qrexec_gui_zfs

  TC_00_Basic/test_120_start_standalone_with_cdrom_dom0 (1/5 times with errors)

  • job 109480 AssertionError: 1 != 0 : b'Timeout waiting for dom0:loop6 device to...

• system_tests_audio

  TC_20_AudioVM_Pulse_fedora-40-xfce/test_223_audio_play_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_224_audio_rec_muted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_224_audio_rec_muted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_225_audio_rec_unmuted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_225_audio_rec_unmuted_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_PipeWire_whonix-workstation-17/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)

  • job 115623 AssertionError: too short audio, expected 10s, got 9.34507936507936...
  TC_20_AudioVM_Pulse_debian-12-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_fedora-40-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_Pulse_whonix-workstation-17/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)

  • job 115623 libvirt.libvirtError: internal error: libxenlight failed to create ...
  TC_20_AudioVM_PipeWire_fedora-40-xfce/test_260_audio_mic_enabled_switch_audiovm (2/5 times with errors)

  • job 116847 AssertionError: too short audio, expected 10s, got 0.00013605442176...
  • job 117586 AssertionError: too short audio, expected 10s, got 0.00013605442176...
  TC_20_AudioVM_PipeWire_whonix-workstation-17/test_260_audio_mic_enabled_switch_audiovm (1/5 times with errors)

  • job 115623 AssertionError: too short audio, expected 10s, got 9.05353741496598...

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

No remaining performance tests

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69.44%. Comparing base (039b7d3) to head (5b7e57b).
Report is 18 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #638      +/-   ##
==========================================
- Coverage   69.49%   69.44%   -0.06%     
==========================================
  Files          58       58              
  Lines       12465    12434      -31     
==========================================
- Hits         8663     8635      -28     
+ Misses       3802     3799       -3     

Flag	Coverage Δ
unittests	69.44% <ø> (-0.06%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.