tests: add grub tests for archlinux too

[marmarek]

Test for QubesOS/qubes-linux-utils#124

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.54%. Comparing base (e7d49e3) to head (1f94afd).
Report is 4 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #682      +/-   ##
==========================================
- Coverage   70.58%   70.54%   -0.04%     
==========================================
  Files          61       61              
  Lines       12973    12984      +11     
==========================================
+ Hits         9157     9160       +3     
- Misses       3816     3824       +8     

Flag	Coverage Δ
unittests	70.54% <ø> (-0.04%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025052914-4.3-archlinux&flavor=templates

Test run included the following:

• tests: add grub tests for archlinux too #682 (1f94afd)
• Add Arch packaging qubes-core-admin-client#332 (QubesOS/qubes-core-admin-client@40487bc)
• archlinux: Sync /etc/fstab with other distros qubes-core-agent-linux#575 (QubesOS/qubes-core-agent-linux@aff3c5c)
• archlinux: include scrub_pages initrd hook qubes-linux-utils#126 (QubesOS/qubes-linux-utils@5886a77)
• archlinux: restart qubes-qrexec-agent on update qubes-core-qrexec#209 (QubesOS/qubes-core-qrexec@f0124b2)
• archlinux: update dnf dependency qubes-core-agent-linux#574 (QubesOS/qubes-core-agent-linux@2453e15)
• tests: give it more time to start recording #683 (8190938)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025031804-4.3&flavor=update

• system_tests_whonix

  • whonix_torbrowser: unnamed test (unknown)
  • whonix_torbrowser: Failed (test died)
    # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...

• system_tests_audio

  • TC_20_AudioVM_PipeWire_archlinux: test_250_audio_playback_audiovm_pipewire (failure)
    AssertionError: pacat for test-inst-vm1 (xid 11) running(False) in ...

  • TC_20_AudioVM_PipeWire_archlinux: test_251_audio_playback_audiovm_pipewire_late_start (failure)
    AssertionError: pacat for test-inst-vm1 (xid 12) running(False) in ...

  • TC_20_AudioVM_PipeWire_archlinux: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: pacat for test-inst-vm1 (xid 14) running(False) in ...

  • TC_20_AudioVM_Pulse_archlinux: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: pacat for test-inst-vm1 (xid 27) running(False) in ...

• system_tests_guivm_gui_interactive

  • update_templates: Failed (test died)
    # Test died: command 'qvm-template upgrade --yes --enablerepo=qubes...

• system_tests_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'text-editor-save-prom...

Failed tests

9 failures

• system_tests_whonix

  • whonix_torbrowser: unnamed test (unknown)
  • whonix_torbrowser: Failed (test died)
    # Test died: no candidate needle with tag(s) 'anon-whonix-tor-brows...

• system_tests_audio

  • TC_20_AudioVM_PipeWire_archlinux: test_250_audio_playback_audiovm_pipewire (failure)
    AssertionError: pacat for test-inst-vm1 (xid 11) running(False) in ...

  • TC_20_AudioVM_PipeWire_archlinux: test_251_audio_playback_audiovm_pipewire_late_start (failure)
    AssertionError: pacat for test-inst-vm1 (xid 12) running(False) in ...

  • TC_20_AudioVM_PipeWire_archlinux: test_260_audio_mic_enabled_switch_audiovm (failure)
    AssertionError: pacat for test-inst-vm1 (xid 14) running(False) in ...

  • TC_20_AudioVM_Pulse_archlinux: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: pacat for test-inst-vm1 (xid 27) running(False) in ...

• system_tests_guivm_gui_interactive

  • update_templates: Failed (test died)
    # Test died: command 'qvm-template upgrade --yes --enablerepo=qubes...

• system_tests_gui_interactive

  • clipboard_and_web: unnamed test (unknown)
  • clipboard_and_web: Failed (test died)
    # Test died: no candidate needle with tag(s) 'text-editor-save-prom...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/132953#dependencies

5 fixed

• system_tests_basic_vm_qrexec_gui

  • TC_20_NonAudio_whonix-gateway-17: test_300_bug_1028_gui_memory_pinning (failure)
    AssertionError: Dom0 window doesn't match VM window content, saved ...

• system_tests_whonix

  • whonixcheck: fail (unknown)
    Whonixcheck for sys-whonix failed...

  • whonixcheck: unnamed test (unknown)

• system_tests_audio

  • TC_20_AudioVM_Pulse_whonix-workstation-17: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: only silence detected, no useful audio data

• system_tests_qrexec

  • TC_00_Qrexec_fedora-41-xfce: test_081_qrexec_service_argument_allow_specific (error)
    subprocess.CalledProcessError: Command '/usr/lib/qubes/qrexec-clien...

Unstable tests

Details

• system_tests_update

  update2/Failed (1/5 times with errors)

  • job 139051 # Test died: command 'script -c 'qubes-vm-update --force-update --l...

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

No remaining performance tests