Enable logging in tests

[marmarek]

No description provided.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.68%. Comparing base (f3bb106) to head (b9c4b81).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #763      +/-   ##
==========================================
- Coverage   70.74%   70.68%   -0.06%     
==========================================
  Files          61       61              
  Lines       13809    13809              
==========================================
- Hits         9769     9761       -8     
- Misses       4040     4048       +8     

Flag	Coverage Δ
unittests	70.68% <ø> (-0.06%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[qubesos-bot]

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025121306-4.3&flavor=pull-requests

Test run included the following:

• Add Arch packaging qubes-core-admin-client#332 (QubesOS/qubes-core-admin-client@40487bc)
• Fix devices serialization to not use prohibited chars qubes-core-admin-client#399 (QubesOS/qubes-core-admin-client@28b79d7)
• Add method to solely create disposable qubes-core-admin-client#401 (QubesOS/qubes-core-admin-client@96e818a)
• Deserialize device in events only if there is a handler registered qubes-core-admin-client#402 (QubesOS/qubes-core-admin-client@322aa48)
• tests: log more info on failure #736 (a3fc21c)
• Disposable performance: Add drive information to HCL, more details in spec, more tests for line graph #744 (5c352a7)
• Wait for user session for preloaded disposables #757 (4094238)
• Switch autostart event in favor of only start #758 (b474909)
• Deserialize device from qrexec arg properly #759 (6137b62)
• Enable logging in tests #763 (b9c4b81)
• Allow GUIVM clients to know if GUIVM has session qubes-core-agent-linux#625 (QubesOS/qubes-core-agent-linux@420e90f)
• network: reload firewall rules on DNS change qubes-core-agent-linux#626 (QubesOS/qubes-core-agent-linux@ddea7fe)
• Query GUIVM session or GUID from client in GUIVM qubes-core-qrexec#217 (QubesOS/qubes-core-qrexec@88935ab)
• Update to upstream version 4.24 qubes-desktop-linux-i3#54 (QubesOS/qubes-desktop-linux-i3@0e8b9b6)
• Delay connecting with gui-daemon until after starting Xorg qubes-gui-agent-linux#251 (QubesOS/qubes-gui-agent-linux@89fd8c1)
• Re-dock tray icons when tray manager is restarted qubes-gui-daemon#173 (QubesOS/qubes-gui-daemon@d37169c)
• Hide disks that other udev rules marked as hidden from udisks qubes-linux-utils#133 (QubesOS/qubes-linux-utils@17f8800)
• Allow GUIVM clients to know if GUIVM has session qubes-mgmt-salt-dom0-virtual-machines#88 (QubesOS/qubes-mgmt-salt-dom0-virtual-machines@4c3007f)
• Wait for GUI session on the server side qubes-notification-proxy#14 (QubesOS/qubes-notification-proxy@6da96ee)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2025111104-4.3&flavor=update

• system_tests_extra

  • TC_00_InputProxy_debian-13-xfce: test_050_mouse_late_attach (failure)
    AssertionError: unexpectedly None : Device 'test-inst-input: Test i...

  • TC_00_InputProxy_fedora-42-xfce: test_050_mouse_late_attach (failure)
    AssertionError: unexpectedly None : Device 'test-inst-input: Test i...

  • TC_10_Thunderbird_fedora-42-xfce: test_000_send_receive_default (failure)
    raise Exception('Cannot export ... Exception: Cannot export public key

  • TC_10_Thunderbird_fedora-42-xfce: test_020_send_receive_inline_with_attachment (failure + cleanup)
    raise Exception('Cannot export ... Exception: Cannot export public key

• system_tests_dispvm

  • TC_20_DispVM_whonix-workstation-18: test_015_preload_race_more (failure)
    AssertionError: last preloaded didn't complete in time

• system_tests_guivm_vnc_gui_interactive

  • collect_logs: wait_serial (wait serial expected)
    # wait_serial expected: qr/ubQlW-\d+-/...

  • collect_logs: Failed (test died + timed out)
    # Test died: command 'curl --form [email protected] --form upn...

  • collect_logs: wait_serial (wait serial expected)
    # wait_serial expected: qr/inLZ0-\d+-/...

• system_tests_audio@hw1

  • TC_20_AudioVM_Pulse_debian-13-xfce: test_222_audio_rec_unmuted_pulseaudio (failure)
    AssertionError: only silence detected, no useful audio data

  • TC_20_AudioVM_Pulse_debian-13-xfce: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: Command 'timeout 20s paplay --format=float32le --ra...

• system_tests_qwt_win10@hw13

  • windows_clipboard_and_filecopy: unnamed test (unknown)
  • windows_clipboard_and_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'windows-Notepad' matc...

• system_tests_qwt_win10_seamless@hw13

  • windows_install: Failed (test died)
    # Test died: Install failed with code 1 at qubesos/tests/windows_in...

• system_tests_network_updates

  • TC_00_Dom0Upgrade_whonix-gateway-18: test_010_instal (error)
    subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...

Failed tests

16 failures

• system_tests_extra

  • TC_00_InputProxy_debian-13-xfce: test_050_mouse_late_attach (failure)
    AssertionError: unexpectedly None : Device 'test-inst-input: Test i...

  • TC_00_InputProxy_fedora-42-xfce: test_050_mouse_late_attach (failure)
    AssertionError: unexpectedly None : Device 'test-inst-input: Test i...

  • TC_10_Thunderbird_fedora-42-xfce: test_000_send_receive_default (failure)
    raise Exception('Cannot export ... Exception: Cannot export public key

  • TC_10_Thunderbird_fedora-42-xfce: test_020_send_receive_inline_with_attachment (failure + cleanup)
    raise Exception('Cannot export ... Exception: Cannot export public key

• system_tests_dispvm

  • TC_20_DispVM_whonix-workstation-18: test_015_preload_race_more (failure)
    AssertionError: last preloaded didn't complete in time

• system_tests_guivm_vnc_gui_interactive

  • collect_logs: wait_serial (wait serial expected)
    # wait_serial expected: qr/ubQlW-\d+-/...

  • collect_logs: Failed (test died + timed out)
    # Test died: command 'curl --form [email protected] --form upn...

  • collect_logs: wait_serial (wait serial expected)
    # wait_serial expected: qr/inLZ0-\d+-/...

• system_tests_audio@hw1

  • TC_20_AudioVM_Pulse_debian-13-xfce: test_222_audio_rec_unmuted_pulseaudio (failure)
    AssertionError: only silence detected, no useful audio data

  • TC_20_AudioVM_Pulse_debian-13-xfce: test_252_audio_playback_audiovm_switch_hvm (failure)
    AssertionError: Command 'timeout 20s paplay --format=float32le --ra...

• system_tests_qwt_win10@hw13

  • windows_clipboard_and_filecopy: unnamed test (unknown)
  • windows_clipboard_and_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'windows-Notepad' matc...

• system_tests_qwt_win10_seamless@hw13

  • windows_install: Failed (test died)
    # Test died: Install failed with code 1 at qubesos/tests/windows_in...

• system_tests_qwt_win11@hw13

  • windows_install: wait_serial (wait serial expected)
    # wait_serial expected: qr/install-complete-\d+-/...

  • windows_install: Failed (test died + timed out)
    # Test died: Install timed out at qubesos/tests/windows_install.pm ...

• system_tests_network_updates

  • TC_00_Dom0Upgrade_whonix-gateway-18: test_010_instal (error)
    subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/158999#dependencies

19 fixed

• system_tests_extra

  • TC_00_QVCTest_debian-13-xfce: test_010_screenshare (failure + cleanup)
    AssertionError: 2.4614345149565264 not less than 2.0

  • TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure)
    AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...

  • TC_00_QVCTest_whonix-workstation-18: test_010_screenshare (failure)
    AssertionError: 1 != 0 : Timeout waiting for /dev/video0 in test-in...

• system_tests_guivm_gui_interactive

  • gui_keyboard_layout: unnamed test (unknown)
  • gui_keyboard_layout: Failed (test died)
    # Test died: no candidate needle with tag(s) 'work-xterm, work-xter...

• system_tests_dispvm

  • TC_20_DispVM_whonix-workstation-18: test_030_edit_file (failure)
    AssertionError: Timeout waiting for editor window

  • TC_20_DispVM_whonix-workstation-18: test_100_open_in_dispvm (failure)
    AssertionError: './open-file test.txt' failed with ./open-file test...

• system_tests_guivm_vnc_gui_interactive

  • gui_filecopy: unnamed test (unknown)
  • gui_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'disp-text-editor' mat...

• system_tests_qwt_win10@hw13

  • windows_install: wait_serial (wait serial expected)
    # wait_serial expected: qr/kauF4-\d+-/...

  • windows_install: Failed (test died + timed out)
    # Test died: command 'script -e -c 'bash -x /usr/bin/qvm-create-win...

• system_tests_qwt_win10_seamless@hw13

  • windows_clipboard_and_filecopy: unnamed test (unknown)
  • windows_clipboard_and_filecopy: Failed (test died)
    # Test died: no candidate needle with tag(s) 'windows-Edge-address-...

• system_tests_dispvm_perf@hw7

  • system_tests: Fail (unknown)
    Tests qubes.tests.integ.dispvm_perf failed (exit code 1), details r...

  • system_tests: Failed (test died)
    # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...

  • TC_00_DispVMPerf_debian-13-xfce: test_411_dom0_dispvm_preload_gui_concurrent_api (failure)
    AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...

  • TC_00_DispVMPerf_debian-13-xfce: test_900_reader (failure)
    AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...

  • TC_00_DispVMPerf_whonix-workstation-18: test_409_dom0_dispvm_preload_gui_api (failure)
    AssertionError: '/usr/lib/qubes/tests/dispvm_perf.py --dvm=test-ins...

  • TC_00_DispVMPerf_whonix-workstation-18: test_900_reader (failure)
    AssertionError: '/usr/lib/qubes/tests/dispvm_perf_reader.py --templ...

Unstable tests

Details

Performance Tests

Performance degradation:

3 performance degradations

• debian-13-xfce_exec: 7.78 🔻 ( previous job: 6.42, degradation: 121.27%)
• fedora-42-xfce_dom0-vm-api (mean:0.036): 0.43 🔻 ( previous job: 0.39, degradation: 110.71%)
• whonix-workstation-18_dom0-vm-gui-api (mean:0.073): 0.88 🔻 ( previous job: 0.45, degradation: 195.10%)

Remaining performance tests:

53 tests

• debian-13-xfce_exec-root: 26.88 🟢 ( previous job: 27.48, improvement: 97.80%)
• debian-13-xfce_socket: 8.54 🟢 ( previous job: 8.68, improvement: 98.49%)
• debian-13-xfce_socket-root: 8.41 🔻 ( previous job: 8.40, degradation: 100.11%)
• debian-13-xfce_exec-data-simplex: 66.51 🟢 ( previous job: 67.70, improvement: 98.25%)
• debian-13-xfce_exec-data-duplex: 69.46 🔻 ( previous job: 69.20, degradation: 100.37%)
• debian-13-xfce_exec-data-duplex-root: 84.87 🟢 ( previous job: 86.64, improvement: 97.96%)
• debian-13-xfce_socket-data-duplex: 131.59 🟢 ( previous job: 136.31, improvement: 96.54%)
• fedora-42-xfce_exec: 9.23 🔻 ( previous job: 9.23, degradation: 100.01%)
• fedora-42-xfce_exec-root: 59.14 🟢 ( previous job: 59.89, improvement: 98.74%)
• fedora-42-xfce_socket: 8.45 🔻 ( previous job: 8.23, degradation: 102.65%)
• fedora-42-xfce_socket-root: 8.82 🔻 ( previous job: 8.31, degradation: 106.13%)
• fedora-42-xfce_exec-data-simplex: 67.13 🔻 ( previous job: 66.18, degradation: 101.43%)
• fedora-42-xfce_exec-data-duplex: 69.52 🟢 ( previous job: 71.51, improvement: 97.23%)
• fedora-42-xfce_exec-data-duplex-root: 96.89 🔻 ( previous job: 96.52, degradation: 100.38%)
• fedora-42-xfce_socket-data-duplex: 138.42 🔻 ( previous job: 137.78, degradation: 100.47%)
• whonix-gateway-18_exec: 7.89 🟢 ( previous job: 8.52, improvement: 92.68%)
• whonix-gateway-18_exec-root: 131.24 🔻 ( previous job: 129.05, degradation: 101.70%)
• whonix-gateway-18_socket: 7.82 🟢 ( previous job: 8.26, improvement: 94.65%)
• whonix-gateway-18_socket-root: 8.12 🔻 ( previous job: 7.76, degradation: 104.71%)
• whonix-gateway-18_exec-data-simplex: 70.19 🟢 ( previous job: 73.13, improvement: 95.99%)
• whonix-gateway-18_exec-data-duplex: 72.20 🔻 ( previous job: 71.98, degradation: 100.31%)
• whonix-gateway-18_exec-data-duplex-root: 137.86 🟢 ( previous job: 146.68, improvement: 93.99%)
• whonix-gateway-18_socket-data-duplex: 136.16 🟢 ( previous job: 142.71, improvement: 95.40%)
• whonix-workstation-18_exec: 9.20 🔻 ( previous job: 8.85, degradation: 103.97%)
• whonix-workstation-18_exec-root: 138.71 🟢 ( previous job: 149.84, improvement: 92.57%)
• whonix-workstation-18_socket: 9.41 🔻 ( previous job: 9.12, degradation: 103.17%)
• whonix-workstation-18_socket-root: 7.75 🟢 ( previous job: 8.75, improvement: 88.63%)
• whonix-workstation-18_exec-data-simplex: 68.61 🔻 ( previous job: 67.02, degradation: 102.37%)
• whonix-workstation-18_exec-data-duplex: 70.79 🔻 ( previous job: 69.25, degradation: 102.22%)
• whonix-workstation-18_exec-data-duplex-root: 143.17 🟢 ( previous job: 146.32, improvement: 97.84%)
• whonix-workstation-18_socket-data-duplex: 137.71 🟢 ( previous job: 139.15, improvement: 98.97%)
• debian-13-xfce_dom0-dispvm-api (mean:6.888): 82.66 🟢 ( previous job: 84.68, improvement: 97.61%)
• debian-13-xfce_dom0-dispvm-gui-api (mean:7.87): 94.44 🟢 ( previous job: 98.62, improvement: 95.76%)
• debian-13-xfce_dom0-dispvm-preload-2-api (mean:4.13): 49.56
• debian-13-xfce_dom0-dispvm-preload-4-api (mean:3.646): 43.75
• debian-13-xfce_dom0-dispvm-preload-2-gui-api (mean:4.14): 49.68
• debian-13-xfce_dom0-dispvm-preload-4-gui-api (mean:3.948): 47.37
• debian-13-xfce_dom0-vm-api (mean:0.039): 0.47 🟢 ( previous job: 0.59, improvement: 79.36%)
• debian-13-xfce_dom0-vm-gui-api (mean:0.045): 0.54 🟢 ( previous job: 0.58, improvement: 93.09%)
• fedora-42-xfce_dom0-dispvm-api (mean:7.206): 86.47 🟢 ( previous job: 89.70, improvement: 96.40%)
• fedora-42-xfce_dom0-dispvm-gui-api (mean:8.356): 100.27 🟢 ( previous job: 107.00, improvement: 93.71%)
• fedora-42-xfce_dom0-dispvm-preload-2-api (mean:4.754): 57.04
• fedora-42-xfce_dom0-dispvm-preload-4-api (mean:3.994): 47.92
• fedora-42-xfce_dom0-dispvm-preload-2-gui-api (mean:4.659): 55.91
• fedora-42-xfce_dom0-dispvm-preload-4-gui-api (mean:3.906): 46.87
• fedora-42-xfce_dom0-vm-gui-api (mean:0.038): 0.46 🟢 ( previous job: 0.54, improvement: 85.00%)
• whonix-workstation-18_dom0-dispvm-api (mean:8.884): 106.61 🟢 ( previous job: 117.52, improvement: 90.71%)
• whonix-workstation-18_dom0-dispvm-gui-api (mean:9.805): 117.67 🟢 ( previous job: 130.38, improvement: 90.25%)
• whonix-workstation-18_dom0-dispvm-preload-2-api (mean:5.522): 66.26
• whonix-workstation-18_dom0-dispvm-preload-4-api (mean:4.679): 56.14
• whonix-workstation-18_dom0-dispvm-preload-2-gui-api (mean:5.687): 68.25
• whonix-workstation-18_dom0-dispvm-preload-4-gui-api (mean:4.706): 56.47
• whonix-workstation-18_dom0-vm-api (mean:0.051): 0.62 🔻 ( previous job: 0.60, degradation: 102.15%)