Observations on "short test summary info" section

[jeffwright13]

Hello, Pytest Devs:

I have a couple of observations on the "short test summary info" section. This is not meant as criticism, but I wanted to point out some discrepancies out in case anyone thinks they are "issues" that might need to be addressed. Mostly these observations just have to do with consistency of output.

1. The "short test summary info" section is not marked up (with ANSI code), hence does not display in color, unlike the "test session starts" section at the beginning of the test run.
2. XFAIL results span multiple lines if a reason is specified, unlike the other result categories. Maybe it makes sense to visually offset the reason instead of appending it to the end of the line. On the other hand, failed tests append their failure details at the end of the line, so there is a discrepancy there.
3. SKIPPED tests do not get referenced by test title, but instead are referenced by filename and line number. This is different than all the other test classifications. SKIPPED tests are properly referenced by test title in the 'test session starts' section, however.

Regards, Jeff

$ pytest -v -rA
==================================================================================== test session starts ====================================================================================
platform darwin -- Python 3.9.9, pytest-7.1.1, pluggy-1.0.0 -- /Users/jwr003/coding/pytest-tui/venv/bin/python
cachedir: .pytest_cache
rootdir: /Users/jwr003/coding/pytest-tui, configfile: pytest.ini, testpaths: tests
plugins: Faker-13.0.0, tui-0.8.8
collected 35 items

tests/test_1.py::test_a_ok PASSED                                                                                                                                                     [  2%]
tests/test_1.py::test_b_fail FAILED                                                                                                                                                   [  5%]
tests/test_1.py::test_c_error ERROR                                                                                                                                                   [  8%]
tests/test_1.py::test_d1_skip_inline SKIPPED (Skipping this test with inline call to 'pytest.skip()'.)                                                                                [ 11%]
tests/test_1.py::test_d2_skip_decorator SKIPPED (Skipping this test with inline call to 'pytest.skip()'.)                                                                             [ 14%]
tests/test_1.py::test_e1_xfail_by_inline_and_has_reason XFAIL (Marked as Xfail with inline call to 'pytest.xfail()'.)                                                                 [ 17%]
tests/test_1.py::test_e2_xfail_by_decorator_and_has_reason XFAIL (Marked as Xfail with decorator.)                                                                                    [ 20%]
tests/test_1.py::test_f1_xfails_by_inline_even_though_assertTrue_happens_before_pytestDotXfail XFAIL (Marked as Xfail with inline call to 'pytest.xfail()'.)                          [ 22%]
tests/test_1.py::test_f2_xpass_by_xfail_decorator_and_has_reason XPASS (Marked as Xfail with decorator.)                                                                              [ 25%]
tests/test_1.py::test_g_eval_parameterized[3+5-8] PASSED                                                                                                                              [ 28%]
tests/test_1.py::test_g_eval_parameterized[2+4-6] PASSED                                                                                                                              [ 31%]
tests/test_1.py::test_g_eval_parameterized[6*9-42] FAILED                                                                                                                             [ 34%]
tests/test_1.py::test_1_passes_and_has_logging_output PASSED                                                                                                                          [ 37%]
tests/test_1.py::test_2_fails_and_has_logging_output FAILED                                                                                                                           [ 40%]
tests/test_1.py::test_3_fails FAILED                                                                                                                                                  [ 42%]
tests/test_1.py::test_4_passes PASSED                                                                                                                                                 [ 45%]
tests/test_1.py::test_5_marked_SKIP SKIPPED (unconditional skip)                                                                                                                      [ 48%]
tests/test_1.py::test_6_marked_xfail_by_decorator_but_passes_and_has_no_reason XPASS                                                                                                  [ 51%]
tests/test_1.py::test_7_marked_xfail_by_decorator_and_fails_and_has_no_reason XFAIL                                                                                                   [ 54%]
tests/test_1.py::test_8_causes_a_warning FAILED                                                                                                                                       [ 57%]
tests/test_1.py::test_9_lorem_fails FAILED                                                                                                                                            [ 60%]
tests/test_1.py::test_10_fail_capturing FAIL stdout not captured, going directly to sys.stdout
FAIL stderr not captured, going directly to sys.stderr
FAILED                                                                                                                                        [ 62%]
tests/test_1.py::test_11_pass_capturing FAILED                                                                                                                                        [ 65%]
tests/test_1.py::test_12_fails_and_has_stdout FAILED                                                                                                                                  [ 68%]
tests/test_1.py::test_13_passes_and_has_stdout PASSED                                                                                                                                 [ 71%]
tests/test_1.py::test_14_causes_error_pass_stderr_stdout_stdlog ERROR                                                                                                                 [ 74%]
tests/test_1.py::test_15_causes_error_fail_stderr_stdout_stdlog ERROR                                                                                                                 [ 77%]
tests/test_1.py::test_16_fail_compare_dicts_for_pytest_icdiff FAILED                                                                                                                  [ 80%]
tests/test_2.py::test_a_ok PASSED                                                                                                                                                     [ 82%]
tests/test_2.py::test_b_fail FAILED                                                                                                                                                   [ 85%]
tests/test_2.py::test_c_error ERROR                                                                                                                                                   [ 88%]
tests/test_warnings.py::test_1_fails_with_warnings FAILED                                                                                                                             [ 91%]
tests/test_warnings.py::test_2_passes_with_warnings PASSED                                                                                                                            [ 94%]
tests/test_xpass_xfail.py::test_xfail_by_inline XFAIL (xfailing this test with 'pytest.xfail()')                                                                                      [ 97%]
tests/test_xpass_xfail.py::test_xfail_by_decorator XFAIL (Here's my reason for xfail: None)                                                                                           [100%]

================================================================================== short test summary info ==================================================================================
PASSED tests/test_1.py::test_a_ok
PASSED tests/test_1.py::test_g_eval_parameterized[3+5-8]
PASSED tests/test_1.py::test_g_eval_parameterized[2+4-6]
PASSED tests/test_1.py::test_1_passes_and_has_logging_output
PASSED tests/test_1.py::test_4_passes
PASSED tests/test_1.py::test_13_passes_and_has_stdout
PASSED tests/test_2.py::test_a_ok
PASSED tests/test_warnings.py::test_2_passes_with_warnings
SKIPPED [1] tests/test_1.py:35: Skipping this test with inline call to 'pytest.skip()'.
SKIPPED [1] tests/test_1.py:40: Skipping this test with inline call to 'pytest.skip()'.
SKIPPED [1] tests/test_1.py:105: unconditional skip
XFAIL tests/test_1.py::test_e1_xfail_by_inline_and_has_reason
  reason: Marked as Xfail with inline call to 'pytest.xfail()'.
XFAIL tests/test_1.py::test_e2_xfail_by_decorator_and_has_reason
  reason: Marked as Xfail with decorator.
XFAIL tests/test_1.py::test_f1_xfails_by_inline_even_though_assertTrue_happens_before_pytestDotXfail
  reason: Marked as Xfail with inline call to 'pytest.xfail()'.
XFAIL tests/test_1.py::test_7_marked_xfail_by_decorator_and_fails_and_has_no_reason
XFAIL tests/test_xpass_xfail.py::test_xfail_by_inline
  reason: xfailing this test with 'pytest.xfail()'
XFAIL tests/test_xpass_xfail.py::test_xfail_by_decorator
  Here's my reason for xfail: None
XPASS tests/test_1.py::test_f2_xpass_by_xfail_decorator_and_has_reason Marked as Xfail with decorator.
XPASS tests/test_1.py::test_6_marked_xfail_by_decorator_but_passes_and_has_no_reason
ERROR tests/test_1.py::test_c_error - assert 0
ERROR tests/test_1.py::test_14_causes_error_pass_stderr_stdout_stdlog
ERROR tests/test_1.py::test_15_causes_error_fail_stderr_stdout_stdlog
ERROR tests/test_2.py::test_c_error - assert 0
FAILED tests/test_1.py::test_b_fail - assert 0
FAILED tests/test_1.py::test_g_eval_parameterized[6*9-42] - AssertionError: assert 54 == 42
FAILED tests/test_1.py::test_2_fails_and_has_logging_output - assert 0 == 1
FAILED tests/test_1.py::test_3_fails - assert 0
FAILED tests/test_1.py::test_8_causes_a_warning - TypeError: api_v1() missing 1 required positional argument: 'log_testname'
FAILED tests/test_1.py::test_9_lorem_fails - assert False
FAILED tests/test_1.py::test_10_fail_capturing - assert False
FAILED tests/test_1.py::test_11_pass_capturing - TypeError: disabled() takes 1 positional argument but 2 were given
FAILED tests/test_1.py::test_12_fails_and_has_stdout - assert 0 == 1
FAILED tests/test_1.py::test_16_fail_compare_dicts_for_pytest_icdiff - AssertionError: assert ['Hello', 'hi... 'at', 'this'] == [7, 10, 45, 23, 77]
FAILED tests/test_2.py::test_b_fail - assert 0
FAILED tests/test_warnings.py::test_1_fails_with_warnings - assert False
=================================================== 12 failed, 8 passed, 3 skipped, 6 xfailed, 2 xpassed, 22 warnings, 4 errors in 2.49s ====================================================

[jeffwright13]

Item (1) has been addressed in Pytest release 7.2.