2025.3

[javierggt]

ska3-flight 2025.3

This PR includes:

• cxotime:
  • Added the possibility to use an environment variable (CXOTIME_NOW) to artificcialy set the "current" time in CxoTime.
  • Added support for CXOTIME_NOW in chandra_time and cheta
• kadi
  • Support using MAUDE as the source of telemetry for kadi events, to allow the events to be up to date with ground telemetry soon after MAUDE dump data ingest completes.
  • Add infrastructure to filter command events to get an alternate command history (e.g.: the expected command events in the hypothetical case that an SCS 107 was not run)
  • Fixed a bug where the HRC appeared to be powered on after an SCS 107 in the middle of an HRC observation.
• sparkles: Check close-to-zero dither observations meet requirements (creep away and no dynamic background)
• starcheck: Remove high IR zone check

Interface Impacts:

• cheta:
  • Add back symbols that had been removed from cheta.fetch.
  • The symbol ENG_ARCHIVE in cheta.fetch was removed
• kadi:
  • from now on, times beyond the last state will return the last state instead of failing with an exception.
  • Using KADI_COMMANDS_DEFAULT_STOP now generates a warning. Use CXOTIME_NOW instead.
  • Previously the State column in a local scenario command events file was being ignored. Now it behaves like the google sheet and (if that column is present), events are filtered accordingly. I.e. only Predictive and Definitive are allowed.
  • Added event_filter kwarg to get_cmds, get_states, get_continuity, get_observations,
    get_starcats, get_starcats_as_table functions.
  • Changes in events:
    • safe_suns: Obsid associated with safe sun event might change (depends on particular timing).
    • normal_suns: Normal suns now strictly match AOPCADMD == "NSUN" with no event fuzzing.
    • scs107s: SCS107 strictly based on RW momentum bias disabled. This is more accurate.
    • eclipses: Many spurious short eclipse events (< 100 s) removed.
  • New HRC commands result from any SCS-107 run (including NSM, Safe Mode). The command timing is different due to the addition of new commands with 1.025 sec waits. ([bugfix] Add commands to turn HRC off to SCS 107 kadi#344)

At the time of promotion, copy /export/tom/kadi-pr343/data/kadi/events3.db3 to flight Ska data.

Testing:

• Automated tests.

skare3 dashboard and test result password at https://icxc.cfa.harvard.edu/aspect/skare3_dash_cred.txt

The latest release candidates will be installed in /proj/sot/ska3/test on HEAD, and all release candidates will be available for testing from the usual channels:

conda create -n ska3-flight-2025.3rc3 --override-channels \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/flight \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/test \
  ska3-flight==2025.3rc3

If this release includes an update to ska3-perl, the install process for Aspect will include that. Note: ska3-perl is generally not needed for non-Aspect users.

conda create -n ska3-flight-2025.3rc3 --override-channels \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/flight \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/test \
  ska3-flight==2025.3rc3 ska3-perl==2025.3rc3

Review

All operations critical or impacting PR's are independently and carefully reviewed. For other PR's the level of detail for review is calibrated to operations criticality. Some PR's that are confined to aspect-team-specific processing may have little to no independent review.

Deployment

ska3-flight 2025.3 will be promoted to flight conda channel and installed on HEAD and GRETA Linux upon approval of FSDS Jira ticket.

Code changes

ska3-core changes (2025.2 -> 2025.3rc3)

New Packages

• accessible-pygments: 0.0.5
• pydata-sphinx-theme: 0.16.1
• sphinx-autoapi: 3.5.0
• sphinx-copybutton: 0.5.2
• stdlib-list: 0.11.1

ska3-core-latest changes (2025.1 -> 2025.3rc3)

New Packages

• **configobj: **
• **pydata-sphinx-theme: **
• **sphinx-autoapi: **
• **sphinx-copybutton: **

ska3-flight changes (2025.1 -> 2025.3rc3)

Updated Packages

• acis_thermal_check: 5.2.0 -> 5.3.0 (5.2.0 -> 5.3.0)
  • PR 76 (John ZuHone): Documentation page on what to do if something goes wrong with lr, new script to copy files to webpage
• acispy: 2.7.0 -> 2.8.0 (2.7.0 -> 2.8.0)
• chandra_aca: 4.48.1 -> 4.49.0 (4.48.1 -> 4.49.0)
  • PR 188 (Jean Connelly): Change the get_aca_images default to bgsub=False
  • PR 187 (Jean Connelly): Update for ruff 0.9.0
• chandra_time: 4.1.2 -> 4.2.0 (4.1.2 -> 4.2.0)
  • PR 59 (Tom Aldcroft): Support cxotime now sentinel and env var
• cheta: 4.62.3 -> 4.63.1 (4.62.3 -> 4.63.0 -> 4.63.1)
  • PR 273 (Tom Aldcroft): Fix update scripts broken in Update Ska.quatutil to 3.3.2 #269 + unrelated docs fixes
  • PR 271 (Tom Aldcroft): Require at least one row of data in full data for server sync
  • PR 269 (Tom Aldcroft): Documentation overhaul
  • PR 268 (Tom Aldcroft): Add remote access traceback + fix MSID.iplot() + docs update
  • PR 270 (Tom Aldcroft): Support CXOTIME_NOW environment variable
  • PR 274 (Tom Aldcroft): Add back most of fetch module contents to all
• cxotime: 3.9.2 -> 3.10.0 (3.9.2 -> 3.10.0)
  • PR 50 (Tom Aldcroft): Use CXOTIME_NOW environment variable as current time if set
  • PR 49 (Tom Aldcroft): Documentation overhaul and update to fast converter function generation
• kadi: 7.14.2 -> 7.16.0 (7.14.2 -> 7.15.0 -> 7.16.0)
  • PR 349 (Tom Aldcroft): Use CXOTIME_NOW, deprecate KADI_COMMANDS_DEFAULT_STOP for default stop
  • PR 348 (Tom Aldcroft): Documentation overhaul
  • PR 351 (Tom Aldcroft): Add infrastructure to filter command events to get alternate command history
  • PR 343 (Tom Aldcroft): Support MAUDE telemetry for events
  • PR 344 (John ZuHone): [bugfix] Add commands to turn HRC off to SCS 107
• mica: 4.38.1 -> 4.38.3 (4.38.1 -> 4.38.2 -> 4.38.3)
  • PR 315 (Tom Aldcroft): Use different alg for two_byte_sum that fixes off-by-one error
  • PR 317 (Jean Connelly): Set mica.report.report.main matplotlib backend to Agg
  • PR 318 (Jean Connelly): Limit stat update range to end of AOPCADMD data
• parse_cm: 3.16.2 -> 3.17.0 (3.16.2 -> 3.17.0)
  • PR 59 (Tom Aldcroft): Documentation update using ska_helpers.docs, pydata_sphinx_theme, sphinx_autoapi
  • PR 58 (Tom Aldcroft): CSD parser remove ATS caching and test recent loads
  • PR 57 (Tom Aldcroft): Ruff
• ska3-core: 2025.1 -> 2025.3
• ska_helpers: 0.17.0 -> 0.18.0 (0.17.0 -> 0.18.0)
  • PR 60 (Tom Aldcroft): Add base conf.py for docs for all Ska projects
• ska_shell: 4.0.1 -> 4.1.0 (4.0.1 -> 4.1.0)
  • PR 31 (Javier Gonzalez): No pexpect
• sparkles: 4.28.1 -> 4.29.0 (4.28.1 -> 4.29.0)
  • PR 221 (Jean Connelly): Check close-to-zero dither observations meet requirements
• starcheck: 14.12.0 -> 14.13.0 (14.12.0 -> 14.13.0)
  • PR 451 (Jean Connelly): Ruff
  • PR 450 (Jean Connelly): Remove high IR zone check
  • PR 448 (Tom Aldcroft): Refactor code and change format of HTML report
  • PR 449 (Jean Connelly): Don't run flight starcheck from in the repo
• xija: 4.33.1 -> 4.33.2 (4.33.1 -> 4.33.2)
  • PR 141 (Tom Aldcroft): Ruff
  • PR 145 (Tom Aldcroft): Improved implementation for pars_dict and pars attributes + pickle test
  • PR 144 (Tom Aldcroft): Remove legacy tests

Related Issues

Fixes #1492
Fixes #1496
Fixes #1498
Fixes #1499
Fixes #1502
Fixes #1503
Fixes #1504
Fixes #1505
Fixes #1506
Fixes #1507
Fixes #1508
Fixes #1509
Fixes #1510
Fixes #1511
Fixes #1516
Fixes #1517