Deployment 2021-1

[gwbischof]

Previsit

• Make sure that the current latest environments are pushed to all the bl machines
• Skim the IPython startup files in profile_collection
  • Check if it's safe to start bsui remotely (does it touch any hardware?) - use git grep .put or git grep caput
• Check for outstanding PRs and issues on beamline repos
• Check if beamline specific packages pushed to the BL machines
• (Optional) Enable CI

Housekeeping

• Add BL staff to the BL GitHub organization as owners
• Work with BL staff to commit any un-committed changes to their profiles
• Tag the profile as-found as 2019C3.x
• Discuss with BL staff which conda envs they want to keep/delete and perform the cleanup
• Check/update the beamline's inventory with the BL staff (in https://github.com/NSLS-II/playbooks/blob/master/production)

Test deployment

• In ~/.bashrc add the following and remember to source ~/.bashrc afterward.

  export BLUESKY_LOG_FILE=/var/log/bluesky/bluesky.log
  export BLUESKY_IPYTHON_LOG_FILE=/var/log/bluesky/bluesky_ipython.log
  

  and (if needed) create those directories, making them world-read/write-able.
• Append to 00-startup.py https://gist.github.com/jklynch/a4366b8900ec0c03883403455ae711b2
• Run profile against new environment
  • BS_ENV=collection-2021-1.0-xpdacq
• Update the profile as needed to run:
  • potential issue with images in databroker V2
• Run acceptance tests (if any) and run a representative set of scans for the beamline
• Tag the updated profile as 2021C1.0
• Update BSUI via ansible to use the new environment (http://nsls-ii.github.io/deployment/upgrading-beamlines.html#change-bsui-s-default-environment)

[gwbischof]

During the testing phase of the deployment, we noticed that documents were not published to ZMQ as expected. We saw that it works correctly for older environments.

The cause of this was that this line fails in the newest environment, which prevents the remaining startup scripts from loading.
https://github.com/NSLS-II-PDF/profile_collection/blob/master/startup/94-load.py#L79

We are seeing this error when the previous line executes:

Which appears to be caused by this:

[danielballan]

A fix has been applied upstream in xpdacq and released in xpdacq 0.12.0. It needs to be verified at PDF.

The relevant commit is xpdAcq/xpdAcq@d0070ec. It removes use of pyFAI.gui.cli_calibration (which evidently imports PyQt5) and uses pyFAI.calibrant instead.

I propose to source-install xpdacq 0.12.0 to verify and then go through the process of making a new, fixed conda environment if it works.

[tacaswell]

This is what the preload logic in bsui does, but I think the logic is too restrictive (only looking for 2020-2.0* in the name).