Skip to content

Enumerate variables needed by the HTCondor workflow#376

Closed
duncanmmacleod wants to merge 3 commits intogwpy:masterfrom
duncanmmacleod:no-getenv
Closed

Enumerate variables needed by the HTCondor workflow#376
duncanmmacleod wants to merge 3 commits intogwpy:masterfrom
duncanmmacleod:no-getenv

Conversation

@duncanmmacleod
Copy link
Member

This PR closes #375 by replacing the use of getenv=true with a hardcoded set of environment variables to pass through from the submit environment.

instead enumerate the variables we want to propagate from the submit environment
@codecov
Copy link

codecov bot commented Aug 25, 2023

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 49.65%. Comparing base (958795b) to head (bf72398).
⚠️ Report is 48 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #376      +/-   ##
==========================================
- Coverage   50.27%   49.65%   -0.62%     
==========================================
  Files          60       60              
  Lines        8677     8824     +147     
==========================================
+ Hits         4362     4381      +19     
- Misses       4315     4443     +128     
Flag Coverage Δ
Linux 49.65% <100.00%> (-0.62%) ⬇️
python3.10 49.65% <100.00%> (-0.62%) ⬇️
python3.11 49.65% <100.00%> (?)
python3.7 ?
python3.8 ?
python3.9 49.65% <100.00%> (-0.62%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@eagoetz
Copy link
Collaborator

eagoetz commented Aug 29, 2023

@duncanmmacleod Thanks, do we also need CONDA_EXE?

@eagoetz eagoetz added this to the 2.2.0 milestone Sep 12, 2023
@duncanmmacleod
Copy link
Member Author

@duncanmmacleod Thanks, do we also need CONDA_EXE?

I don't see any references to CONDA_EXE in this project.

@eagoetz eagoetz modified the milestones: 2.2.0, 2.2.1 Sep 19, 2023
@eagoetz eagoetz modified the milestones: 2.2.0, 2.2.1 Nov 1, 2023
@eagoetz eagoetz modified the milestones: 2.2.1, 2.2.2 Feb 5, 2024
@eagoetz
Copy link
Collaborator

eagoetz commented Feb 8, 2024

@duncanmmacleod Thanks, do we also need CONDA_EXE?

I don't see any references to CONDA_EXE in this project.

@duncanmmacleod the reason I ask is because the code wants to get the conda environment used at the time pages are generated. Like here: https://github.com/gwdetchar/gwdetchar/blob/f79547a178c16b9a6b9626d23d656fb025c10338/gwdetchar/io/html.py#L51. Wouldn't this mean we need CONDA_EXE or maybe you are saying we do not because gwsumm runs from within a conda environment. Can you confirm? Thanks

@eagoetz eagoetz modified the milestones: 2.2.2, 2.2.3 Feb 14, 2024
so that it is available in conda to generate the package list
@duncanmmacleod
Copy link
Member Author

Wouldn't this mean we need CONDA_EXE or maybe you are saying we do not because gwsumm runs from within a conda environment. Can you confirm? Thanks

I have added CONDA_EXE.

@eagoetz eagoetz modified the milestones: 2.2.3, 2.3.0 Mar 4, 2024
@eagoetz eagoetz modified the milestones: 2.3.0, 2.3.1 Apr 28, 2025
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request May 7, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request May 8, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375
@eagoetz eagoetz removed this from the 2.3.1 milestone May 8, 2025
@eagoetz
Copy link
Collaborator

eagoetz commented May 8, 2025

I'll close this PR as I'd like to use #429 instead. I hope to be able to remove getenv = true in the next release after this one (this next one is much more urgent for scitokens)

@eagoetz eagoetz closed this May 8, 2025
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 3, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 18, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 18, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 18, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 19, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 19, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 19, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz pushed a commit to eagoetz/gwsumm that referenced this pull request Nov 19, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by gwpy#376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes gwpy#375

# Conflicts:
#	gwsumm/batch.py
eagoetz added a commit that referenced this pull request Nov 25, 2025
See https://computing.docs.ligo.org/guide/htcondor/environment/?h=getenv#getenv. This PR is inspired by #376, but I wanted to keep the existing code as simple as possible to avoid confusion.

Closes #375

Co-authored-by: Evan Goetz <evan.goetz@ligo.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove getenv=true as a (default) condor_submit command

2 participants