Updating to version 3.1.1

.version

@@ -1 +1 @@
-3.0.2
+3.1.1

Config/Delta_Config.py

@@ -220,9 +220,9 @@
 # Note that sys, os, re, and subprocess can not be tracked due to the way that python tracking works.
 # TODO modify these paths
 python_pkg_patterns = [
-  { 'k_s' : 'SKIP', 'kind' : 'path', 'patt' : r"^[^/]"               },  # SKIP all built-in packages
   { 'k_s' : 'SKIP', 'kind' : 'name', 'patt' : r"^_"                  },  # SKIP names that start with a underscore
   { 'k_s' : 'SKIP', 'kind' : 'name', 'patt' : r".*\."                },  # SKIP all names that are divided with periods: a.b.
+  { 'k_s' : 'SKIP', 'kind' : 'name', 'patt' :  r"\/sw\/external\/python\/anaconda3_[^/]*\/.*"}, # Skip anaconda3 builtins 
   { 'k_s' : 'KEEP', 'kind' : 'path', 'patt' : r".*conda\/.*"          },  # KEEP all packages installed by users
   { 'k_s' : 'KEEP', 'kind' : 'path', 'patt' : r".*\/site-packages\/.*" },  # KEEP all site-packages 
   { 'k_s' : 'KEEP', 'kind' : 'path', 'patt' : r"^\/delta/scratch\/.*"  },  # KEEP all packages the system project directories
@@ -232,4 +232,9 @@
   { 'k_s' : 'SKIP', 'kind' : 'path', 'patt' : r"^\/opt"               },  # SKIP all python packages in /opt except for ones in .*/site-packages/
   { 'k_s' : 'SKIP', 'kind' : 'path', 'patt' : r"^\/home"              },  # SKIP all other packages in user locations
   { 'k_s' : 'SKIP', 'kind' : 'path', 'patt' : r"^\/work"              },  # SKIP all other packages in user locations
+  { 'k_s' : 'SKIP', 'kind' : 'path', 'patt' : r"^[^/]"               }  # SKIP all built-in packages
+
 ]
+
+
+

README.md

@@ -28,7 +28,15 @@ effective, and systematic way.
 
 ## Original Documentation
 
-Installation and Use of XALT is provided at https://xalt.readthedocs.io website.
+* Documentation:   https://xalt.readthedocs.org
+* GitHub:          https://github.com/xalt/xalt
+
+
+## XALT Mailing list
+
+* mailto:xalt-users@lists.sourceforge.net.
+
+Please go to https://sourceforge.net/projects/xalt/lists/xalt-users to join.
 
 
 # NCSA SPIN Summer 2024 Documentation
@@ -55,6 +63,7 @@ If you want the XALT module to be always available, simply include the changes t
 XALT is located in `/sw/workload/` on Delta. The source (this repository) is in `/sw/workload/xalt2/xalt_src` and the executables are in `/sw/workload/xalt2/xalt`.
 
 Each build of XALT requires a configuration file. The configuration file is in [Delta_config.py](https://github.com/ScreamingPigeon/xalt/blob/main/Config/Delta_Config.py).
+Note: XALT tracks linking on all hostnames, so both compute and login nodes.
 
 Relevant information on configuring XALT can be found here
 - [Downloading XALT and Configuring it for your site](https://xalt.readthedocs.io/en/latest/020_site_configuration.html)
@@ -146,13 +155,39 @@ A condensed explanation of the key idea behind XALT is available [here](https://
 
 The main changes in this fork are
 1. XALT was segfaulting when wrapped around `lsof` with debugging on. This was fixed in XALT 3.0.3, but this was forked from 3.0.2 and had a near-identical fix.
-2. This fork of XALT supports creating start records for ALL PROCESSES as opposed to just MPI jobs. This can be achieved by setting `XALT_ALWAYS_CREATE_START=yes` in your environment. This has been included in the modulefile
+2. (No longer available) This fork of XALT supports creating start records for ALL PROCESSES as opposed to just MPI jobs. This can be achieved by setting `XALT_ALWAYS_CREATE_START=yes` in your environment. This has been included in the modulefile
 3. Comments around signal handling in [`src/libxalt/xalt_initialize.c`](https://github.com/ScreamingPigeon/xalt/blob/main/src/libxalt/xalt_initialize.c). 
 4. Inclusion of a custom config, build script, modulefile, epilog script, and a python cli-tool
 
 
 ### Miscellaneous Notes
 
+#### Symlinks
+##### Pre-Execution Filtering
+
+The XALT filters uses the path of the target used to build the symlink, as opposed to the path of the link itself. For example, if you have the rules
+  - KEEP, `/usr/bin/gcc`
+  - SKIP, `/sw/*`
+
+and the following file in `/sw/workload/xalt/`
+```
+lrwxrwxrwx  1 prakhar7      root   12 Jul 23 11:38 gcc -> /usr/bin/gcc
+
+```
+XALT uses the `/usr/bin/gcc` path while filtering. 
+
+##### Record Generation
+Run Records contain references to the symlink's path
+```
+  "cmdlineA": ["/sw/workload/xalt2/gcc"],
+```
+
+However, in the `UserT` key, we see
+```
+    "exec_path": "/usr/bin/gcc",
+```
+Therefore run records capture both paths
+
 #### Profiling
 
 XALT comes with a special build flag `--with-tmpdir=` which allows the user to specify the directory for intermediate logs, as opposed to the default which is `/dev/shm`. Attempting to use $HOME in this flag leads to signifcant slowdowns
@@ -262,4 +297,5 @@ trap sighandler TERM
 
 ### Existing Issues
 - The generation of link records is not consistent among different compilers. Possibly due to the order in which $PATH is set. Seems to work with the  `/bin/gcc` and the aocc module. Link records do not generate with the gcc module
-- Need to turn on tracking for compilers on login nodes. 
+- Need to turn on tracking for compilers on login nodes.
+- The `$APPTAINER_BINDPATH` variable set in the modulefile interferes with building containers. Builds fail due to lack of a mount point for these directories.

README.new

@@ -0,0 +1,19 @@
+XALT 3.0+
+    (3.0.1) * PR60: allow --with-primeNumber=0 to not generated numbered sub-directories
+    (3.0.2) * Add icx, ifx and icpx to list of otherCmplrA[]
+            * Avoid generating extra end records when a process forks.
+              Only generate an end record when the pid is the same as in myinit().
+	    * Issue #63: Wrap the pre_ingest_filter and pkgFilter libraries in XALTdb.py
+	    * Issue #63: Test that the pre_ingest_filter and pkgFilter libraries as late as possible
+	    * Issue #63: Make *.in.py files produce a msg that they should not be run.  Instead
+	      run the installed version.
+    (3.0.3) * Force shells like bash, csh, etc be ignored
+    (3.0.4) * Change configure.ac to run all tests before erroring out
+            * SKIP all shells in src/tmpl/xalt_config.py
+XALT 3.1+
+    (3.1)   * Using UUID Version 7 when the routine getentropy() is available.
+    (3.1.1) * Add support for TACC's vista compute node names. (i123-456)
+            * using -e flag to check for .git not -d
+
+
+