summaryrefslogtreecommitdiff
path: root/lib
AgeCommit message (Collapse)AuthorFilesLines
2023-04-18Revert addition of SPACK_EDITOR pending review.Todd Gamblin5-160/+62
This reverts commit d8a26905ee0fc9e72a05a87bf7ced7e7fc2d4900. This reverts commit 1ee049ccc3d4d4bf1e8dafad0247f3cef01dda58. These were spuriously pushed to `develop`.
2023-04-18editing: add higher-precedence `SPACK_EDITOR` environment variableTodd Gamblin4-4/+57
Other tools like git support `GIT_EDITOR` which takes higher precedence than the standard `VISUAL` or `EDITOR` variables. This adds similar support for Spack, in the `SPACK_EDITOR` env var. - [x] consolidate editor code from hooks into `spack.util.editor` - [x] add more editor tests - [x] add support for `SPACK_EDITOR` - [x] add a documentation section for controlling the editor and reference it
2023-04-18refactor: unify use of spack.util.editorTodd Gamblin3-59/+104
Code from `spack.util.editor` was duplicated into our licensing hook in #11968. We really only want one place where editor search logic is implemented. This consolidates the logic into `spack.util.editor`, including a special case to run `gvim` with `-f`. - [x] consolidate editor search logic in spack.util.editor - [x] add tests for licensing case, where `Executable` is used instead of `os.execv` - [x] make `_exec_func` argument of `editor()` into public `exec_fn` arg - [x] add type annotations
2023-04-17Allow users to remove items from hierarchy per-path (#31351)Greg Becker4-2/+34
* lmod modules: allow users to remove items from hierarchy per-spec This allows MPI wrappers that depend on MPI to be removed from the MPI portion of the hierarchy and be made available when the appropriate compiler is loaded. module load gcc module load mpi-wrapper # implicitly loads mpi module load hdf5 This allows users to treat an mpi wrapper like an mpi program
2023-04-17Revert "move depfile logic into its own module, separate traversal logic ↵Harmen Stoppels2-264/+147
from model (#36911)" (#36985) This reverts commit a676f706a8783e9d517e95e8cd2b6997e527fc3c.
2023-04-17move depfile logic into its own module, separate traversal logic from model ↵Harmen Stoppels2-147/+264
(#36911)
2023-04-14Change environment modifications to escape with double quotes (#36789)Doug Jacobsen2-3/+42
This commit changes the environment modifications class to escape strings with double quotes instead of single quotes. Single quotes prevent the expansion of enviornment variables that are nested within environment variable definitions.
2023-04-14gitlab ci: Better tagging of "service" jobs (#36846)Scott Wittenburg1-0/+50
- Tag non-rebuild jobs to target a cheaper (and more highly available) subset of runners. - Add missing resource requests to these jobs as well.
2023-04-14netcdf: fix bugs introduced with multiple build systems split (#36825)Massimiliano Culpo2-9/+11
Fixes #36689 - The "base" builder class should be last in the MRO - `filter_compiler_wrappers` needs to be moved to builders - Decorating a function from a mixin class require using the correct metaclass for the mixin
2023-04-13Resolve `<include-fragment>` tags e.g. in github release pages (#36674)Wouter Deconinck4-2/+70
This aims to resolve #34164 by resolving the <include-fragment> tags that GitHub has started using for their release pages, see https://github.github.io/include-fragment-element/. This feels a bit hacky but intended as a starting point for discussion. After reading a page during spidering, it first parses for include-fragments, gets them all, and treats them all as separate pages. Then it looks for href links in both the page itself and the fragments. Co-authored-by: Alec Scott <alec@bcs.sh>
2023-04-13containerize: strip binaries in a less aggressive way (#36683)Massimiliano Culpo2-0/+22
2023-04-11Windows/MSVC: propagate all VCVARS changes to Spack env (#36582)John W. Parent1-4/+5
MSVC compilers rely on vcvars environment setup scripts to establish build environement variables neccesary for all projects to build successfully. Prior to this we were only piping LIB, INCLUDE, and PATH change through. Instead we need to propegate all changes to the env variables made by VCVARs in order to establish robust support for the MSVC compiler. This most significantly impacts projects that need to be build with NMake and MSBuild
2023-04-11Windows testing: reenable tests for "spack dependents" (#36786)markus-ferrell2-6/+0
All the tests worked out of the box. This just removes the skip statements.
2023-04-11Remove a unit-test that monkey-patches os.stat (#36757)Harmen Stoppels1-42/+0
"test_create_stage_root_bad_uid" started failing as pytest updated to v7.3.0
2023-04-10Ci backwards compat (#36045)kwryankrattiger5-25/+266
* CI: Fixup docs for bootstrap. * CI: Add compatibility shim * Add an update method for CI Update requires manually renaming section to `ci`. After this patch, updating and using the deprecated `gitlab-ci` section should be possible. * Fix typos in generate warnings * Fixup CI schema validation * Add unit tests for legacy CI * Add deprecated CI stack for continuous testing * Allow updating gitlab-ci section directly with env update * Make warning give good advice for updating gitlab-ci * Fix typo in CI name * Remove white space * Remove unneeded component of deprected-ci
2023-04-07Fix incorrect reformatting of spack.yaml (#36698)Massimiliano Culpo3-55/+101
* Extract a method to warn when the manifest is not up-to-date * Extract methods to update the repository and ensure dir exists * Simplify further the write method, add failing unit-test * Fix the function computing YAML equivalence between two instances
2023-04-06spack install: fail if --log-file and not --log-format (#36684)Massimiliano Culpo1-0/+4
fixes #34551 "spack install" now fails if a user passed the --logfile option without specifying a log format.
2023-04-05Update archspec to HEAD of develop (#36657)Massimiliano Culpo3-12/+62
2023-04-04Add workflow:rules:always to spack ci output (#36011)Jonathon Anderson1-0/+3
2023-04-04Make spack config update work on environments (#36542)Harmen Stoppels3-21/+46
Previously `spack -e bla config update <section>` would treat the environment config scope as standard config file instead of a single file config scope. This fixes that.
2023-04-04filter __spack_path_placeholder__ in generated module files after buildcache ↵Harmen Stoppels2-2/+2
install (#36611) * filter __spack_path_placeholder__ in generated module files after buildcache install * fix windows
2023-04-03modules: remove default symlink on uninstall (#36454)Xavier Delaruelle2-0/+16
When app is uninstalled, if it matches a default, then remove the default symlink targeting its modulefile. Until now, when a default were uninstalled, the default symlink were left pointing to a nonexistent modulefile.
2023-04-03Improve Dockerfile recipe generation (#35187)Massimiliano Culpo4-11/+142
- Update default image to Ubuntu 22.04 (previously was still Ubuntu 18.04) - Optionally use depfiles to install the environment within the container - Allow extending Dockerfile Jinja2 template - Allow extending Singularity definition file Jinja2 template - Deprecate previous options to add extra instructions
2023-04-03Rework error handling within the ASP logic program (#36536)Massimiliano Culpo4-123/+122
* Reduce effort on grounding by employing cardinality constraints If we use a cardinality constraint instead of a rule using pair of values, we'll end up grounding 1 rule instead of all the possible pair combinations of the allowed values. * Display all errors from concretization, instead of just one If clingo produces multiple "error" facts, we now print all of them in the error message. Before we were printing just the one with the least priority. Consolidate a few common patterns in concretize.lp to ensure that certain node attributes have one and only one value assigned. All errors are displayed, so use a single criterion instead of three. * Account for weights in concretize.lp To recover the optimization order we had before, account for weights of errors when minimizing. The priority is mapped to powers of 10, so to effectively get back the same results as with priorities.
2023-04-03modules: correctly detect explicit installation (#36533)Xavier Delaruelle16-47/+78
When generating modulefile, correctly detect software installation asked by user as explicit installation. Explicit installation status were previously fetched from database record of spec, which was only set after modulefile generation. Code is updated to pass down the explicit status of software installation to the object that generates modulefiles. Fixes #34730. Fixes #12105. A value for the explicit argument has to be set when creating a new installation, but for operations on existing installation, this value is retrieved from database. Such operations are: module rm, module refresh, module setdefaults or when get_module function is used. Update on the way tests that mimics an installation, thus explicit argument has to be set under such situation.
2023-03-31Allow configurable stage names (#36509)John W. Parent4-6/+20
Add `config:stage_name` which is a Spec format string that can customize the names of stages created by Spack. This was primarily created to allow generating shorter stage names on Windows (along with `config:build_stage`, this can be used to create stages with short absolute paths). By default, this is not set and the prior name stage format is used. This also removes the username component that is always added to Stage paths on Windows (if users want to include this, they can add it to the `build_stage`).
2023-03-31compiler wrapper: fix -Xlinker parsing (#35929)Harmen Stoppels2-35/+123
* compiler wrapper: fix -Xlinker parsing * handle the case of -rpath without value; avoid that we drop the flag * also handle the -Xlinker -rpath -Xlinker without further args case... * fix test * get rid of global $rp var, reduce branching
2023-03-31typehint a few globals (#36544)Harmen Stoppels6-8/+20
2023-03-30Add type-hints to spack.bootstrap (#36491)Massimiliano Culpo5-78/+117
2023-03-30Fix a couple of minor bugs with ASP weights (#36522)Massimiliano Culpo2-23/+14
Reorder versions so that deprecated ones are last. Account for default not used when the variant exists.
2023-03-28retry: bugfix: package requirements with git commits (#35057) (#36347)Todd Gamblin4-34/+234
- [x] Specs that define 'new' versions in the require: section need to generate associated facts to indicate that those versions are valid. - [x] add test to verify success with unknown versions. - [x] remove unneeded check that was leading to extra complexity and test failures (at this point, all `hash=version` does not require listing out that version in `packages.yaml`) - [x] unique index for origin (dont reuse 0) Co-authored-by: Peter Josef Scheibel <scheibel1@llnl.gov>
2023-03-28macos: set new ad-hoc signature with codesign after binary string ↵Harmen Stoppels3-10/+31
replacement (#35585)
2023-03-27Add `llnl.util.filesystem.find_first` (#36083)Harmen Stoppels2-1/+168
Add a `find_first` method that locates one instance of a file that matches a specified pattern by recursively searching a directory tree. Unlike other `find` methods, this only locates one file at most, so can use optimizations that avoid searching the entire tree: Typically the relevant files are at low depth, so it makes sense to locate files through iterative deepening and early exit.
2023-03-27modules: enhance help message (#36410)Xavier Delaruelle2-1/+54
Update tcl and lmod modulefile template to provide more information on help message (name, version and target) like done on whatis for lmod modulefiles.
2023-03-24modules: add support for append_flags/remove_flags (#36402)Xavier Delaruelle2-0/+4
Adapt tcl and lmod modulefile templates to generate append-path or remove-path commands in modulefile when respectively append_flags or remove_flags commands are defined in package for run environment. Fixes #10299.
2023-03-24modules tcl: simplify env modification block in template (#36334)Xavier Delaruelle3-8/+27
Simplify environment modification block in modulefile Tcl template by always setting a path delimiter to the prepend-path, append-path and remove-path commands. Remove --delim option to the setenv command as this command does not allow such option. Update test_prepend_path_separator test to explicitly check the 6 path-like commands that should be present in generated modulefile.
2023-03-23unit tests: don't hard-code arch in compiler config (#36360)Harmen Stoppels1-3/+0
This breaks when testing on non-x86_64 machines outside CI
2023-03-23Fix regression on compiler constraint (#36342)Massimiliano Culpo3-3/+68
fixes #36339 We were missing a rule that enforced a match between the `node_compiler` and the compiler used to satisfy a requirement. Fix compiler with custom, made up version too
2023-03-23Revert "Bugfix: package requirements with git commits (#35057)" (#36341)Harmen Stoppels4-215/+11
This reverts commit 3d597e29bee1429d2b8d204016df40b575900d66.
2023-03-23Bugfix: package requirements with git commits (#35057)Peter Scheibel4-11/+215
* Specs that define 'new' versions in the require: section need to generate associated facts to indicate that those versions are valid. * add test to verify success with unknown versions.
2023-03-23modules tcl: switch default all:autoload from none to direct (#36269)Xavier Delaruelle1-4/+7
Since environment-modules has support for autoloading since 4.2, and Spack-builds of it enable it by default, use the same autoload default for tcl as lmod.
2023-03-22docs: mention cuda multi-arch capability (#36321)Leopold Talirz1-1/+4
2023-03-20Package requirements: allow single specs in requirement lists (#36258)Peter Scheibel3-9/+35
If you have a "require:" section in your packages config, and you use it to specify a list of requirements, the list elements can now include strings (before this, each element in the list had to be a `one_of` or `any_of` specification, which is awkward if you wanted to apply just one spec with no alternatives).
2023-03-20spack install: simplify behavior when inside environments (#35206)Harmen Stoppels3-217/+183
Example one: ``` spack install --add x y z ``` is equivalent to ``` spack add x y z spack concretize spack install --only-concrete ``` where `--only-concrete` installs without modifying spack.yaml/spack.lock Example two: ``` spack install ``` concretizes current spack.yaml if outdated and installs all specs. Example three: ``` spack install x y z ``` concretizes current spack.yaml if outdated and installs *only* concrete specs in the environment that match abstract specs `x`, `y`, or `z`.
2023-03-20Remove unused `ignore` parameter of `extends()` directive (#35588)Adam J. Stewart1-23/+0
The `ignore` parameter was only used for `spack activate/deactivate`, and it isn't used by Spack Environments which have their own handling of file conflicts. We should remove it. Everything that handles `ignore=` was removed in #29317 and included in 0.19, when we removed `spack activate` and `spack deactivate` in favor of environments. So all of these usages removed here were already being ignored by Spack.
2023-03-20ci.py: remove redundant wrapper around get (#36188)Harmen Stoppels1-30/+24
2023-03-20modules tcl: fix autoload mechanism in template (#36237)Xavier Delaruelle1-13/+2
Adapt tcl modulefile template to call "module load" on autoload dependency without testing if this dependency is already loaded or not. The is-loaded test is not necessary, as module commands know how to cope with an already loaded module. With environment-modules 4.2+ (released in 2018) it is also important to have this "module load" command even if dependency is already loaded in order to record that the modulefile declares such dependency. This is important if you want to keep a consistent environment when a dependent module is unloaded. The "Autoloading" verbose message is also removed as recent module commands will report such information to the user (depending on the verbosity configured for the module command). Such change has been test successfully with Modules 3.2 (EL7), 4.5 (EL8) and 5.2 (latest) and also with Lmod 7 and 8 (as it is mentionned in Spack docs that Lmod can be used along with tcl modules). Dependencies are correctly loaded or unloaded, whether they are loaded/unloaded or not. This change fixes Tcl quoting issue introduced in #32853. Fixes #19155.
2023-03-19Fix case spelling for Lmod and Tcl (#36215)Xavier Delaruelle17-37/+37
2023-03-18cmake build system: make "generator" a variant (#35552)Massimiliano Culpo3-33/+64
2023-03-18Fix wrong computation of concrete specs due to a bug in intersects (#36194)Massimiliano Culpo2-1/+22
fixes #36190