summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2021-10-28r-fansi: add 0.5.0 (#26986)Manuela Kuhn1-2/+2
2021-10-28r-lifecycle: add 1.0.1 (#26975)Manuela Kuhn1-2/+3
2021-10-28r-parallelly: add 1.28.1 (#26974)Manuela Kuhn1-2/+2
2021-10-28r-vctrs: add 0.3.8 (#26966)Manuela Kuhn1-3/+4
2021-10-28bugfix: config edit should work with a malformed `spack.yaml`Todd Gamblin4-10/+106
If you don't format `spack.yaml` correctly, `spack config edit` still fails and you have to edit your `spack.yaml` manually. - [x] Add some code to `_main()` to defer `ConfigFormatError` when loading the environment, until we know what command is being run. - [x] Make `spack config edit` use `SPACK_ENV` instead of the config scope object to find `spack.yaml`, so it can work even if the environment is bad. Co-authored-by: scheibelp <scheibel1@llnl.gov>
2021-10-28bugfix: `spack config get <section>` in environmentsTodd Gamblin1-4/+4
`spack config get <section>` was erroneously returning just the `spack.yaml` for the environment. It should return the combined configuration for that section (including anything from `spack.yaml`), even in an environment. - [x] reorder conditions in `cmd/config.py` to fix
2021-10-28config: ensure that options like `--debug` are set firstTodd Gamblin1-17/+38
`spack --debug config edit` was not working properly -- it would not do show a stack trace for configuration errors. - [x] Rework `_main()` and add some notes for maintainers on where things need to go for configuration to work properly. - [x] Move config setup to *after* command-line parsing is done. Co-authored-by: scheibelp <scheibel1@llnl.gov>
2021-10-28errors: Rework error handling in `main()`Todd Gamblin1-23/+48
`main()` has grown, and in some cases code that can generate errors has gotten outside the top-level try/catch in there. This means that simple errors like config issues give you large stack traces, which shouldn't happen without `--debug`. - [x] Split `main()` into `main()` for the top-level error handling and `_main()` with all logic.
2021-10-28r-ellipsis: add 0.3.2 (#26965)Manuela Kuhn1-2/+2
2021-10-28r-rlang: add 0.4.12 (#26963)Manuela Kuhn1-2/+2
2021-10-28r-mvtnorm: add 1.1-3 (#26957)Manuela Kuhn1-2/+2
2021-10-28r-lme4: add 1.1-27.1 (#26955)Manuela Kuhn1-3/+3
* r-lme4: add 1.1-27.1 * Use cran instead of explicit url
2021-10-28llvm: fix gcc11 build for @11 (#27013)Manuela Kuhn1-1/+1
2021-10-28New versions of py-flake8 and py-pyflakes (#27008)iarspider2-26/+41
* New versions of py-flake8 and py-pyflakes * Changes from review
2021-10-28config: fix `SPACK_DISABLE_LOCAL_CONFIG`, remove `$user_config_path` (#27022)Todd Gamblin7-19/+15
There were some loose ends left in ##26735 that cause errors when using `SPACK_DISABLE_LOCAL_CONFIG`. - [x] Fix hard-coded `~/.spack` references in `install_test.py` and `monitor.py` Also, if `SPACK_DISABLE_LOCAL_CONFIG` is used, there is the issue that `$user_config_path`, when used in configuration files, makes no sense, because there is no user config scope. Since we already have `$user_cache_path` in configuration files, and since there really shouldn't be *any* data stored in a configuration scope (which is what you'd configure in `config.yaml`/`bootstrap.yaml`/etc., this just removes `$user_config_path`. There will *always* be a `$user_cache_path`, as Spack needs to write files, but we shouldn't rely on the existence of a particular configuration scope in the Spack code, as scopes are configurable, both in number and location. - [x] Remove `$user_config_path` substitution. - [x] Fix reference to `$user_config_path` in `etc/spack/deaults/bootstrap.yaml` to refer to `$user_cache_path`, which is where it was intended to be.
2021-10-28depend on libevent when +pmix (#27020)Daryl W. Grunau1-1/+2
Co-authored-by: Daryl W. Grunau <dwg@lanl.gov>
2021-10-28mochi-margo: add version 0.9.6 (#26951)Phil Carns1-0/+1
2021-10-28add MPItrampoline 2.0.0 (#27019)Valentin Churavy1-0/+1
2021-10-28New version: py-distro 1.6.0 (#27003)iarspider1-0/+1
2021-10-28New versions: docutils 0.17, 0.17.1, 0.18 (#27005)iarspider1-0/+3
2021-10-28Deactivate previous env before activating new one (#25409)Harmen Stoppels5-22/+108
* Deactivate previous env before activating new one Currently on develop you can run `spack env activate` multiple times to switch between environments, but they leave traces, even though Spack only supports one active environment at a time. Currently: ```console $ spack env create a $ spack env create b $ spack env activate -p a [a] $ spack env activate -p b [b] [a] $ spack env activate -p b [a] [b] [a] $ spack env activate -p a [a] [b] [c] $ echo $MANPATH | tr ":" "\n" /path/to/environments/a/.spack-env/view/share/man /path/to/environments/a/.spack-env/view/man /path/to/environments/b/.spack-env/view/share/man /path/to/environments/b/.spack-env/view/man ``` This PR fixes that: ```console $ spack env activate -p a [a] $ spack env activate -p b [b] $ spack env activate -p a [a] $ echo $MANPATH | tr ":" "\n" /path/to/environments/a/.spack-env/view/share/man /path/to/environments/a/.spack-env/view/man ```
2021-10-28spack setup-env.sh: make zsh loading async compatible, and ~10x faster (in ↵Tom Scogland4-10/+26
some cases) (#26120) Currently spack is a bit of a bad actor as a zsh plugin, and it was my fault. The autoload and compinit should really be handled by the user, as was made abundantly clear when I found spack was doing completion initialization for *all* of my plugins due to a deferred setup that was getting messed up by it. Making this conditional took spack load time from 1.5 seconds (with module loading disabled) to 0.029 seconds. I can actually afford to load spack by default with this change in. Hopefully someday we'll do proper zsh completion support, but for now this helps a lot. * use zsh hist expansion in place of dirname * only run (bash)compinit if compdef/complete missing * add zsh compiled files to .gitignore * move changes to .in file, because spack
2021-10-28New version: py-fasteners 0.16.3 (#27006)iarspider1-1/+3
2021-10-28Remove failing macOS test (#27009)Harmen Stoppels1-14/+0
2021-10-28Add Pybind11 v2.8 (#26867)Brent Huisman1-1/+4
* Add Pybind11 v2.8 * Add Python dependency * Update package.py * Added Pybind v2.8.1
2021-10-28YamlFilesystemView: improve file removal performance via batching (#24355)Robert Blackwell3-17/+23
* Drastically improve YamlFilesystemView file removal via batching The `remove_file` routine has to check if the file is owned by multiple packages, so it doesn't remove necessary files. This is done by the `get_all_specs` routine, which walks the entire package tree. With large numbers of packages on shared file systems, this can take seconds per file tree traversal, which adds up extremely quickly. For example, a single deactivate of a largish python package in our software stack on GPFS took approximately 40 minutes. This patch simply replaces `remove_file` with a batch `remove_files` routine. This routine removes a list of files rather than a single file, requiring only one traversal per batch. In practice this means a package can be removed in seconds time, rather than potentially hours, essentially a ~100x speedup (ignoring initial deactivation logic, which takes about 3 minutes in our test setup).
2021-10-28cmake: add v3.21.4, v3.20.6 (#27004)Harmen Stoppels1-0/+2
2021-10-28dtcmp & lwgrp: add shared variant (#26999)Cameron Stanavige2-5/+20
2021-10-28Fix sbang hook for non-writable files (#27007)Michael Kuhn2-0/+15
* Fix sbang hook for non-writable files PR #26793 seems to have broken the sbang hook for files with missing write permissions. Installing perl now breaks with the following error: ``` ==> [2021-10-28-12:09:26.832759] Error: PermissionError: [Errno 13] Permission denied: '$SPACK/opt/spack/linux-fedora34-zen2/gcc-11.2.1/perl-5.34.0-afuweplnhphcojcowsc2mb5ngncmczk4/bin/cpanm' ``` Temporarily add write permissions to the original file so it can be overwritten with the patched one. And test that file permissions are preserved in sbang even for non-writable files Co-authored-by: Harmen Stoppels <harmenstoppels@gmail.com>
2021-10-28nsimd: add v3.0.1, determine SIMD variant automatically by default (#26850)Erik Schnetter1-3/+35
2021-10-28buildcaches: fix directory link relocation (#26948)Paul Ferrell3-3/+62
When relocating a binary distribution, Spack only checks files to see if they are a link that needs to be relocated. Directories can be such links as well, however, and need to undergo the same checks and potential relocation.
2021-10-27llvm: use cmake helper functions (#26988)Seth R. Johnson1-101/+64
* llvm: use cmake helper functipack stns * llvm: review feedback
2021-10-27New versions: py-cffi 1.15.0, 1.14.6 (#26979)iarspider1-1/+2
* New versions: py-cffi 1.15.0, 1.14.6 * Changes from review
2021-10-27New versions of py-cachetools (#26976)iarspider1-0/+4
* New versions of py-cachetools * Changes from review
2021-10-27New version: py-bottle@0.12.19 (#26973)iarspider1-1/+2
* New version: py-bottle@0.12.19 * Changes from review
2021-10-27hpcviewer: add support for macosx, add version 2021.10 (#26823)Mark W. Krentel1-18/+78
2021-10-27Add w3emc version 2.9.1 (#26880)Kyle Gerheiser1-0/+1
2021-10-27New version: py-contextlib2 21.6.0 (#26985)iarspider1-3/+5
2021-10-27Remove documentation tests from GitHub Actions (#26981)Massimiliano Culpo3-61/+6
We moved documentation tests to readthedocs since a while, so remove the one on GitHub.
2021-10-27New versions: py-boken@2.3.3, 2.4.0, 2.4.1 (#26972)iarspider1-4/+23
2021-10-27New version: py-certifi 2021.10.8 (#26978)iarspider1-0/+1
2021-10-27hdf5-vol-log: add new package (#26956)H. Joe Lee1-0/+32
2021-10-27New version: py-commonmark 0.9.1 (#26983)iarspider1-1/+3
2021-10-27fftw: add v3.3.10 (#26982)Mosè Giordano1-0/+1
2021-10-27fontconfig: add v2.13.94 and fix test with dash (#26961)Bernhard Kaindl1-0/+5
Fix install --test=root with /bin/sh -> dash: A test uses SIGINT SIGTERM SIGABRT EXIT for trap -> use signal numbers
2021-10-27perl-extutils-installpaths: depend on perl-extutils-config (#26969)Bernhard Kaindl1-0/+2
2021-10-27strumpack: add v6.1.0, remove unused variants (#26971)Pieter Ghysels1-7/+2
2021-10-27recola: fix compilation (#26634)Valentin Volkl2-2/+5
* recola: fix compilation * Update var/spack/repos/builtin/packages/recola-sm/package.py Co-authored-by: Seth R. Johnson <johnsonsr@ornl.gov> * flake8 * fixes * fix typo * fix typo Co-authored-by: Seth R. Johnson <johnsonsr@ornl.gov>
2021-10-27tests: speed up `spack list` tests (#26958)Todd Gamblin2-36/+41
`spack list` tests are not using mock packages for some reason, and many are marked as potentially slow. This isn't really necessary; we don't need 6,000 packages to test the command. - [x] update tests to use `mock_packages` fixture - [x] remove `maybeslow` annotations
2021-10-27Allow non-UTF-8 encoding in sbang hook (#26793)Harmen Stoppels2-71/+181
Currently Spack reads full files containing shebangs to memory as strings, meaning Spack would have to guess their encoding. Currently Spack has a fixed guess of UTF-8. This is unnecessary, since e.g. the Linux kernel does not assume an encoding on paths at all, it's just bytes and some delimiters on the byte level. This commit does the following: 1. Shebangs are treated as bytes, so that e.g. latin1 encoded files do not throw UnicodeEncoding errors, and adds a test for this. 2. No more bytes than necessary are read to memory, we only have to read until the first newline, and from there on we an copy the file byte by bytes instead of decoding and re-encoding text. 3. We cap the number of bytes read to 4096, if no newline is found before that, we don't attempt to patch it. 4. Add support for luajit too. This should make Spack both more efficient and usable for non-UTF8 files.