spack - A flexible package manager that supports multiple versions, configurations, platforms, and compilers.

Age	Commit message (Collapse)	Author	Files	Lines
2022-01-14	Update copyright year to 2022	Todd Gamblin	1	-1/+1

2021-01-02	copyrights: update all files with license headers for 2021	Todd Gamblin	1	-1/+1
	- [x] add `concretize.lp`, `spack.yaml`, etc. to licensed files - [x] update all licensed files to say 2013-2021 using `spack license update-copyright-year` - [x] appease mypy with some additions to package.py that needed for oneapi.py
2020-02-19	Distributed builds (#13100)	Tamara Dahlgren	1	-3/+0
	Fixes #9394 Closes #13217. ## Background Spack provides the ability to enable/disable parallel builds through two options: package `parallel` and configuration `build_jobs`. This PR changes the algorithm to allow multiple, simultaneous processes to coordinate the installation of the same spec (and specs with overlapping dependencies.). The `parallel` (boolean) property sets the default for its package though the value can be overridden in the `install` method. Spack's current parallel builds are limited to build tools supporting `jobs` arguments (e.g., `Makefiles`). The number of jobs actually used is calculated as`min(config:build_jobs, # cores, 16)`, which can be overridden in the package or on the command line (i.e., `spack install -j <# jobs>`). This PR adds support for distributed (single- and multi-node) parallel builds. The goals of this work include improving the efficiency of installing packages with many dependencies and reducing the repetition associated with concurrent installations of (dependency) packages. ## Approach ### File System Locks Coordination between concurrent installs of overlapping packages to a Spack instance is accomplished through bottom-up dependency DAG processing and file system locks. The runs can be a combination of interactive and batch processes affecting the same file system. Exclusive prefix locks are required to install a package while shared prefix locks are required to check if the package is installed. Failures are communicated through a separate exclusive prefix failure lock, for concurrent processes, combined with a persistent store, for separate, related build processes. The resulting file contains the failing spec to facilitate manual debugging. ### Priority Queue Management of dependency builds changed from reliance on recursion to use of a priority queue where the priority of a spec is based on the number of its remaining uninstalled dependencies. Using a queue required a change to dependency build exception handling with the most visible issue being that the `install` method must install something in the prefix. Consequently, packages can no longer get away with an install method consisting of `pass`, for example. ## Caveats - This still only parallelizes a single-rooted build. Multi-rooted installs (e.g., for environments) are TBD in a future PR. Tasks: - [x] Adjust package lock timeout to correspond to value used in the demo - [x] Adjust database lock timeout to reduce contention on startup of concurrent `spack install <spec>` calls - [x] Replace (test) package's `install: pass` methods with file creation since post-install `sanity_check_prefix` will otherwise error out with `Install failed .. Nothing was installed!` - [x] Resolve remaining existing test failures - [x] Respond to alalazo's initial feedback - [x] Remove `bin/demo-locks.py` - [x] Add new tests to address new coverage issues - [x] Replace built-in package's `def install(..): pass` to "install" something (i.e., only `apple-libunwind`) - [x] Increase code coverage
2019-12-30	copyright: update copyright dates for 2020 (#14328)	Todd Gamblin	1	-1/+1

2019-01-01	copyright: update license headers for 2013-2019 copyright.	Todd Gamblin	1	-1/+1

2018-10-17	relicense: replace LGPL headers with Apache-2.0/MIT SPDX headers	Todd Gamblin	1	-23/+4
	- remove the old LGPL license headers from all files in Spack - add SPDX headers to all files - core and most packages are (Apache-2.0 OR MIT) - a very small number of remaining packages are LGPL-2.1-only
2018-03-24	Update copyright on LLNL files for 2018. (#7592)	Todd Gamblin	1	-1/+1

2017-11-04	Replace github.com/llnl/spack with github.com/spack/spack (#6142)	Todd Gamblin	1	-1/+1
	We moved to a new GitHub org! Now make the code and docs reflect that.
2017-09-06	Update copyright notices for 2017 (#5295)	Michael Kuhn	1	-1/+1

2017-06-24	Make LICENSE recognizable by GitHub. (#4598)	Todd Gamblin	1	-1/+1

2016-12-27	Ensure that every file in Spack has a license (#2659)	Adam J. Stewart	1	-0/+24
	* Ensure that every package has a license Also fixes URLs with http://http:// doubled. This is a continuation of #2656. * Add license to every file in Spack * Make sure Todd is the author of all packages * Fix flake8 tests * Don't license external Sphinx docs * Don't display licenses in tutorial example packages Also fixes typos and converts command-line examples from tcsh to bash, which is more common
2016-07-14	spack: introduce dependency types	Ben Boeckel	1	-0/+15
	deptypes: allow for different queries For things like Python modules, they are required for the build and runtime, but rather than adding a new parameter for what to query across the dependency DAG, just expose the recursive query parameter.