summaryrefslogtreecommitdiff
path: root/lib
AgeCommit message (Collapse)AuthorFilesLines
2017-09-17Add --show-log-on-error option to `spack install`Todd Gamblin4-14/+59
- converted `log_path` and `env_path` to properties of PackageBase. - InstallErrors in build_environment are now annotated with the package that caused them, in the 'pkg' attribute. - Add `--show-log-on-error` option to `spack install` that catches InstallErrors and prints the log to stderr if it exists. Note that adding a reference to the Pakcage allows a lot of stuff currently handled by do_install() and build_environment to be handled externally.
2017-09-17Remove redundant dest arguments in install.pyTodd Gamblin1-8/+8
2017-09-17Fix log error parsing bug introduced in c830eda0e (#5387)Todd Gamblin2-3/+3
- '\b' in regular expression needs to be in a raw string (r'\b') - Regression test that would've caught this was unintentionally disabled - This fixes the string and the test
2017-09-17Filter system paths from CMAKE_PREFIX_PATH (#5385)Pramod S Kumbhar1-0/+2
2017-09-16Improve external package location detection algorithm. (#5145)Kelly (KT) Thompson2-1/+8
Also inspect `PATH` to help locate an external package and provide a test for getting path from module's PATH. Fixes #5141
2017-09-16set CMAKE_PREFIX_PATH for cmake packages (#5364)Denis Davydov1-0/+5
* cmake: set CMAKE_PREFIX_PATH * cmake: use build/link immediate dependencies to construct CMAKE_PREFIX_PATH
2017-09-12Force reference consistency between Spec & PackageMassimiliano Culpo2-13/+23
The correct place to set the mutual references between spec and package objects is at the end of concretization. After a call to concretize we should now be ensured that spec is the same object as spec.package.spec. Code in `build_environment.py` that was performing the same operation has been turned into an assertion to be defensive on the new behavior.
2017-09-11clean up concreteness detectionTodd Gamblin3-99/+27
- Fixes bugs where concretization would fail due to an erroneously cached _concrete attribute. - Ripped out a bunch of code in spec.py that isn't needed/valid anymore: - The various concrete() methods on different types of Specs would attempt to statically compute whether the Spec was concrete. - This dates back to when DAGs were simpler and there were no optional dependencies. It's actually NOT possible to compute statically whether a Spec is concrete now. The ONLY way you know is if it goes through concretization and is marked concrete once that completes. - This commit removes all simple concreteness checks and relies only on the _concrete attribute. This should make thinking about concreteness simpler. - Fixed a couple places where Specs need to be marked concrete explicitly. - Specs read from files and Specs that are destructively copied from concrete Specs now need to be marked concrete explicitly. - These spots may previously have "worked", but they were brittle and should be explcitly marked anyway.
2017-09-11bugfix: concrete dependencies are now copied properly.Todd Gamblin1-25/+44
- Dependencies in concrete specs did not previously have their cache fields (_concrete, _normal, etc.) preserved. - _dup and _dup_deps weren't passing each other enough information to preserve concreteness properly, so only the root was properly preserved. - cached concreteness is now preserved properly for the entire DAG, not just the root. - added method docs.
2017-09-11Simplify logic in Spec.normalize()Todd Gamblin1-4/+4
2017-09-11Preserve original stack trace for UnsatisfiableSpecErrorTodd Gamblin1-3/+4
2017-09-11'with_or_without' accepts bool variantsMassimiliano Culpo2-36/+151
Fixes #4112 This commit extends the support of the AutotoolsPackage methods `with_or_without` and `enable_or_disable` to bool-valued variants. It also defines for those functions a convenience short-cut if the activation parameter is the prefix of a spec (like in `--with-{pkg}={prefix}`). This commit also includes: * Updates to viennarna and adios accordingly: they have been modified to use `enable_or_disable` and `with_or_without` * Improved docstrings in `autotools.py`. Raise `KeyError` if name is not a variant.
2017-09-09Fix name detection in HeaderList and LibraryList (#5118)Adam J. Stewart2-34/+68
* Fix name detection in HeaderList and LibraryList * Add support for CUDA header files
2017-09-08Bootstrap environment-modulesMatthew Scott Krafczyk4-112/+233
Renames the existing bootstrap command to 'clone'. Repurposes 'spack bootstrap' to install packages that are useful to the operation of Spack (for now this is just environment-modules). For bash and ksh users running setup-env.sh, if a Spack-installed instance of environment-modules is detected and environment modules and dotkit are not externally available, Spack will define the 'module' command in the user's shell to use the environment-modules built by Spack.
2017-09-07dump environment in sourceable form (#5301)Rob Latham1-1/+1
First, quote the environment variable values. Second, export the variables. sorry, this is bourn-shell syntax. Happy to consider a shell-independent way to do this, but spack is already using sh-like "env=value"
2017-09-06Update copyright notices for 2017 (#5295)Michael Kuhn232-232/+232
2017-09-05Added support for querying by tags (#4786)Massimiliano Culpo9-127/+518
* Added support to query packages by tags. - The querying commands `spack list`, `spack find` and `spack info` have been modified to support querying by tags. Tests have been added to check that the feature is working correctly under what should be the most frequent use cases. * Refactored Repo class to make insertion of new file caches easier. - Added the class FastPackageChecker. This class is a Mapping from package names to stat info, that gets memoized for faster access. - Extracted the creation of a ProviderIndex to its own factory function. * Added a cache file for tags. - Following what was done for providers, a TagIndex class has been added. This class can serialize and deserialize objects from json. Repo and RepoPath have a new method 'packages_with_tags', that uses the TagIndex to compute a list of package names that have all the tags passed as arguments. On Ubuntu 14.04 the effect if the cache reduces the time for spack list from ~3sec. to ~0.3sec. after the cache has been built. * Fixed colorization of `spack info`
2017-09-05Fixed bug in `spack env` due to missing argument. (#5280)Massimiliano Culpo3-7/+58
This command broke after #5109. It was using the default value for the "dirty" argument in `setup_package`. Now it adopts the same logic as in `spack install`. Changed help for '--clean' and '--dirty'. Improved coverage of spack env.
2017-09-01Set default cmake build_type to Release for llvmscheibelp1-1/+1
Override CMake "build_type" variant to default to "Release" for llvm package.
2017-08-31Patch directive allows non-archives (#5197)Massimiliano Culpo5-1/+100
- Don't expand downloaded patch file if it is not gzipped/tar'd/zipped/etc.
2017-08-30add optional maintainers property to package (#5230)Denis Davydov2-0/+9
* add optional package maintainers
2017-08-30Slightly better error matching when parsing spack logs (#5236)Andrey Prokopenko1-1/+1
2017-08-29Added unit tests for Spec.__init__ exceptional pathsalalazo1-0/+11
2017-08-29Fixed bug in Spec._dup, updated docstringalalazo1-7/+17
The private method `Spec._dup` was missing a line (when setting compiler flags the parent spec was not set to `self`). This resulted in an inconsistent state of the duplicated Spec. This problem has been fixed here. The docstring of `Spec._dup` has been updated.
2017-08-29Make Spec construction simpler (#5227)Todd Gamblin1-27/+26
2017-08-28Add --show-full-compiler option to 'spack find'Matthew Scott Krafczyk2-2/+12
When 'spack find' is invoked with the '--show-full-compiler' option, the compiler flags and version are shown for each spec that is found.
2017-08-25Removed default value for 'dirty' function argument. (#5109)Massimiliano Culpo1-3/+3
This change is done to avoid inconsistencies during refactoring. The rationale is that functions at different levels in the call stack all define a default for the 'dirty' argument. This PR removes the default value for all the functions except the top-level one (`PackageBase.do_install`). In this way not defining 'dirty' will result in an error, instead of the default value being used. This will reduce the risk of having an inconsistent behavior after a refactoring.
2017-08-25Fix copyright years in spack create template (#5203)Michael Kuhn1-1/+1
2017-08-25Improve Ubuntu arch detection (#2649)Michael Kuhn1-1/+6
Ubuntu uses a YY.{04,10} release scheme, where YY.04 is not necessarily binary-compatible with YY.10.
2017-08-25Link extra_rpaths from compilers.yaml at build time (#5211)scheibelp1-0/+2
2017-08-25patch config.guess for any ppc64le arch (#5215)Gregory Lee1-1/+1
2017-08-25Improve grammar in build log error message. (#5214)Todd Gamblin1-2/+7
- "1 error found" instead of "1 errors found" - don't print any build log context if no errors were found; just refer the user to the build log.
2017-08-25Add contributors link to Sphinx docs (#5213)Mark C. Miller1-1/+1
2017-08-25Respect --insecure (-k) flag when fetching list_url. (#5178)Sergey Kosukhin1-3/+33
* Respect --insecure when fetching list_url. * Ensure support for Python 2.6, and that urlopen works for python versions prior 2.7.9 and between 3.0 and 3.4.3.
2017-08-24test/gpg: init from the testing key directoryBen Boeckel1-11/+2
The old testing pattern set an attribute on the parser directly. Now that there is a parsed flag, use it instead.
2017-08-24gpg: add an argument for the import directoryBen Boeckel1-2/+8
This is hidden because it is only meant for use by the tests.
2017-08-23Improve Spec literals, add Spec.from_dict() (#5151)Massimiliano Culpo4-199/+472
* Simplified Spec.__init__ signature by removing the *dep_like argument. The `*dep_like` argument of `Spec.__init__` is used only for tests. This PR removes it from the call signature and introduces an equivalent fixture to be used in tests. * Refactored ``spec_from_dict`` to be a static method of ``Spec`` The fixture ``spec_from_dict`` has been refactored to be a static method of ``Spec``. Test code has been updated accordingly. Added tests for exceptional paths. * Renamed argument `unique` to `normal` + added LazySpecCache class As requested in the review the argument `unique` of `Spec.from_literal` has been renamed to `normal`. To avoid eager evaluations of `Spec(spec_like)` expressions a subclass of `collections.defaultdict` has been introduced. * Spec object can be keys of the dictionary for a spec literal. Added back the possibility use a spec directly as a key. This permits to build DAGs that are partially normalized.
2017-08-23Add --source option to spack install (#4102)Christoph Junghans3-0/+27
- -- source will copy source into prefix along with the package. - added a test for --source, as well
2017-08-23add test for lua and node patching in sbang (#5169)healther1-6/+42
* add test for lua and node handling in sbang patching (cf #5086)
2017-08-22Add testing for new build output.Todd Gamblin3-2/+55
- Update handling of ChildError so that its output is capturable from a SpackCommand - Update cmd/install test to make sure Python and build log output is being displayed properly.
2017-08-22Make install command reusable within single Spack runTodd Gamblin3-21/+48
- install and probably other commands were designed to run once, but now we can to test them from within Spack with SpackCommand - cmd/install.py assumed that it could modify do_install in PackageBase and leave it that way; this makes the decorator temporary - package.py didn't properly initialize its stage if the same package had been built successfully before (and the stage removed). - manage stage lifecycle better and remember when Package needs to re-create the stage
2017-08-22SpackCommand uses log_output to capture command output.Todd Gamblin5-43/+29
2017-08-22log_ouptut can take either a filename or a file objectTodd Gamblin1-55/+93
2017-08-22Display build output on ProcessError, instead of Python context.Todd Gamblin2-29/+200
- If a failure comes from an external command and NOT the Python code, display errors highlighted with some context. - Add some rudimentary support for parsing errors out of the build log (not very sophisticated yet). - Build errors in Python code will still display with Python context.
2017-08-22Limit package context to 3 lines and colorize in error output.Todd Gamblin1-4/+16
2017-08-22Config scopes are now returning OrderedDicts instead of dicts. (#5183)Massimiliano Culpo3-3/+73
It seems 8f21332fec4c8adb5349ff90e30bb0e4f75e090e introduced a bug in that normal dictionaries are returned from ConfigScope objects instead of OrderedDicts. This is fixed here.
2017-08-21Add environment variables to path substitutionMatthew Scott Krafczyk3-22/+52
Update documentation on config file variable substitutions and add expansion of environment variables in config files.
2017-08-21Added custom messages for conflicts directive. fixes #4965 (#5083)Massimiliano Culpo2-8/+26
Users can now add an optional custom message to the conflicts directive. Layout on screen has been changed to improve readability and the long spec is shown in tree format. Two conflicts in `espresso` have been modified to showcase the feature.
2017-08-20Unbuffer so that output from packages appears when redirectingTodd Gamblin2-2/+65
- Python I/O would not properly interleave (or appear) with output from subcommands. - Add a flusing wrapper around sys.stdout and sys.stderr when redirecting, so that Python output is synchronous with that of subcommands.
2017-08-20Add tests for output redirection.Todd Gamblin1-0/+95