summaryrefslogtreecommitdiff
AgeCommit message (Collapse)AuthorFilesLines
2022-01-12unparser: Don't omit parenthesis when unparsing a sliceTodd Gamblin1-14/+39
Backport of https://github.com/python/cpython/commit/c102a148256b00b7d48c51a1a97df19042e603de Includes support for Python 2.
2022-01-12unparser: Don't put unnecessary parentheses on class declarationsTodd Gamblin1-1/+1
Backport of * https://github.com/python/cpython/commit/25160cdc4775a1ddb4e37c8bf5a6e31ad9c146ed
2022-01-12package_hash: add test to ensure that every package in Spack can be unparsedTodd Gamblin3-7/+30
- [x] add option to canonical source to *not* filter multimethods - [x] add test to unparse every package in builtin
2022-01-12package_hash: add test to ensure consistency across Python versionsTodd Gamblin7-0/+2486
Our package hash is supposed to be consistent from python version to python version. Test this by adding some known unparse inputs and ensuring that they always have the same canonical hash. This test relies on the fact that we run Spack's unit tests across many python versions. We can't compute for several python versions within the same test run so we precompute the hashes and check them in CI.
2022-01-12package_hash: fix handling of multimethods and add testsTodd Gamblin2-35/+261
Package hashing was not properly handling multimethods. In particular, it was removing any functions that had decorators from the output, so we'd miss things like `@run_after("install")`, etc. There were also problems with handling multiple `@when`'s in a single file, and with handling `@when` functions that *had* to be evaluated dynamically. - [x] Rework static `@when` resolution for package hash - [x] Ensure that functions with decorators are not removed from output - [x] Add tests for many different @when scenarios (multiple @when's, combining with other decorators, default/no default, etc.) Co-authored-by: Danny McClanahan <1305167+cosmicexplorer@users.noreply.github.com>
2022-01-12package_hash: rework `RemoveDirectives` and add a testTodd Gamblin3-6/+41
Previously we used `directives.__all__` to get directive names, but it wasn't quite right -- it included `DirectiveMeta`, etc. It's not wrong, but it's also not the clearest way to do this. - [x] Refactor `@directive` to track names in `directive_names` global - [x] Rename `_directive_names` to `_directive_dict_names` in `DirectiveMeta` - [x] Add a test for `RemoveDirectives` Co-authored-by: Danny McClanahan <1305167+cosmicexplorer@users.noreply.github.com>
2022-01-12package_hash: remove all unassigned strings, not just docstringsTodd Gamblin2-9/+77
Some packages use top-level unassigned strings instead of comments, either just after a docstring on in the body somewhere else. Ignore those strings becasue they have no effect on package behavior. - [x] adjust RemoveDocstrings to remove all free-standing strings. - [x] move tests for util/package_hash.py to test/util/package_hash.py Co-authored-by: Danny McClanahan <1305167+cosmicexplorer@users.noreply.github.com>
2022-01-12unparser: handle unicode string literals consistently across Python versionsTodd Gamblin1-2/+16
Python 2 and 3 represent string literals differently in the AST. Python 2 requires '\x' literals, and Python 3 source is always unicode, and allows unicode to be written directly. These also unparse differently by default. - [x] modify unparser to write both out the way `repr` would in Python 2 when `py_ver_consistent` is provided.
2022-01-12unparser: implement operator precedence algorithm for unparserTodd Gamblin7-169/+314
Backport operator precedence algorithm from here: https://github.com/python/cpython/commit/397b96f6d7a89f778ebc0591e32216a8183fe667 This eliminates unnecessary parentheses from our unparsed output and makes Spack's unparser consistent with the one in upstream Python 3.9+, with one exception. Our parser normalizes argument order when `py_ver_consistent` is set, so that star arguments in function calls come last. We have to do this because Python 2's AST doesn't have information about their actual order. If we ever support only Python 3.9 and higher, we can easily switch over to `ast.unparse`, as the unparsing is consistent except for this detail (modulo future changes to `ast.unparse`)
2022-01-12unparser: refactor delimiting with context managers in ast.unparseTodd Gamblin1-190/+177
Backport of https://github.com/python/cpython/commit/4b3b1226e86df6cd45e921c8f2ad23c3639c43b2
2022-01-12unparser: add block() context manager for indentationTodd Gamblin1-63/+63
This is a backport of a refactor from cpython 3.9
2022-01-12unparse: Make unparsing consistent for 2.7 and 3.5-3.10Todd Gamblin2-13/+71
Previously, there were differences in the unparsed code for Python 2.7 and for 3.5-3.10. This makes unparsed code the same across these Python versions by: 1. Ensuring there are no spaces between unary operators and their operands. 2. Ensuring that *args and **kwargs are always the last arguments, regardless of the python version. 3. Always unparsing print as a function. 4. Not putting an extra comma after Python 2 class definitions. Without these changes, the same source can generate different code for different Python versions, depending on subtle AST differences. One place where single source will generate an inconsistent AST is with multi-argument print statements, e.g.: ``` print("foo", "bar", "baz") ``` In Python 2, this prints a tuple; in Python 3, it is the print function with multiple arguments. Use `from __future__ import print_function` to avoid this inconsistency.
2022-01-12externals: add astunparseTodd Gamblin5-18/+1022
Add `astunparse` as `spack_astunparse`. This library unparses Python ASTs and we're adding it under our own name so that we can make modifications to it. Ultimately this will be used to make `package_hash` consistent across Python versions.
2022-01-12perl-tk: add missing dependencies (#28240)Andrew W Elble1-0/+6
2022-01-12e2fsprogs: fix non-root install (#28255)Dylan Simon1-0/+6
2022-01-12Use depends_on over load in lmod module files generated by Spack (#28352)Harmen Stoppels2-21/+4
2022-01-12poamsa: fix build errors for gcc10+ (#28262)snehring1-0/+4
2022-01-12yarn: add runtime dependency on `node-js@4.0:` (#27654)Danny McClanahan2-0/+6
2022-01-12HDF5 GPU VFD: add new package. (#28272)H. Joe Lee1-0/+35
2022-01-12ITensor: add v3.1.10 and 'shared' variant (#28370)Melven Roehrig-Zoellner1-0/+9
2022-01-12py-async-timeout: fix checksum issue (#28329)Adam J. Stewart1-3/+3
2022-01-12libtheora: disable docs by default (#28330)Nils Leif Fischer1-1/+8
2022-01-12curl: add support for external detection (#28331)Nils Leif Fischer1-0/+32
2022-01-12Remove tut since it requires deprecated Python 3.6 (#28360)Massimiliano Culpo1-1/+0
2022-01-11Packaging: Virtual package for libllvm (#27200)kwryankrattiger3-0/+26
Add an abstraction around libllvm to allow libllvm providers to be specified for all packages. This is targeting allowing mesa to build against llvm-amdgpu or intel-llvm or llvm or any other custom llvm variant that arises for specific GPU toolchains
2022-01-11memkind: add v1.12.0 (#28306)Erik Schnetter1-0/+1
2022-01-11openblas: New version 0.3.19 (#28308)Erik Schnetter1-0/+1
2022-01-11py-aiohttp: switch to PyPI tarball (#28333)Adam J. Stewart1-5/+5
2022-01-11Open3D: add missing LLVM dep (#28334)Adam J. Stewart1-0/+2
2022-01-11ffmpeg: add v4.4.1 (#28300)Erik Schnetter1-0/+1
2022-01-11hdf5: prefer stable over experimental releases (#28340)Harmen Stoppels1-2/+4
2022-01-11mbedtls: add v2.16.12, v2.28.0 and v3.1.0(#28281)Harmen Stoppels1-14/+17
2022-01-10Deprecate Python 2 installations (#28003)Adam J. Stewart109-413/+409
* Deprecate Python 2 installations * Deprecate py-python-meep * Deprecate older easybuild backend libs * Deprecate Python 3.6 * Deprecate miniconda2
2022-01-10automake: New version 1.16.5 (#28299)Erik Schnetter1-0/+1
2022-01-10gawk: New version 5.1.1 (#28301)Erik Schnetter1-0/+1
2022-01-10gdbm: New version 1.22 (#28302)Erik Schnetter1-0/+1
2022-01-10grep: New version 3.7 (#28303)Erik Schnetter1-0/+1
2022-01-10lorene: Beautify package title in documentation (#28305)Erik Schnetter1-1/+1
2022-01-10wi4mpi: New version 3.5.0 (#28313)Erik Schnetter1-0/+1
2022-01-10wget: New version 1.21.2 (#28312)Erik Schnetter1-0/+1
2022-01-10openssl: New version 1.1.1m (#28310)Erik Schnetter1-1/+3
2022-01-10stage.steal_source: preserve symlinksPeter Scheibel1-1/+1
This avoids dangling symlink errors. ignore_dangling_symlinks option would be more-targeted but is only available for Python >= 3.2 (#28318)
2022-01-10Python: set default config_vars (#28290)Adam J. Stewart2-43/+68
* Python: set default config_vars * Add missing commas * dso_suffix not present for some reason * Remove use of default_site_packages_dir * Use config_vars during bootstrapping too * Catch more errors * Fix unit tests * Catch more errors * Update docstring
2022-01-10New packages: google-crc32c and py-google-crc32c (#28293)Marcus Boden2-0/+52
2022-01-10z3: New version 4.8.14 (#28314)Erik Schnetter1-0/+1
2022-01-10hwloc: New version 2.7.0 (#28298)Erik Schnetter1-0/+1
2022-01-09New package: petaca (#28326)Peter Brady1-0/+49
* Add the petaca fortran/c package * Adopt date for version name and remove variants
2022-01-08blaspp: set BLA_VENDOR for cray (#28104)luker1-1/+7
* for Cray's libsci in blaspp, set BLA_VENDOR=all * Update package.py * Update package.py * Update package.py
2022-01-08SQLite: add new version/variant (#28204)Adam J. Stewart2-25/+27
2022-01-08openssh: New version 8.8p1 (#28325)Erik Schnetter1-0/+1