summaryrefslogtreecommitdiff
path: root/.github
diff options
context:
space:
mode:
authorScott Wittenburg <scott.wittenburg@kitware.com>2021-02-16 18:21:18 -0700
committerGitHub <noreply@github.com>2021-02-16 18:21:18 -0700
commit5b0507cc6536f8b243d398f4e1b78b5eee298753 (patch)
treefe27c0916bf3117ef64c4a0453742599a8666d5d /.github
parent1fe51ffe18f6207c2565db3a921d797d18e17bfd (diff)
downloadspack-5b0507cc6536f8b243d398f4e1b78b5eee298753.tar.gz
spack-5b0507cc6536f8b243d398f4e1b78b5eee298753.tar.bz2
spack-5b0507cc6536f8b243d398f4e1b78b5eee298753.tar.xz
spack-5b0507cc6536f8b243d398f4e1b78b5eee298753.zip
Pipelines: Temporary buildcache storage (#21474)
Before this change, in pipeline environments where runners do not have access to persistent shared file-system storage, the only way to pass buildcaches to dependents in later stages was by using the "enable-artifacts-buildcache" flag in the gitlab-ci section of the spack.yaml. This change supports a second mechanism, named "temporary-storage-url-prefix", which can be provided instead of the "enable-artifacts-buildcache" feature, but the two cannot be used at the same time. If this prefix is provided (only "file://" and "s3://" urls are supported), the gitlab "CI_PIPELINE_ID" will be appended to it to create a url for a mirror where pipeline jobs will write buildcache entries for use by jobs in subsequent stages. If this prefix is provided, a cleanup job will be generated to run after all the rebuild jobs have finished that will delete the contents of the temporary mirror. To support this behavior a new mirror sub-command has been added: "spack mirror destroy" which can take either a mirror name or url. This change also fixes a bug in generation of "needs" list for each job. Each jobs "needs" list is supposed to only contain direct dependencies for scheduling purposes, unless "enable-artifacts-buildcache" is specified. Only in that case are the needs lists supposed to contain all transitive dependencies. This changes fixes a bug that caused the needs lists to always contain all transitive dependencies, regardless of whether or not "enable-artifacts-buildcache" was specified.
Diffstat (limited to '.github')
0 files changed, 0 insertions, 0 deletions