Skip to content

Commit 8d7d8b8

Browse files
authored
basics: update for Spack 1.0 and other minor improvements (#469)
This reverts commit 5384049.
1 parent 1def1ac commit 8d7d8b8

2 files changed

Lines changed: 55 additions & 30 deletions

File tree

outputs/basics.sh

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,8 @@ example basics/list-py "spack list 'py-*'"
2828
# spack install
2929
example basics/gmake "spack install gmake"
3030

31+
example basics/compiler-list "spack compilers"
32+
3133
example basics/mirror "spack mirror add tutorial /mirror"
3234
example basics/mirror "spack buildcache keys --install --trust"
3335

@@ -57,7 +59,7 @@ example basics/hdf5-spec "spack spec hdf5"
5759
example basics/hdf5 "spack install hdf5"
5860
example basics/hdf5-no-mpi "spack install hdf5~mpi"
5961

60-
example basics/hdf5-hl-mpi "spack install hdf5+hl+mpi ^mpich"
62+
example basics/hdf5-hl-mpi "spack install hdf5+hl+mpi %c,cxx=gcc ^mpich"
6163

6264
example basics/find-ldf-2 "spack find -ldf"
6365

@@ -96,8 +98,8 @@ example basics/compilers "spack compilers"
9698

9799
example basics/install-gcc-12.1.0 "spack install gcc@12"
98100

99-
example basics/find-p-gcc "spack find -p gcc"
101+
example basics/compilers-2 "spack compilers"
100102

101-
example basics/compiler-add-location 'spack compiler add "$(spack location -i gcc@12)"'
103+
example basics/spec-zziplib "spack spec zziplib"
102104

103-
example basics/compiler-remove 'spack compiler remove gcc@12'
105+
example basics/compiler-uninstall 'spack uninstall gcc@12'

tutorial_basics.rst

Lines changed: 49 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -72,16 +72,24 @@ Let's go ahead and install ``gmake``,
7272
.. literalinclude:: outputs/basics/gmake.out
7373
:language: console
7474

75-
We see Spack installed ``gmake``, ``gcc-runtime``, and ``glibc``.
75+
You will see Spack installed ``gmake``, ``gcc``, ``gcc-runtime``, and ``glibc``.
7676
The ``glibc`` and ``gcc-runtime`` packages are automatically tracked by Spack to manage consistency requirements among compiler runtimes.
77-
They do not represent separate software builds from source, but are records of the system's compiler runtime components Spack used for the install.
78-
For the rest of this section, we'll ignore these components and focus on the packages explicitly installed.
77+
These do not represent separate software builds from source, but are records of the compiler runtime components Spack used for the install.
78+
For the rest of this section, we'll ignore these components and focus on the packages explicitly installed and their listed dependencies.
79+
80+
The ``gcc`` package was found on the system and Spack used it because ``gmake`` requires a compiler to build from source.
81+
Compilers are handled somewhat specially in Spack; Spack searches the ``PATH`` environment variable for compilers automatically.
82+
We can run ``spack compiler list`` or simply ``spack compilers`` to show all the compilers Spack found.
83+
84+
.. literalinclude:: outputs/basics/compiler-list.out
85+
:language: console
86+
87+
All compilers that Spack found will be configured as external packages -- we'll talk more about externals in the "Spack Concepts" slides and in :ref:`Configuration Tutorial <configs-tutorial>` later on.
7988

8089
Spack can install software either from source or from a binary cache.
8190
Packages in the binary cache are signed with GPG for security.
82-
For this tutorial, we've prepared a binary cache so we don't have to wait for slow compilation from source.
83-
84-
To enable installation from the binary cache, we'll need to configure Spack with the location of the cache and trust the GPG key that the cache was signed with.
91+
For this tutorial we have prepared a binary cache so we don't have to wait for slow compilation from source.
92+
To enable installation from the binary cache, we'll need to configure Spack with the location of the cache and trust the GPG key that the binaries were signed with.
8593

8694
.. literalinclude:: outputs/basics/mirror.out
8795
:language: console
@@ -92,7 +100,7 @@ By default, this will install the binary cached version if it exists and fall ba
92100
Now that we understand how Spack handles installations, let's explore how we can customize what gets installed.
93101
Spack's "spec" syntax is the interface by which we can request specific configurations of a package.
94102
The ``%`` sigil is used to specify direct dependencies like a package's compiler.
95-
For example, we can install zlib (a commonly used compression library), but instead of building it with the GCC compiler as we did for gmake previously, we'll install it with ``%clang`` to build it on top of the clang compiler.
103+
For example, we can install zlib (a commonly used compression library), but instead of building it with the GCC compiler as we did for gmake previously, we'll install it with ``%clang`` to build it with the clang compiler.
96104

97105
.. literalinclude:: outputs/basics/zlib-clang.out
98106
:language: console
@@ -107,11 +115,13 @@ Let's check what versions of zlib-ng are available, and then we'll install a dif
107115
.. literalinclude:: outputs/basics/versions-zlib.out
108116
:language: console
109117

110-
The ``@`` sigil is used to specify versions, both of packages and of compilers.
118+
The ``@`` sigil is used to specify versions.
111119

112120
.. literalinclude:: outputs/basics/zlib-2.0.7.out
113121
:language: console
114122

123+
The spec syntax is recursive -- any syntax we can specify for the "root" package (``zlib-ng``) we can also use for a dependency.
124+
115125
.. literalinclude:: outputs/basics/zlib-gcc-10.out
116126
:language: console
117127

@@ -134,7 +144,7 @@ Additionally, if we include the ``-f`` flag, Spack will show any non-empty compi
134144
.. literalinclude:: outputs/basics/find-lf.out
135145
:language: console
136146

137-
Spack generates a unique hash for each spec we define.
147+
Spack generates a unique hash for each spec.
138148
This hash reflects the complete provenance of the package, so any change to the spec—such as compiler version, build options, or dependencies—will result in a different hash.
139149
Spack uses these hashes both to compare specs and to create unique installation directories for every possible configuration.
140150

@@ -145,7 +155,9 @@ This approach helps us avoid unnecessary rebuilds of common dependencies, which
145155
.. literalinclude:: outputs/basics/tcl.out
146156
:language: console
147157

148-
When we need to specify dependencies explicitly, we use the ``^`` sigil in the spec syntax. The syntax is recursive, meaning that anything we can specify for the top-level package can also be specified for a dependency using ``^``. This allows us to precisely control the configuration of both packages and their dependencies.
158+
Sometimes it is simpler to specify dependencies without caring whether they are direct or transitive dependencies.
159+
To do that, use the ``^`` sigil.
160+
Note that a dependency specified by ``^`` is always applied to the root package, whereas a direct dependency specified by ``%`` is applied to either the root or any intervening dependency specified by ``^``.
149161

150162
.. literalinclude:: outputs/basics/tcl-zlib-clang.out
151163
:language: console
@@ -207,9 +219,25 @@ Spack also supports versioning of virtual dependencies.
207219
A package can depend on the MPI interface at version 3 (e.g., ``hdf5 ^mpi@3``), and provider packages specify what version of the interface *they* provide.
208220
The partial spec ``^mpi@3`` can be satisfied by any of several MPI implementation packages that provide MPI version 3.
209221

222+
We've actually already been using virtual packages when we changed compilers earlier.
223+
Compilers are providers for virtual packages like ``c``, ``cxx``, and ``fortran``.
224+
Because these are often provided by the same package but we might want to use C and C++ from one compiler and Fortran from another, we need a syntax to specify which virtual a package provides.
225+
We call this "virtual assignment", and can be specified by ``%virtual=provider`` or ``^virtual=provider``.
226+
227+
We will now install HDF5 with MPI support provided by MPICH, ensuring that the C and C++ components of HDF5 are compiled with ``gcc``.
228+
We could use the same syntax for ``^mpi=mpich``, but there's no need because the only way for ``hdf5`` to depend on ``mpich`` is to provide ``mpi``.
229+
This is also why we didn't care to specify which virtuals ``gcc`` and ``clang`` provided earlier when building simpler packages.
230+
210231
.. literalinclude:: outputs/basics/hdf5-hl-mpi.out
211232
:language: console
212233

234+
.. note::
235+
236+
It is frequently sufficient to specify ``%gcc`` even for packages
237+
that use multiple languages, because Spack prefers to minimize the
238+
number of packages needed for a build. Later on we will discuss
239+
more complex compiler requests, and how and when they are useful.
240+
213241
We'll do a quick check in on what we have installed so far.
214242

215243
.. literalinclude:: outputs/basics/find-ldf-2.out
@@ -222,7 +250,7 @@ Now let's look at an even more complicated package.
222250
:language: console
223251

224252
Now we're starting to see the power of Spack.
225-
Trilinos in its default configuration has 23 direct dependencies, many of which have dependencies of their own.
253+
Depending on the spec, Trilinos can have over 30 direct dependencies, many of which have dependencies of their own.
226254
Installing more complex packages can take days or weeks even for an experienced user.
227255
Although we've done a binary installation for the tutorial, a source installation of Trilinos using Spack takes about 3 hours (depending on the system), but only 20 seconds of programmer time.
228256

@@ -331,33 +359,28 @@ The ``spack compilers`` command is an alias for ``spack compiler list``.
331359
.. literalinclude:: outputs/basics/compilers.out
332360
:language: console
333361

334-
The compilers are maintained in a YAML file (``compilers.yaml``).
335-
Later in the tutorial, you will learn how to configure compilers by hand for special cases.
336-
Spack also has tools to add compilers, and compilers built with Spack can be added to the configuration.
362+
These compilers are maintained in a YAML file.
363+
Later in the tutorial we will discuss how to configure external compilers by hand for special cases.
364+
Spack can also use compilers built by Spack to compile later packages.
337365

338366
.. literalinclude:: outputs/basics/install-gcc-12.1.0.out
339367
:language: console
340368

341-
.. literalinclude:: outputs/basics/find-p-gcc.out
369+
.. literalinclude:: outputs/basics/compilers-2.out
342370
:language: console
343371

344-
We can add GCC to Spack as an available compiler using the ``spack compiler add`` command.
345-
This will allow future packages to build with ``gcc@12.3.0``.
346-
To avoid having to copy and paste GCC's path, we can use ``spack location -i`` to get the installation prefix.
372+
Because this compiler is a newer version than the external compilers Spack knows about, it will be the new default compiler.
373+
We will discuss changing these defaults in a later section.
374+
We can check that this compiler is preferred by looking at the install plan for a package that isn't being reused from binary.
347375

348-
.. literalinclude:: outputs/basics/compiler-add-location.out
376+
.. literalinclude:: outputs/basics/spec-zziplib
349377
:language: console
350378

351-
We can also remove compilers from our configuration using ``spack compiler remove <compiler_spec>``
379+
For the test of the tutorial we will sometimes use this new compiler, and sometimes we want to demonstrate things without it. For now, we will uninstall it to avoid using it in the next section.
352380

353-
.. literalinclude:: outputs/basics/compiler-remove.out
381+
.. literalinclude:: outputs/basics/compiler-uninstall.out
354382
:language: console
355383

356-
.. tip::
357-
358-
Starting from Spack v1.0 it will be no longer necessary to add a Spack installed
359-
compilers to configuration, in order to use them.
360-
361384
.. note::
362385

363386
The spec syntax may be confusing for new users.

0 commit comments

Comments
 (0)