Since I have already studied the basics of the necessary mathematical tools, for now I want to prioritize physical understanding. Thus, I will deepen my understanding of the mathematics to the level necessary to understand, apply, and critically question the physical framework under study. Purely mathematical proofs and developments can be left for when they become necessary or when I decide to delve deeper into the foundations.
For example, it is not necessary, at this point, to delve deeper into the proof of the spectral theorem for Hermitian matrices, since its proof is predominantly mathematical and does not, by itself, add a new physical interpretation to the problem. On the other hand, it is worth deepening mathematical results that establish relationships directly relevant to the physical theory, such as proving that two operators that have the same complete basis of eigenvectors commute, since this relationship allows us to understand mathematically the compatibility between observables.
However, I will be sharing here a purely mathematical review, an almost verbatim reproduction of this material (Delft University of Technology (2026)). A more complete review can be found aqui.
Basic Matrix Arithmetic¶
An -matrix is an array of rows and columns containing (usually real or complex) numbers called the entries (or coefficients) of the matrix. The entries of a matrix are denoted by , or similar, where the first index refers to the row and the second to the column. That is, the entries are laid out like
You will often see notation like or to indicate how the entries are denoted and/or how many rows and columns the matrix has.
In this section we focus on the basic operations that can be performed with matrices.
Addition and scalar multiplication
Like vectors, matrices can be added or subtracted entrywise. They can also be multiplied entrywise by a given scalar. For example,
Special matrices
A few (types of) matrices occur very often and have their own names:
- the zero matrix
- the identity matrix
- diagonal matrices
- upper triangular matrices
- lower triangular matrices
Inner product of vectors
Definition Given two vectors and , the inner product of and is the scalar
Properties of the inner product: For vectors , , (all of the same length) and scalars the following hold:
Matrix-vector multiplication
Matrices can be multiplied by vectors.
Definition: Given a matrix as in 1 and a vector
the (matrix-vector) product of and is the vector
Equivalently, we can write
Properties of matrix-vector multiplication: For matrices and , vectors and and scalars the following hold whenever the expressions are defined:
:::
Note: Here are two other useful ways to think about matrix-vector products. First, in terms of inner products: the vector consists of the inner products of each of the rows of with the vector . Namely, if
then
Second, in terms of linear combinations: the vector is a linear combination of the columns of where the coefficients are the entries of . Namely, if
then
Matrix multiplication
Two matrices and can be multiplied if the number of columns of equals the number of rows of .
Definition: If is an -matrix and is an -matrix, then the (matrix) product of and is the -matrix defined as follows:
The product can be viewed as matrix-vector multiplications: if , then
Properties of matrix multiplication: For matrices , and and scalars the following hold whenever the expressions are defined:
:::
Warning: Matrix multiplication is not commutative! That is, in general we have
Matrix Operations¶
Very often, an -matrix with real entries represents a linear map from the space of vectors of length to the space of vectors of length . Similarly, a matrix with complex entries represents a linear map from to . This map is defined by the matrix-vector product.
Definition: Given a real (resp. complex) -matrix , the linear map associated with is the map that sends each vector to the vector (resp. each vector to the vector ). :::
Matrix multiplication is defined so that the product represents the linear map gotten by first applying and then . In other words, we have
Note that on the left we have one matrix multiplication and one matrix-vector multiplication, while on the right we just have two matrix-vector multiplications. Commutators play an extremely important role in quantum physics.
Definition: Given two -matrices and , the commutator of and is the -matrix
Definition: The transpose of an -matrix is the -matrix defined by
Definition: The adjoint (conjugate transpose or Hermitian transpose) of an -matrix is the -matrix obtained by applying the complex conjugate and the transpose operation: The adjoint of is also known as the ** or ** of .
Definition: The trace of an -matrix is the sum of the diagonal entries of :
The determinant of an -matrix can be defined in various ways. We will make use of permutations. Using the Einstein summation convention[1] and the Levi-Civita symbol[2] commonly used in physics, we can also write this as
Properties of the determinant :
A square matrix is invertible if and only if is non-zero.
Given two -matrices and , we have
The determinant of a diagonal matrix (and more generally of an upper or lower triangular matrix) is the product of the diagonal entries.
4. If is obtained from by scaling a row by a scalar , then .
5. If is obtained from by swapping two rows, then .
6. If is obtained from by adding a multiple of a row to another row, then .
Properties 4-6 also hold for columns instead of rows.
Finally, we define the characteristic polynomial of a square matrix; this will be used in diagonalisation.
Definition: The characteristic polynomial of an -matrix is the polynomial of degree in a variable defined by [3]
Properties that are typically demonstrated in exercises:
If is an matrix and an matrix, then
If is an matrix and a scalar, then and
Basis transformations¶
Until now, we have been working with one specific coordinate system in which vectors are identified with their coordinate vectors with respect to the standard basis vectors:
In other words, a vector means the same as the corresponding linear combination of the standard basis vectors:
In many situations, it is useful to express vectors in a different coordinate system. For this we need the general concept of a basis.
Definition: A basis of consists of vectors (or ) such that every vector can be written in exactly one way as a linear combination:, with scalars . These scalars are called the coordinates of relative to . The vector is called the coordinate vector of relative to .
Alternatively, a basis consists of vectors with the following two properties:
they span the space , i.e. every vector is a linear combination of ;
they are linearly independent, i.e. the only way to write the zero vector as a linear combination of is as .
A priori, we could have defined a basis as a collection of some number (say ) of vectors that span the space and are linearly independent. However, it can be shown that in fact any two bases contain the same number of vectors. Since the standard basis of consists of vectors, the same therefore holds for any basis.
Suppose we have two bases of , say
Definition: The basis transformation matrix (or change-of-basis matrix) from to is the matrix such that the -th column of contains the coordinates of relative to the basis .
The definition of means:
Given a vector , we write for the coordinate vector of with respect to the basis , and we define similarly. Then we calculate
which shows that
Similarly, given a linear map , we write for the matrix of with respect to the basis , and likewise for . Then and are related by
Namely, consider what happens when we multiply this matrix to a coordinate vector of the form . First, applying [4] to gives . Next, applying gives . Finally, applying gives , which is what we wanted to show.
The trace and the determinant are invariant under basis transformation: if and are square matrices of the same size with invertible, then we have
Because the characteristic polynomial is also defined as a determinant, it too is invariant under basis transformation.
Properties that are typically demonstrated in exercises:
Suppose that and are two matrices and is an invertible matrix such that , then and , in addition, and share the same characteristic polynomial.
Diagonalisation¶
A very common example of a basis transformation is diagonalisation of a matrix. For this we first introduce the concept of eigenvalues and eigenvectors. Consider an -matrix with complex entries. We view as a linear map on .
Definition: An eigenvector for is a non-zero vector such that for some scalar . This is called the eigenvalue of acting on .
Writing for the identity matrix, we see that if is an eigenvector with eigenvalue , then
This means that is not invertible[5]; equivalently, its determinant vanishes. Thus, if is an eigenvalue of , we have
This implies that the eigenvalues of are roots of the characteristic polynomial . We can factor the characteristic polynomial as
where are the distinct roots of and each is an integer called the multiplicity of as a root of .
The idea of diagonalisation is that it is often easiest to understand a linear map if we can find a basis of our space consisting of vectors on which acts as multiplication by some scalar.
Definition: An -matrix is diagonalisable if there exist a diagonal[6] matrix and an invertible -matrix such that
We can rewrite the above equation as . Let us write for the columns of and for the diagonal entries of . Then we compute
and
We therefore see that the equation comes down to the equations . In other words, each is an eigenvector of and is the corresponding eigenvalue.
The fact that is invertible means that the eigenvectors form a basis of . We obtain the following conclusion.
Theorem: An -matrix is diagonalisable precisely when there exists a basis of consisting of eigenvectors for .
This also gives us a way to tell whether is diagonalisable, and if so to determine matrices and as above:
1. Determine the eigenvalues of by finding the roots of the characteristic polynomial .
2. For each eigenvalue , say with multiplicity , determine if there exist linearly independent eigenvectors with eigenvalue .
3. The matrix is diagonalisable if and only if there exist linearly independent eigenvectors with eigenvalue for all . In this case, the matrices
and
give a diagonalisation of .
Properties that are typically demonstrated in exercises:
Assuming with invertible and a scalar matrix[7], then .
Hilbert Spaces¶
So far, we have been considering vectors in an -dimensional real or complex space. In quantum mechanics, one encounters infinite-dimensional vector spaces as well. In particular, the state of a quantum system is represented mathematically by a (unit) vector in a Hilbert space.
Vector spaces¶
As is customary in quantum physics and quantum algorithms, we use bra-ket notation for vectors in Hilbert spaces.
Definition: A (real or complex) *vector space* consists of
- a set of vectors, denoted by symbols like
- a distinguished vector called the zero vector
- a way of adding vectors, i.e. given two vectors and we can obtain a third vector
- a way of multiplying a vector by a scalar: given a scalar (a real or complex number, depending on whether we consider a real or complex vector space) and a vector we can obtain a vector
Such that a number of properties hold:
-
-
-
-
-
-
-
-
Definition: A basis for a vector space is a collection of vectors such that every vector can be written in exactly one way as a linear combination of the . The number of vectors in a basis is called the dimension of the space.
As in basis-transformations, any two bases contain the same number of vectors, so the dimension does not depend on the choice of basis.
Exemplo: The simplest examples are the -dimensional vector spaces and with coordinatewise addition and scalar multiplication. An important special case is the two-dimensional space . In bra-ket notation, various symbols are used for the standard basis vectors and in this space, such as:
and ;
and (in the context of quantum computing);
and (in the context of spins).
Hermitian inner products and Hilbert spaces¶
Definition: A Hermitian inner product assigns to vectors and a complex number such that the following properties hold:
- ;
- , and holds precisely when (note that is a real number because of the first property);
- ;
- ;
Definition: The norm or length of a vector in a Hilbert space is defined as the real number .
The properties above imply that for any scalar , the inner product of with equals . In other words, while the inner product is (complex) linear in its second argument, it is only conjugate linear in its first argument. This is the usual convention in physics. It differs from the convention in mathematics, where inner products are usually linear in the first argument and conjugate linear in the second argument.
Definition: A Hilbert space is a complex vector space equipped with a Hermitian inner product and satisfying a condition called completeness.
We will not make the notion of completeness precise in these notes. Roughly speaking, it means that we do not have to worry too much about convergence of sequences or series in our Hilbert space, and there is a notion of infinite linear combinations[8].
Example: We take and define an inner product by This satisfies all the properties of a Hermitian inner product.
The dual Hilbert space¶
With any Hilbert space , we can associate a dual Hilbert space . In the bra-ket formalism used in quantum mechanics, for every “ket vector” in we have a dual “bra vector” in . This correspondence has the following properties:
In mathematical language, is the space of continuous linear maps . The bra vector then represents the linear map that sends to .
Example:In the case we can identify with as well; for a vector in , the dual vector can then be naturally identified with the corresponding vector in . It can also be convenient to distinguish from by denoting a ket vector as a column vector and the corresponding bra vector by the conjugate transpose of , so is the row vector whose entries are the complex conjugates of those of .
In , for example, we have
This allows us to view as a linear map sending to the scalar obtained by multiplying the row vector by the column vector . If you know about continuous linear maps of Hilbert spaces, here is a useful connection between the mathematical definition of and the bra-ket formalism: the Riesz representation theorem states that every continuous linear map is of the form for some in . Ou seja, todo mapa linear contínuo tem a forma onde tem um único vetor correspondente .
Orthonormal bases¶
When working with vector spaces, it is frequently useful to make a choice of basis adapted to the problem at hand. In the context of a Hilbert space, it turns out that a “good” basis is often one that satisfies the following property with respect to the inner product.
Definition: An orthonormal system of vectors in a Hilbert space is a collection of vectors , where is some index set, satisfying
Definition: An orthonormal basis of a Hilbert space is an orthonormal system in that spans , i.e. every vector in can be written as a (possibly infinite) linear combination of the .
Example: In the Hilbert space with the standard inner product, the standard basis is an orthonormal basis.
Linear subspaces¶
Definition: A linear subspace of a vector space is a set of vectors contained in such that the following properties hold:
- The zero vector of lies in .
- For all vectors and in , the sum is also in .
- For every vector in and every scalar , the scalar multiple is also in .
In quantum physics, linear subspaces are important because they encode quantum states that a physical state can collapse to when a measurement is performed. To make this more precise, we need the notions of orthogonal complement of a subspace and of orthogonal projection onto a subspace.
Definition: Orthogonal complement Consider a Hilbert space and a linear subspace of . The orthogonal complement of in , denoted by , is the set of all vectors in that are orthogonal to all of , i.e.
It is not hard to verify that the orthogonal complement of a linear subspace of is again a linear subspace.
Properties that are typically demonstrated in exercises:
The Cauchy-Schwarz inequality states that for the vectors and , in a Hilbert space, we have
The triangle inequality states that for the vectors and , in a Hilbert space, we have
If we consider a linear subspace of the Hilbert space then the orthogonal complement[9] is also a linear space.
Operators on Hilbert spaces¶
An operator or linear map on a Hilbert space is a map
such that
It is also possible to define linear maps between different Hilbert spaces, but we will not go into this.
In physics, operators are often denoted with a hat, so what we call would be written as . One reason for this is to distinguish a physical quantity (like momentum or energy) from the corresponding mathematical operator. Since we do not consider physical quantities in this module, we do not use the hat notation.
Operators form a vector space: the sum of two operators and is defined by the formula
and multiplication of an operator by a scalar is defined by the formula
Like matrices (but unlike vectors), operators can be composed: if and are two operators, then is the operator defined by
Matrix entries¶
In physics, quantities of the form
are often of special interest. These are called matrix entries of , especially if and are basis vectors in some fixed orthonormal basis of .
A remark on notation: you will often see notation like . This is literally meaningless: the operator can be applied to vectors, which we denote by , while the symbol is just a label. However, in practice it is very convenient and completely unambiguous to write instead of the strictly speaking more correct .
Similarly, we will write to mean the inner product of with . Extending this notation to scalars , we can also write
The adjoint of an operator¶
Given an operator on a Hilbert space , there exists an operator with the property
The operator is called the *adjoint* of .
Properties of the adjoint: For all operators , and scalars , we have
1.
2.
3.
Hermitian operators¶
Definition: An operator on a Hilbert space is called Hermitian if it is equal to its own adjoint, i.e.
It is clear from the definition that all real symmetric matrices are Hermitian. The following two results are of fundamental importance in quantum mechanics. Together, they explain why in the mathematical formalism of quantum mechanics, Hermitian operators correspond to physical observables.
Theorem: The eigenvalues of a Hermitian operator are real.
Proof: Suppose is an eigenvalue of and is a corresponding eigenvector. Then we have:
Since is non-zero, we can divide by it and obtain .
Theorem: If is a Hermitian operator on a Hilbert space , then there exists an orthonormal basis of that consists of eigenvectors for .
Unitary operators¶
Definition: An operator on a Hilbert space is called unitary if the adjoint is a two-sided inverse of , i.e.
It follows immediately from the definition that the identity operator on a Hilbert space (sending every vector to itself) is unitary, and if is a unitary operator, then its inverse (which equals ) is also unitary. Similarly, if and are unitary operators, then so is the product . This means that the collection of all unitary operators on a Hilbert space has the mathematical structure of a group.
Orthogonal projection¶
Consider a Hilbert space and a linear subspace. One can show that every vector can be decomposed uniquely as
Definition: Orthogonal projection Given a Hilbert space and a linear subspace of , the orthogonal projection of onto is the map that sends every vector to .
Orthogonal projections onto linear subspaces turn out to be important examples of linear maps.
Example: Let be a one-dimensional linear subspace of a Hilbert space . Then for any unit vector in , the operator sending every vector to is the orthogonal projection onto .
Density operators¶
The topic of this section is usually not treated in BSc-level mathematics courses. We include it because density matrices are a fundamental mathematical concept in quantum physics and are important examples of Hermitian operators. :::
Density operators on Hilbert spaces, or density matrices, play a central role in situations where quantum states are combined with classical uncertainty. They describe mixed states (ensembles of quantum systems) rather than individual (“pure”) quantum states. Density operators are intensively used in the theory of entanglement and in quantum information theory, for example.
Definition: A density operator on a Hilbert space is an operator with the following properties:
1. is Hermitian;
2. is positive semi-definite, i.e. for all we have ;
3. has trace 1.
A density matrix is the matrix of a density operator relative to some choice of basis of .
When is finite-dimensional, the trace of is simply the trace of the matrix of with respect to any choice of basis for . When is infinite-dimensional, the definition is somewhat more complicated.
Example: Let be a unit vector in . The operator sending every vector to is a density operator. :::
Definition: A density operator is pure when is the orthogonal projection onto a 1-dimensional linear subspace of , and mixed otherwise.
On a finite-dimensional Hilbert space, an operator is a density operator precisely when there exist unit vectors and real numbers with such that can be expressed as the convex combination:
of the pure density operators . Given a density operator , there are in general multiple ways of expressing as such a convex combination. By definition, is pure precisely when it admits a decomposition as above with . Furthermore, it can be shown that is pure precisely when it satisfies the identity .
Exponential of an operator¶
The exponential function can be characterised by the Taylor series
In quantum physics, it is frequently useful to apply this formula not just to (real or complex) numbers, but to operators as well. One reason is that there is an important application to differential equations.
Definition: If is an operator on a Hilbert space , then the exponential of is the operator
In the case where , an operator corresponds to an matrix . The same formula as above then defines the matrix exponential of .
Warning: Since operators do not commute in general, the exponential does not have the property as one might expect from the case of ordinary exponentials.
Properties that are typically demonstrated in exercises:
An operator is unitary precisely when it satisfies for all vectors .
Consider a square matrix and an invertible matrix . So the matrix exponential of satisfies: .
Tensor products¶
In the mathematical formalism of quantum mechanics, the state of a system is a (unit) vector in a Hilbert space. Likewise, a composite of two quantum systems can be described by the tensor product of the corresponding Hilbert spaces.
In this section, and are two Hilbert spaces.
Definition: The tensor product of and is a Hilbert space . This space contains vectors of the form , where is in and is in . These vectors are called pure tensors. Importantly, also contains linear combinations of such pure tensors (possibly with infinitely many terms); these are called (non-pure) tensors.
The inner product between two pure tensors and is by definition . (Note that the first inner product is taken in and the second in !)
Note: In quantum mechanics, a non-pure tensor in represents an entangled state of a composite quantum system.
We can easily write down a basis for a tensor product using bases of and . It turns out that the “obvious” definition works well with inner products.
Property: If is an orthonormal basis of and is an orthonormal basis of , then is an orthonormal basis of .
If is an operator (i.e. a linear map) on and is a linear map on , then there is a linear map on . This is defined on pure tensors by
However, just like not every tensor is a pure tensor, there are many operators on that cannot be written in the form (where and are operators on and , respectively).
Einstein notation is a notational convention that implies summation over a set of indexed terms in a formula, thus achieving brevity. There are essentially three rules of Einstein summation notation, namely: 1) Repeated indices are implicitly summed over. 2) Each index can appear at most twice in any term. 3) Each term must contain identical non-repeated indices (Wolfram MathWorld).
More generally, in dimensions, the Levi-Civita symbol is defined by: +1 if is an even permutation from , -1 if is an odd permutation and 0 otherwhise.
An alternative definition of the characteristic polynomial, which agrees with the one above up to a factor , is
Note that if and given that , then , that is, .
If is invertible, it means that ,so This is contradictory, since by definition is nonzero. If it is not invertible, then .
A diagonal matrix is one that has elements only on the main diagonal , for any , we have .
A matrix is scalar when it is a multiple of the identity matrix , that is, .
In short, we can think of a complete space as one in which a sequence of vectors cannot converge to a vector outside the space.
The orthogonal complement of is the set of vectors that are orthogonal to every vector in . For example, if has as its basis the vectors and , then is the subspace corresponding to the -axis.
- Delft University of Technology. (n.d.). Mathematics for Quantum Physics. Retrieved August 31, 2026, from https://interactivetextbooks.tudelft.nl/mqp-v2/