Function basis

A particular form of the solution () arises from assuming the existence of a basis function set $\{\psi_k(x)\},\;k \in K$, such that the function f (x) can be represented by a linear combination of the basis functions in the set, as follows:  

$$f (x) = \sum_{k \in K} c_k \psi_k (x)\;.$$ (33)

We can find the linear coefficients c_k by multiplying both sides of equation () by one of the basis functions (e.g. $\psi_j (x)$). Inverting the equality  

$$\left( \psi_j (x), f (x)\right) = \sum_{k \in K} c_k \Psi_{jk}\;,$$ (34)

where the parentheses denote the dot product, and  

$$\Psi_{jk} = \left( \psi_j (x), \psi_k (x)\right) \;,$$ (35)

leads to the following explicit expression for the coefficients c_k:  

$$c_k = \sum_{j \in K} \Psi^{-1}_{kj} \left( \psi_j (x), f (x)\right) \;.$$ (36)

Here $\Psi^{-1}_{kj}$ refers to the kj component of the matrix, which is the inverse of $\Psi$. The matrix $\Psi$ is invertible as long as the basis set of functions is linearly independent. In the special case of an orthonormal basis, $\Psi$ reduces to the identity matrix:  

$$\Psi_{jk} = \Psi^{-1}_{kj} = \delta_{jk}\;.$$ (37)

Equation () is a least-squares estimate of the coefficients c_k: one can alternatively derive it by minimizing the least-squares norm of the difference between f(x) and the linear decomposition (). For a given set of basis functions, equation () approximates the function f(x) in formula () in the least-squares sense.