Since the function space $\R \to \R $ is a vector space, can we approximate a “complex” element of this set by some basis of “simpler” functions in $\R \to \R $.
Of course, there may be no set that can represent $f$. So instead we may be interested in an element $g \in \span\set{g_1, \dots , g_d}$ which approximates $f$.1
A real function approximator for a function $f: \R \to \R $ is a function $g: \R \to \R $.