\(\DeclarePairedDelimiterX{\Set}[2]{\{}{\}}{#1 \nonscript\;\delimsize\vert\nonscript\; #2}\) \( \DeclarePairedDelimiter{\set}{\{}{\}}\) \( \DeclarePairedDelimiter{\parens}{\left(}{\right)}\) \(\DeclarePairedDelimiterX{\innerproduct}[1]{\langle}{\rangle}{#1}\) \(\newcommand{\ip}[1]{\innerproduct{#1}}\) \(\newcommand{\bmat}[1]{\left[\hspace{2.0pt}\begin{matrix}#1\end{matrix}\hspace{2.0pt}\right]}\) \(\newcommand{\barray}[1]{\left[\hspace{2.0pt}\begin{matrix}#1\end{matrix}\hspace{2.0pt}\right]}\) \(\newcommand{\mat}[1]{\begin{matrix}#1\end{matrix}}\) \(\newcommand{\pmat}[1]{\begin{pmatrix}#1\end{pmatrix}}\) \(\newcommand{\mathword}[1]{\mathop{\textup{#1}}}\)
Needs:
Real Differentiable Functions
Multivariate Functions
Needed by:
Maximum Likelihood Normals
Smooth Multivariate Functions
Links:
Sheet PDF
Graph PDF

Partial Derivatives

Why

We want to talk about how a function of multiple real-valued arguments changes with respect to changes in its arguments.1

Definition

Let $f: \R ^d \to \R $ For $i = 1,\dots ,d$, the $i$th partial derivative of $f$ is the function $g_i: \R ^d \to \R $ defined by

\[ g_i(x) = \lim_{h \to 0} \frac{f(x + he_i) - f(x)}{h} \]

for each $x \in \R ^d$.

Gradient

The gradient of a multivariate function is the vector-valued function whose $i$th component is the the partial derivative of the function with respect to its $i$th argument.

Notation

Let $f: \R ^n \to \R $. The gradient of $f$ is frequently denoted $\nabla f$. It is understood that $(\nabla f) \in \R ^d \to \R ^d$. An alternative notation is to use that similar for single derivatives and to denote the gradient (sometimes called derivative) of $f$ by $f'$ (assuming it exists). It is important to here note that although when $g: \R \to \R $, $g' \in (\R \to \R )$, (and so is another function from and to reals) when $f: \R ^d \to \R $, $f' \in \R ^d \to \R ^d$, and so is a vector-valued (not a real-valued) function.

There is (unfortunately) much notation for the individual partial derivatives; most of which we shall not (fortunately) have occasion to use in these sheets. One popular usage is the use of the $\partial $ symbol, read aloud as “partial.” For example, if $f: \R ^2 \to \R $ is a function of two arguments, each being referred to as $x$ and $y$, then $\partial _x f$ denotes the partial derivative of $f$ with respect to $x$ and $\partial _y f$ denotes the partial derivative of $f$ with respect to $y$. It is understood that $(\partial _x f) \in \R ^d \to \R $. and likewise for $\partial _y f$. Another popular usage is $\partial f/\partial x$ for $\partial _x f$ and $\partial f/\partial y$ for $\partial _y f$. We will almost exclusively prefer the gradient notation.


  1. Future editions will modify this sheet. ↩︎
Copyright © 2023 The Bourbaki Authors — All rights reserved — Version 13a6779cc About Show the old page view