The Gradient
Definition
For a scalar-valued function of several variables,
the gradient is the vector of partial derivatives:
If \(f:\mathbb{R}^n\rightarrow\mathbb{R}\), then \(\nabla f:\mathbb{R}^n\rightarrow\mathbb{R}^n\): at every input point, the gradient produces a vector in the same input space.
Interpretation
The gradient collects the local rates of change of the function in each coordinate direction. Its key properties are:
- Direction: \(\nabla f\) points in the direction of steepest local increase.
- Magnitude: \(\|\nabla f\|\) gives the local rate of increase in that direction.
- Orthogonality: the gradient is perpendicular to level sets of \(f\).
- Zero gradient: \(\nabla f=0\) marks a critical point.
Linear Response
For a small displacement \(h\), the first-order change in the function is
This dot product combines the local rate of change in each coordinate with how far we move in that coordinate. In the Taylor expansion,
Example
For
the gradient is
The resulting vector field points radially away from the origin, which matches the fact that \(x^2+y^2\) increases fastest by moving directly away from the origin.