Part 4: The Theory of Differentiation

Understanding Differentiation: From Intuition to Rigor

The concept of differentiation emerges naturally from our desire to understand how quantities change. When we observe any physical system - whether it’s a planet’s orbit, a quantum particle’s motion, or the curvature of spacetime - we’re fundamentally interested in rates of change. To help internalize the key concepts of differentiation, we’ll use the mnemonic “DERIVATIVES”:

Definition through limits Existence conditions Rules of computation Interpretation and meaning Variational principles Applications in physics Tangent line geometry Inverse processes Vector calculus foundations Extreme value theory Smoothness classes

The Fundamental Definition

Let’s begin with the precise definition of the derivative. For a function f: ℝ → ℝ, the derivative at a point x₀, denoted f’(x₀), is defined as:

f'(x_0) = \lim_{h \to 0} \frac{f(x_0 + h) - f(x_0)}{h}

This can be understood through three complementary perspectives:

Geometric Perspective: The derivative represents the slope of the tangent line to the graph of f at x₀. Consider how we might determine this slope:
- First, draw a secant line through (x₀, f(x₀)) and (x₀ + h, f(x₀ + h))
- Calculate its slope:

f(x₀ + h) - f(x₀)

- Let h approach zero to obtain the tangent slope

2. Physical Perspective: The derivative represents an instantaneous rate of change. In physics, we encounter this as:

- Velocity as the derivative of position

- Force as the derivative of momentum

- Power as the derivative of energy

3. Analytical Perspective: The derivative is a local linear approximation. For small h:

f(x_0 + h) \approx f(x_0) + f'(x_0)h

This linear approximation becomes increasingly accurate as h approaches zero.

Existence and Smoothness

Not every function is differentiable. Let’s understand the conditions for differentiability using the “SHADE” criteria:

Single-valued function Has a limit at the point Approaches from both sides Difference quotient exists Equals the same value from both directions

Consider the absolute value function f(x) = |x| at x = 0:

Left-hand derivative = -1
Right-hand derivative = 1
Therefore, f’(0) does not exist

This example illustrates why corners in physical paths represent infinite accelerations and are physically impossible.

Differentiability Classes

Functions can be classified by their degree of smoothness:

C⁰: Continuous functions
C¹: Continuously differentiable functions
C²: Twice continuously differentiable functions
C∞: Infinitely differentiable functions
Cω: Analytic functions

Physical significance:

Classical mechanics typically assumes C² functions for position (so acceleration exists)
Quantum mechanics often requires C∞ wave functions
Many physical laws assume analyticity (Cω)

The Rules of Differentiation

While we can always return to the limit definition, we have powerful rules for computing derivatives. Remember them through “PLUMP”:

Product rule: (fg)’ = f’g + fg’ Linear combination rule: (af + bg)’ = af’ + bg’ Uniform continuity isn’t required Multichain rule: (f∘g∘h)’ = (f’∘g∘h)(g’∘h)(h’) Power rule: (xⁿ)’ = nxⁿ⁻¹

Higher Derivatives

Higher derivatives reveal deeper structure:

f^{(n)}(x) = \frac{d^n}{dx^n}f(x)

Physical interpretation:

f’(x): Rate of change (velocity)
f”(x): Rate of rate of change (acceleration)
f'''(x): Jerk
f⁽⁴⁾(x): Snap
f⁽⁵⁾(x): Crackle
f⁽⁶⁾(x): Pop

Mean Value Theorem and Applications

The Mean Value Theorem (MVT) states that for f continuous on

a,b

and differentiable on (a,b):

\exists c \in (a,b) : f'(c) = \frac{f(b)-f(a)}{b-a}

Physical interpretation: If you travel 60 miles in one hour, you must have been going exactly 60 mph at some point during your journey.

Applications in physics:

Conservation laws from symmetries
Extremal principles in mechanics
Boundary value problems in field theory

Differential Operators in Physics

The derivative forms the basis for important differential operators:

Gradient (∇):

\nabla f = \left(\frac{\partial f}{\partial x^1}, ..., \frac{\partial f}{\partial x^n}\right)

Physical meaning: Direction of steepest increase

Divergence (∇·):

\nabla \cdot \mathbf{F} = \sum_{i=1}^n \frac{\partial F_i}{\partial x^i}

Physical meaning: Source/sink strength

Curl (∇×):

(\nabla \times \mathbf{F})*i = \epsilon*{ijk}\frac{\partial F_k}{\partial x^j}

Physical meaning: Rotational tendency

Partial Derivatives and the Chain Rule

For functions of multiple variables, partial derivatives measure rates of change in specific directions:

\frac{\partial f}{\partial x^i} = \lim_{h \to 0} \frac{f(x^1,...,x^i+h,...,x^n) - f(x^1,...,x^i,...,x^n)}{h}

The multivariable chain rule takes the form:

\frac{df}{dt} = \sum_{i=1}^n \frac{\partial f}{\partial x^i}\frac{dx^i}{dt}

Physical Applications

Hamilton’s Equations:

\dot{q}_i = \frac{\partial H}{\partial p_i}, \quad \dot{p}_i = -\frac{\partial H}{\partial q_i}

The derivatives give the evolution of canonical coordinates.

Einstein’s Field Equations:

R_{\mu\nu} - \frac{1}{2}Rg_{\mu\nu} = \frac{8\pi G}{c^4}T_{\mu\nu}

Contains up to second derivatives of the metric.

3. Schrödinger Equation:

i\hbar\frac{\partial}{\partial t}\psi = -\frac{\hbar^2}{2m}\nabla^2\psi + V\psi

Involves both time and space derivatives.

Exercises for Mastery

Prove the Product Rule Use the definition of derivative and algebra to prove (fg)’ = f’g + fg’.
Physical Application Show that if energy is conserved in a system, its time derivative must be zero.
Geometric Understanding Explain why the derivative of sin(x) is cos(x) using the unit circle.

Looking Ahead

In our next section, we’ll explore applications of derivatives, particularly in finding extrema and analyzing function behavior. These tools will be crucial for understanding variational principles in physics and optimizing physical quantities.

Remember: Derivatives aren’t just rules for manipulation — they’re our mathematical language for describing change, and understanding them deeply is crucial for physics at all scales.

Next: Part 5 - Applications of Derivatives in Physics