Limits and Derivatives
The limit is the foundation on which all of calculus is built. This chapter develops limits intuitively, numerically, graphically, and rigorously, then uses them to define the two central objects of differential calculus: the tangent line and the derivative.
The Tangent and Velocity Problems
Two classic problems motivate the entire subject. Finding the slope of a line tangent to a curve and finding the instantaneous velocity of a moving object both require the same idea: a quantity approached by a sequence of approximations. That idea is the limit.
The Tangent Problem
Tangent line
A line that touches a curve at a point and has the same direction as the curve there. For a circle it meets the curve exactly once, but for general curves a one-point rule is inadequate, so the tangent is instead defined as a limit of secant lines.
Secant line
A line through two points of a curve. As the second point slides toward the point of tangency, the secant slopes approach the slope of the tangent line.
The Velocity Problem
Average velocity
Change in position divided by elapsed time over an interval. It equals the slope of the secant line on the position-versus-time graph.
Instantaneous velocity
The limiting value of average velocities as the time interval shrinks to zero. It equals the slope of the tangent line to the position graph at that instant.
Both problems reduce to the same limit, \( \lim_{h\to 0}\dfrac{f(a+h)-f(a)}{h} \). Once you internalize that "slope of tangent" and "instantaneous velocity" are the same calculation, the rest of the chapter becomes one idea applied repeatedly. In mechanics this limit reappears as velocity, acceleration, and every rate you'll meet in dynamics — keep it front of mind.
The Limit of a Function
Having seen where limits arise, we now study them directly using numerical tables, graphs, and an intuitive definition.
Intuitive meaning of a limit
We write \( \lim_{x\to a} f(x) = L \) if the values of \(f(x)\) can be made arbitrarily close to \(L\) by taking \(x\) sufficiently close to \(a\) (on either side) but not equal to \(a\). The value of \(f\) at \(a\) itself is irrelevant — only the behaviour near \(a\) matters.
One-Sided Limits
Left-hand and right-hand limits
\( \lim_{x\to a^-} f(x) = L \) means \(f(x)\) approaches \(L\) as \(x\) approaches \(a\) from values less than \(a\); \( \lim_{x\to a^+} f(x) = L \) uses values greater than \(a\).
\( \displaystyle \lim_{x\to a} f(x) = L \) if and only if both one-sided limits exist and equal \(L\):
\[ \lim_{x\to a} f(x) = L \iff \lim_{x\to a^-} f(x) = L = \lim_{x\to a^+} f(x). \]
Infinite Limits
Infinite limit
\( \lim_{x\to a} f(x) = \infty \) means \(f(x)\) can be made arbitrarily large by taking \(x\) close enough to \(a\). The symbol \(\infty\) is not a number; the limit does not "exist" in the usual sense — the notation just describes how it fails.
Vertical asymptote
The line \(x=a\) is a vertical asymptote of \(y=f(x)\) if at least one one-sided limit of \(f\) at \(a\) is \(+\infty\) or \(-\infty\).
Calculating Limits Using the Limit Laws
Tables and graphs can mislead. The Limit Laws let us compute limits exactly from a few basic principles.
If \(c\) is a constant and \( \lim_{x\to a} f(x) \) and \( \lim_{x\to a} g(x) \) exist, then:
Direct Substitution Property
If \(f\) is a polynomial or a rational function and \(a\) is in the domain of \(f\), then \( \lim_{x\to a} f(x) = f(a) \). Such functions are exactly the ones that are continuous at \(a\) (Section 2.5).
If \( f(x) \le g(x) \) near \(a\) (except possibly at \(a\)) and both limits exist, then \( \lim_{x\to a} f(x) \le \lim_{x\to a} g(x) \).
If \( f(x) \le g(x) \le h(x) \) near \(a\) (except possibly at \(a\)) and \( \lim_{x\to a} f(x) = \lim_{x\to a} h(x) = L \), then \( \lim_{x\to a} g(x) = L \).
Intuitively, a function trapped between two others that meet at \(L\) is forced to \(L\) as well.
When direct substitution gives \(0/0\), that's an indeterminate form — not an answer, but a signal to do algebra first: factor, rationalize, or simplify a complex fraction, then substitute. The Squeeze Theorem is your tool when a function won't factor but you can bound it. Reach for it whenever you see a bounded factor (like sine or cosine) multiplied by something going to zero.
The Precise Definition of a Limit
Phrases like "close to" are too vague for proofs. The epsilon–delta definition makes the intuitive notion of a limit rigorous.
The ε–δ definition of a limit
\( \lim_{x\to a} f(x) = L \) means: for every \( \varepsilon > 0 \) there exists a \( \delta > 0 \) such that whenever \( 0 < |x-a| < \delta \), it follows that \( |f(x)-L| < \varepsilon \). Read as a challenge — for any error tolerance \(\varepsilon\), you can find a closeness \(\delta\) that guarantees it.
One-sided ε–δ definitions
For the left-hand limit, restrict \(x\) to \( a-\delta < x < a \); for the right-hand limit, restrict \(x\) to \( a < x < a+\delta \). Everything else is identical.
Precise definition of an infinite limit
\( \lim_{x\to a} f(x) = \infty \) means: for every \( M > 0 \) there is a \( \delta > 0 \) such that \( 0 < |x-a| < \delta \) implies \( f(x) > M \). A negative-infinity version replaces \( f(x) > M \) with \( f(x) < N \) for every \( N < 0 \).
If \( \lim_{x\to a} f(x) = L \) and \( \lim_{x\to a} g(x) = M \), then \( \lim_{x\to a}[f(x)+g(x)] = L+M \). The proof picks \(\delta_1,\delta_2\) making each of \( |f-L| \) and \( |g-M| \) less than \( \varepsilon/2 \), then uses the Triangle Inequality \( |f+g-(L+M)| \le |f-L| + |g-M| < \varepsilon \).
Continuity
The functions whose limits equal their values are called continuous — their graphs have no breaks.
Continuity at a number
A function \(f\) is continuous at \(a\) if \( \lim_{x\to a} f(x) = f(a) \). This single equation silently requires three things: \(f(a)\) is defined, the limit exists, and the two are equal.
Types of discontinuity
Removable: the limit exists but doesn't equal \(f(a)\) (a hole), fixable by redefining one point. Jump: the one-sided limits exist but differ. Infinite: the function blows up, as at a vertical asymptote.
One-sided continuity & continuity on an interval
\(f\) is continuous from the right at \(a\) if \( \lim_{x\to a^+} f(x) = f(a) \), and from the left if \( \lim_{x\to a^-} f(x) = f(a) \). It is continuous on an interval if it is continuous at every number there (using one-sided continuity at endpoints).
If \(f\) and \(g\) are continuous at \(a\) and \(c\) is a constant, then \( f+g,\ f-g,\ cf,\ fg \), and \( f/g \) (where \( g(a)\neq 0 \)) are all continuous at \(a\). A composition of continuous functions is continuous: if \(g\) is continuous at \(a\) and \(f\) is continuous at \(g(a)\), then \( f\circ g \) is continuous at \(a\).
Polynomials, rational functions, root functions, trigonometric and inverse trigonometric functions, exponential functions, and logarithmic functions are all continuous at every number in their domains.
If \(f\) is continuous on the closed interval \([a,b]\) and \(N\) is any value between \(f(a)\) and \(f(b)\) with \( f(a)\neq f(b) \), then there exists \(c\) in \((a,b)\) with \( f(c) = N \). A continuous graph cannot jump over a horizontal line — it must cross it.
The Intermediate Value Theorem is the workhorse behind numerical root-finding (bisection method). In engineering you'll use exactly this sign-change logic to locate where a stress, temperature, or equilibrium condition crosses a critical value. The theorem only promises a root exists — it doesn't hand you the value, which is why iterative methods matter.
Limits at Infinity; Horizontal Asymptotes
Instead of letting \(x\) approach a finite number, we now let \(x\) grow without bound and ask what happens to \(f(x)\).
Limit at infinity
\( \lim_{x\to\infty} f(x) = L \) means \(f(x)\) can be made arbitrarily close to \(L\) by taking \(x\) sufficiently large. A parallel definition uses \( x\to -\infty \) for large negative \(x\).
Horizontal asymptote
The line \(y=L\) is a horizontal asymptote of \(y=f(x)\) if either \( \lim_{x\to\infty} f(x) = L \) or \( \lim_{x\to -\infty} f(x) = L \). A curve may have two different horizontal asymptotes (e.g. \( y=\tan^{-1}x \) with \( \pm\pi/2 \)).
If \( r > 0 \) is rational, then \( \displaystyle \lim_{x\to\infty}\frac{1}{x^r} = 0 \), and (where \(x^r\) is defined for all \(x\)) \( \displaystyle \lim_{x\to -\infty}\frac{1}{x^r} = 0 \).
Infinite limits at infinity
\( \lim_{x\to\infty} f(x) = \infty \) records that \(f(x)\) grows without bound as \(x\) does. For example \( \lim_{x\to\infty} x^3 = \infty \) while \( \lim_{x\to -\infty} x^3 = -\infty \). Exponential growth eventually outpaces any power: \( e^x \) dwarfs \( x^3 \) for large \(x\).
Derivatives and Rates of Change
The tangent-slope limit and the velocity limit are the same object — the derivative — and it measures a rate of change in any science.
Tangent line via the derivative
The tangent line to \(y=f(x)\) at \(P(a,f(a))\) is the line through \(P\) whose slope is the limit of secant slopes, provided that limit exists.
Instantaneous velocity
For a position function \( s=f(t) \), the velocity at \( t=a \) is the limit of average velocities over shrinking intervals — exactly the derivative of \(f\) at \(a\).
The derivative at a number
The derivative of \(f\) at \(a\), written \( f'(a) \), is the limit defining the tangent slope and the velocity. Because the same limit measures rate of reaction, marginal cost, power, and population growth, it earns its own name and notation.
Average vs. instantaneous rate of change
The average rate of change of \(y=f(x)\) over \([x_1,x_2]\) is \( \Delta y/\Delta x \), the secant slope. Its limit as \( \Delta x \to 0 \) is the instantaneous rate of change — the derivative \( f'(x_1) \), the tangent slope.
"Derivative = instantaneous rate of change" is the sentence to memorize. Velocity is the rate of change of position; acceleration is the rate of change of velocity; power is the rate of change of work; marginal cost is the rate of change of cost. Same limit, different units. When you read a derivative's units (e.g. dollars per yard, m/s), you immediately know what it physically means.
The Derivative as a Function
By letting the base point vary, the derivative becomes a new function in its own right.
The derivative as a function
Replacing the fixed number \(a\) with a variable \(x\) produces the function \(f'\), whose value at each \(x\) is the slope of the tangent to \(y=f(x)\) there. Its domain is the set of \(x\) where the limit exists, which may be smaller than the domain of \(f\).
Leibniz and other notations
For \(y=f(x)\), the derivative is written \( f'(x) = y' = \dfrac{dy}{dx} = \dfrac{df}{dx} = \dfrac{d}{dx}f(x) = Df(x) \). The symbol \( dy/dx \) is a single object, not a literal quotient (for now), though it behaves suggestively.
Differentiable
\(f\) is differentiable at \(a\) if \( f'(a) \) exists, and differentiable on an interval if it is differentiable at every point there.
If \(f\) is differentiable at \(a\), then \(f\) is continuous at \(a\). The converse is false: \( f(x) = |x| \) is continuous at 0 but not differentiable there because the graph has a corner.
How a function fails to be differentiable
Three common failures: a corner (left and right slopes differ, as in \(|x|\)), a discontinuity (no derivative since continuity fails), and a vertical tangent (the slope limit is \(\pm\infty\)).
Higher Derivatives
Second derivative and beyond
The derivative of \(f'\) is the second derivative \(f''\), interpreted as the rate of change of the slope. Continuing gives \( f''' \), \( f^{(4)} \), and in general the \(n\)th derivative \( f^{(n)} \).
Acceleration and jerk
For a position function \( s=s(t) \): the first derivative is velocity \( v = ds/dt \), the second is acceleration \( a = d^2s/dt^2 \), and the third is jerk \( j = d^3s/dt^3 \) — the rate of change of acceleration, felt as an abrupt change in motion.
In dynamics you'll live in this hierarchy: position → velocity → acceleration → jerk. Smooth ride design (elevators, trains, robotics) is largely about controlling jerk, not just acceleration — sudden acceleration changes are what passengers feel as a lurch. Note too that differentiability is stronger than continuity: a continuous signal with a sharp corner has no well-defined instantaneous rate there, which matters when you model real measured data.