Limit – Fundamental Concept of Calculus

Understand the concept of limits in calculus, including right-hand and left-hand limits, and their role in continuity an...
🔑

Definition of a Limit

In calculus, a limit is the value that a function "approaches" as the input "approaches" some value. Limits are essential to calculus and are used to define continuity, derivatives, and integrals. The concept describes the behavior of a function near a particular point, rather than at the point itself. It is the mathematical way to describe "getting arbitrarily close" with precise control over accuracy.

\[ \lim_{x \to a} f(x) = L \quad \text{if and only if} \quad \forall \epsilon > 0, \exists \delta > 0: |x - a| < \delta \Rightarrow |f(x) - L| < \epsilon \]
Formal Epsilon-Delta Definition
SymbolDescription
\[ \lim_{x \to a} \]Limit Notation - Describes the behavior of a function as its input \(x\) approaches a value \(a\).
\[ L \]Limit Value - The value that \(f(x)\) approaches as \(x\) approaches \(a\).
\[ \epsilon \]Epsilon - An arbitrarily small positive number representing the desired accuracy or tolerance for the output \(f(x)\).
\[ \delta \]Delta - A small positive number controlling how close the input \(x\) must be to \(a\) to ensure \(f(x)\) is within \(\epsilon\) of \(L\).
\[ a^+ / a^- \]One-Sided Limits - Approaching \(a\) from values greater than \(a\) (right-hand) or less than \(a\) (left-hand).
\[ \infty \]Infinity - Represents a process of unlimited growth, not a specific number.
⚖️

Key Limit Formulas & Rules

\[ \lim_{x \to a} [f(x) \pm g(x)] = \lim_{x \to a} f(x) \pm \lim_{x \to a} g(x) \]
Sum/Difference Rule
\[ \lim_{x \to a} [f(x) \cdot g(x)] = \lim_{x \to a} f(x) \cdot \lim_{x \to a} g(x) \]
Product Rule
\[ \lim_{x \to a} \left(\frac{f(x)}{g(x)}\right) = \frac{\lim_{x \to a} f(x)}{\lim_{x \to a} g(x)} \quad \text{if } \lim_{x \to a} g(x) \neq 0 \]
Quotient Rule
\[ \lim_{x \to a} c \cdot f(x) = c \cdot \lim_{x \to a} f(x) \]
Constant Multiple Rule
\[ \lim_{x \to 0} \frac{\sin x}{x} = 1 \]
Fundamental Trigonometric Limit
\[ \lim_{x \to \infty} \left(1 + \frac{1}{x}\right)^x = e \]
Definition of Euler's Number (e)
\[ \lim_{x \to a} \frac{f(x)}{g(x)} = \lim_{x \to a} \frac{f'(x)}{g'(x)} \]
L'Hôpital's Rule (for 0/0 or ∞/∞ forms)
\[ \text{If } g(x) \leq f(x) \leq h(x) \text{ and } \lim_{x \to a} g(x) = \lim_{x \to a} h(x) = L, \text{ then } \lim_{x \to a} f(x) = L \]
Squeeze Theorem
📊

Visualizing a Limit

x y L+ε L−ε L c c−δ c+δ lim f(x) = L x → c
The ε-δ definition of a limit: f(x) → L as x → c whenever x stays within δ of c (yellow band), the output stays within ε of L (purple band). The function need not be defined at c.

A limit is visualized on a graph of a function \( y = f(x) \). As the x-value gets closer and closer to a point \(a\) from both the left and the right, the y-value of the function gets closer and closer to a specific value \(L\). The function does not need to be defined at \(x=a\) for the limit to exist; there could be a hole in the graph at \((a, L)\). The epsilon-delta definition creates a "box" around the point \((a, L)\) with width \(2\delta\) and height \(2\epsilon\), guaranteeing that if \(x\) is within the \(\delta\)-interval of \(a\), then \(f(x)\) will be within the \(\epsilon\)-interval of \(L\).

⚙️

Properties of Limits

PropertyDescription
UniquenessIf the limit of a function at a point exists, it is unique. A function cannot approach two different values at the same point.
LocalityThe limit of a function at a point \(a\) depends only on the values of the function in the immediate neighborhood of \(a\). It is not affected by the value of the function at \(a\) itself.
CompositionIf \(f\) is continuous at \(L\) and \(\lim_{x \to a} g(x) = L\), then \(\lim_{x \to a} f(g(x)) = f(L)\). This allows passing a limit inside a continuous function.
Preservation of InequalitiesIf \(f(x) \le g(x)\) for all \(x\) near \(a\), and the limits of both functions exist, then \(\lim_{x \to a} f(x) \le \lim_{x \to a} g(x)\).
🔬

Proof of the Sum Rule

We want to prove that if \(\lim_{x \to a} f(x) = L\) and \(\lim_{x \to a} g(x) = M\), then \(\lim_{x \to a} [f(x) + g(x)] = L + M\). We will use the formal epsilon-delta definition of a limit.

1. State the goal: For any given \(\epsilon > 0\), we need to find a \(\delta > 0\) such that if \(0 < |x - a| < \delta\), then \(|(f(x) + g(x)) - (L + M)| < \epsilon\).

2. Use the given limits: Since \(\lim_{x \to a} f(x) = L\), for \(\epsilon/2 > 0\), there exists a \(\delta_1 > 0\) such that if \(0 < |x - a| < \delta_1\), then \(|f(x) - L| < \epsilon/2\).

Similarly, since \(\lim_{x \to a} g(x) = M\), for \(\epsilon/2 > 0\), there exists a \(\delta_2 > 0\) such that if \(0 < |x - a| < \delta_2\), then \(|g(x) - M| < \epsilon/2\).

3. Choose \(\delta\): Let \(\delta = \min(\delta_1, \delta_2)\). This ensures that if \(0 < |x - a| < \delta\), both conditions above are satisfied simultaneously.

4. Apply the Triangle Inequality: We can rearrange the expression from our goal and apply the triangle inequality \(|A+B| \le |A| + |B|\).

\[ |(f(x) + g(x)) - (L + M)| = |(f(x) - L) + (g(x) - M)| \le |f(x) - L| + |g(x) - M| \]

5. Conclude the proof: For \(0 < |x - a| < \delta\), we can substitute the inequalities from step 2:

\[ |f(x) - L| + |g(x) - M| < \frac{\epsilon}{2} + \frac{\epsilon}{2} = \epsilon \]

Thus, we have shown that for any \(\epsilon > 0\), there exists a \(\delta\) such that if \(0 < |x - a| < \delta\), then \(|(f(x) + g(x)) - (L + M)| < \epsilon\). This completes the proof.

✏️

Worked Example

Evaluate the limit: \[ \lim_{x \to 3} \frac{x^2 - 9}{x - 3} \]
  1. First, try direct substitution by plugging in \(x = 3\). This gives \(\frac{3^2 - 9}{3 - 3} = \frac{0}{0}\), which is an indeterminate form. This means we must manipulate the expression.
  2. Factor the numerator, which is a difference of squares: \(x^2 - 9 = (x - 3)(x + 3)\).
  3. Rewrite the limit expression with the factored numerator: \[ \lim_{x \to 3} \frac{(x - 3)(x + 3)}{x - 3} \]
  4. Since the limit considers values of \(x\) approaching 3 but not equal to 3, \(x - 3\) is not zero, so we can cancel the \((x - 3)\) terms.
  5. The expression simplifies to: \[ \lim_{x \to 3} (x + 3) \]
  6. Now, use direct substitution on the simplified expression: \(3 + 3 = 6\).
\[ \lim_{x \to 3} \frac{x^2 - 9}{x - 3} = 6 \]
🚀

Applications of Limits

Engineering & Physics: Limits are fundamental to defining instantaneous velocity and acceleration. They are also used to analyze stress concentrations in materials near a crack or hole, and to determine critical thresholds for structural failure.

Economics & Finance: In economics, limits are used in marginal analysis to find the marginal cost or marginal revenue, representing the change in cost or revenue from producing one additional unit. In finance, the formula for continuously compounded interest is derived from a limit.

Biology & Medicine: Limits model population growth approaching a carrying capacity (logistic growth). In pharmacology, they describe the concentration of a drug in the bloodstream over time, approaching a steady-state or zero.

Computer Science: Limits are used to analyze the complexity of algorithms (Big O notation), describing their performance as the input size approaches infinity. They are also used in optimization algorithms, such as gradient descent in machine learning, to find the minimum of a function.

🌍

Real-World Examples

The position of a falling object is given by the function \(s(t) = 4.9t^2\) meters, where \(t\) is time in seconds. Find the instantaneous velocity of the object at \(t = 2\) seconds.
  1. Instantaneous velocity is the limit of the average velocity as the time interval approaches zero. The formula is \(v(t) = \lim_{h \to 0} \frac{s(t+h) - s(t)}{h}\).
  2. Set \(t=2\): \(v(2) = \lim_{h \to 0} \frac{s(2+h) - s(2)}{h}\).
  3. Substitute the function: \(v(2) = \lim_{h \to 0} \frac{4.9(2+h)^2 - 4.9(2)^2}{h}\).
  4. Expand and simplify the numerator: \(v(2) = \lim_{h \to 0} \frac{4.9(4 + 4h + h^2) - 19.6}{h} = \lim_{h \to 0} \frac{19.6 + 19.6h + 4.9h^2 - 19.6}{h} = \lim_{h \to 0} \frac{19.6h + 4.9h^2}{h}\).
  5. Factor out \(h\) and cancel: \(v(2) = \lim_{h \to 0} \frac{h(19.6 + 4.9h)}{h} = \lim_{h \to 0} (19.6 + 4.9h)\).
  6. Evaluate the limit by substituting \(h=0\): \(19.6 + 4.9(0) = 19.6\).
The instantaneous velocity at 2 seconds is 19.6 m/s.
An investment of $1000 earns an annual interest rate of 5% (r = 0.05). What is the value of the investment after 1 year if the interest is compounded continuously?
  1. The formula for compound interest is \(A = P(1 + r/n)^{nt}\), where \(n\) is the number of times compounded per year. Continuous compounding means we take the limit as \(n \to \infty\).
  2. The formula becomes \(A = P \cdot \lim_{n \to \infty} (1 + r/n)^{nt}\). For one year, \(t=1\).
  3. Let \(x = n/r\). As \(n \to \infty\), \(x \to \infty\). Then \(n = xr\). The limit part becomes \(\lim_{x \to \infty} (1 + 1/x)^{xr} = [\lim_{x \to \infty} (1 + 1/x)^x]^r\).
  4. We know the standard limit \(\lim_{x \to \infty} (1 + 1/x)^x = e\). So the expression simplifies to \(e^r\).
  5. The formula for continuous compounding is \(A = Pe^{rt}\).
  6. Substitute the values: \(A = 1000 \cdot e^{(0.05)(1)} = 1000 \cdot e^{0.05} \approx 1000 \cdot 1.05127\).
The value of the investment after 1 year is approximately $1051.27.
🏙️

Real-World Scenarios

0/0 indeterminate form L′Hôpital lim f/g = lim f′/g′
L'Hôpital's Rule
When a limit yields 0/0 or ∞/∞, L'Hôpital's Rule resolves the indeterminate form: lim f(x)/g(x) = lim f′(x)/g′(x). This is essential for evaluating limits in Taylor series, probability densities, and signal analysis.
as Δt → 0, samples → signal
Digital Sensor Sampling
A digital sensor approximates a continuous physical signal by taking discrete samples. As the sampling interval Δt → 0, the sampled data converges to the true continuous signal — the same limiting process that defines derivatives and integrals.
0.1 + 0.2 ≠ 0.3 IEEE 754 rounding lim as ε → 0 lim as ε → 0
Floating-Point Precision
CPU floating-point arithmetic has finite precision: 0.1 + 0.2 ≠ 0.3 exactly. Numerical algorithms use limit theory to bound these rounding errors — expressing the true result as the limit of a sequence of finite-precision approximations as ε → 0.

Terminal Velocity
As a skydiver falls, their speed increases due to gravity but is counteracted by air resistance, which grows with speed. The skydiver's velocity approaches a maximum constant value called terminal velocity. This terminal velocity is the limit of the speed function as time approaches infinity.

Chemical Equilibrium
In a reversible chemical reaction, the rate of the forward reaction decreases as reactants are consumed, while the rate of the reverse reaction increases as products are formed. The system approaches a state of equilibrium where the concentrations of reactants and products become constant. These equilibrium concentrations are the limits of the concentration functions over time.

Zeno's Paradox
The ancient Greek paradox of Achilles and the tortoise illustrates a limit. To finish a race, a runner must first cover half the distance, then half the remaining distance, and so on. The total distance covered is the limit of the infinite series \(1/2 + 1/4 + 1/8 + ...\), which converges to 1, showing that the runner does indeed finish the race.

🗂️

Types and Classifications

Limits can be classified based on how the input variable approaches its target value and the behavior of the function's output.

Limit TypeNotationDescription
Two-Sided Limit\[ \lim_{x \to a} f(x) \]The function approaches the same value L from both the left and the right of \(a\).
Right-Hand Limit\[ \lim_{x \to a^+} f(x) \]The input \(x\) approaches \(a\) from values greater than \(a\).
Left-Hand Limit\[ \lim_{x \to a^-} f(x) \]The input \(x\) approaches \(a\) from values less than \(a\).
Limit at Infinity\[ \lim_{x \to \infty} f(x) \]Describes the end behavior of a function as \(x\) grows without bound.
Infinite Limit\[ \lim_{x \to a} f(x) = \infty \]The function's value grows without bound as \(x\) approaches \(a\) (e.g., a vertical asymptote).

Indeterminate Forms
When direct substitution yields one of the following forms, it does not mean the limit does not exist, but that further analysis (like algebraic manipulation or L'Hôpital's Rule) is required.

\[ \frac{0}{0}, \quad \frac{\infty}{\infty}, \quad 0 \cdot \infty, \quad \infty - \infty, \quad 0^0, \quad 1^{\infty}, \quad \infty^0 \]
⚠️

Common Mistakes

⚠️ Assuming the Limit Equals the Function Value: A common error is to assume \(\lim_{x \to a} f(x)\) is always equal to \(f(a)\). This is only true if the function is continuous at \(a\). The limit can exist even if \(f(a)\) is undefined.
⚠️ Incorrectly Applying L'Hôpital's Rule: L'Hôpital's Rule only applies to indeterminate forms of \(0/0\) or \(\infty/\infty\). Applying it to other forms (like \(\infty - \infty\) without first converting it to a quotient) will lead to an incorrect answer.
⚠️ Treating Infinity as a Number: Infinity (\(\infty\)) is a concept of unbounded growth, not a real number. Algebraic operations like \(\infty - \infty = 0\) are invalid. Indeterminate forms involving infinity must be handled with proper limit techniques.
🚀

Study Strategy

1 🧠 Grasp the Core Concept
  • Focus on the 'Definition of a Limit' to understand what `lim h→0` truly signifies in the formula.
  • Use the 'Visualizing a Limit' section to connect the abstract formula to the geometric idea of a secant line approaching a tangent line.
  • Recognize that the `[f(x+h) - f(x)] / h` part of the formula is the slope of a secant line.
  • Review the 'Properties of Limits' to understand the algebraic rules that govern how limits are manipulated.
2 ✍️ Commit Formulas to Memory
  • Write out the primary limit definition of a derivative, `f'(x) = lim(h→0) [f(x+h) - f(x)] / h`, until it is memorized.
  • Create flashcards for the 'Key Limit Formulas & Rules', especially for constants, powers of x, and trigonometric functions.
  • Actively recall the steps in the 'Proof of the Sum Rule' to internalize how limit properties are applied in derivations.
  • Memorize the results of special limits, such as `lim(x→0) sin(x)/x = 1`, which are foundational for more complex proofs.
3 💪 Reinforce with Practice
  • Replicate the 'Worked Example' without looking at the solution to test your understanding of the algebraic steps.
  • Apply the limit formula to find the derivatives of basic functions like `f(x) = x²`, `f(x) = c`, and `f(x) = 1/x`.
  • Consult the 'Common Mistakes' section before starting practice problems to preemptively avoid errors like improper cancellation.
  • Use the 'Types and Classifications' section to find varied functions (polynomial, rational) to practice on.
4 📈 Connect to Applications
  • Read the 'Applications of Limits' section to explicitly connect the derivative to the concept of an instantaneous rate of change.
  • Analyze the 'Real-World Examples' to see how the formula calculates instantaneous velocity from a position function.
  • Attempt to set up the limit formula for one of the problems described in the 'Real-World Scenarios' section.
  • Examine the 'Related Formulas' to understand how this fundamental definition is the basis for all other differentiation rules.
By systematically building from concept to application, you'll master the limit definition of a derivative and unlock the core of calculus.

Frequently Asked Questions

×

×