Jump to content

Sequential definition of continuity – "Math for Non-Geeks"

From Wikibooks, open books for an open world


Among the sequence criteria, the epsilon-delta criterion is another way to define the continuity of functions. This criterion describes the feature of continuous functions, that sufficiently small changes of the argument cause arbitrarily small changes of the function value.

Motivation

[edit | edit source]

In the beginning of this chapter, we learned that continuity of a function may - by a simple intuition - be considered as an absence of jumps. So if we are at an argument where continuity holds, the function values will change arbitrarily little, when we wiggle around the argument by a sufficiently small amount. So , for in the vicinity of . The function values may therefore be useful to approximate .

Continuity when approximating function values

[edit | edit source]

If a function has no jumps, we may approximate its function values by other nearby values . For this approximation, and hence also for proofs of continuity, we will use the epsilon-delta criterion for continuity. So how will such an approximation look in a practical situation?

Suppose, we make an experiment that includes measuring the air temperature as a function of time. Let be the function describing the temperature. So is the temperature at time . Now, suppose there is a technical problem, so we have no data for - or we simply did not measure at exactly this point of time. However, we would like to approximate the function value as precisely as we can:

At time x_0 , the temperature is f(x_0)
At time x_0 , the temperature is f(x_0)

Suppose, a technical issue prevented the measurement of . Since the temperature changes continuously in time - and especially there is no jump at - we may instead use a temperature value measured at a time close to . So, let us approximate the value by taking a temperature with close to . That means, is an approximation for . How close must come to in order to obtain a given approximation precision?

Suppose that for the evaluation of the temperature at a later time , the maximal error shall be . So considering the following figure, the measured temperature should be in the grey region . Those are all temperatures with function values between and , i.e. inside the open interval  :

Epsilon-region around the function value f(x_0)
Epsilon-region around the function value f(x_0)

In this graphic, we may see that there is a region around , where function values differ by less than from . So in fact, there is a time difference , such that all function values are inside the interval highlighted in grey:

Delta-region around x_0, where all function values lie in an epsilon-region around f(x_0)
Delta-region around x_0, where all function values lie in an epsilon-region around f(x_0)

Therefore, we may indeed approximate the missing data point sufficiently well (meaning with a maximal error of ) . This is done by taking a time differing from by less than and then, the error of in approximating will be smaller than the desired maximal error . So will be the approximation for .


Increasing approximation precision

[edit | edit source]

What will happen, if we need to know the temperature value to a higher precision due to increased requirements in the evaluation of the experiment? For instance, if the required maximal temperature error is set to instead of  ?

Small epsilon-interval around the function value f(x_0)
Small epsilon-interval around the function value f(x_0)

In that case, thare is an interval around , where function values do not deviate by more than from . Mathematically speaking, there a exists, such that differs by a maximum amount of from , if there is  :

Small delta-interval around x_0, where all function values are in a small interval around f(x_0)
Small delta-interval around x_0, where all function values are in a small interval around f(x_0)

No matter how small we choose , thanks to the continuous temperature dependence, we may always find a , such that differs at most by from , whenever is closer to than . We keep in mind:


This holds true , since the function does not have a jump at . In other words, since is continuous at . Even beyond that, we may always infer from the above characteristic that there is no jump in the graph of at . Therefore, we may use it as a formal definition for continuity. As mathematicians frequently use the variables and when describing this characteristic, it is also called epsilon-delta-criterion for continuity.

Epsilon-delta-criterion for continuity

[edit | edit source]

Why does the epsilon-delta-criterion hold if and only if the graph of the function does not have a jump at some argument (i.e. it is continuous there)? The temperature example allows us to intuitively verify, that the epsilon-delta-criterion is satisfied for continuous functions. But will the epsilon-delta-criterion be violated, when a function has a jump at some argument? To answer this question, let us assume that the temperature as a function of time has a jump at some :

Function with a jump at x_0
Function with a jump at x_0

Let be a given maximal error that is smaller than the jump:

Epsilon-interval with an epsilon smaller than the jump
Epsilon-interval with an epsilon smaller than the jump

In that case, we may not choose a -interval around , where all function values have a deviation lower than from . If we, for instance, choose the following , then there certainly is an between and with a function value differing by more than from :

x is inside a delta-interval around x_0, but its function value f(x) has a distance larger than epsilon to f(x_0)
x is inside a delta-interval around x_0, but its function value f(x) has a distance larger than epsilon to f(x_0)

When choosing a smaller , we will find an with , as well:

x is situated in a delta-interval around x_0, but f(x) differs by more than epsilon from f(x_0)
x is situated in a delta-interval around x_0, but f(x) differs by more than epsilon from f(x_0)

No matter how small we choose , there will always be an argument with a distance of less than to , such that the function value differs by more than from . So we have seen that in an intuitive example, the epsilon-delta-criterion is not satisfied, if the function has a jump. Therefore, the epsilon-delta-criterion characterizes whether the graph of the function has a jump at the considered argument or not. That means, we may consider it as a definition of continuity. Since this criterion only uses mathematically well-defined terms, it may be used not just as an intuitive, but also as a formal definition.

Hint

In the above example, we did not pay attention to some of the aspects we would have to consider when performing actual measurements. As an example, we assumed to have perfect measurements without any errors. Of course, this is not the case in reality. Every measurement at some time has an outcome differing from the actual value . In addition, we assumed instantaneous measurements at . Usually, each recording of a value takes some time. These uncertainties have to be taken into account for real experiments.

Definition

[edit | edit source]

Epsilon-Delta criterion for continuity

[edit | edit source]

The - definition of continuity at an argument inside the domain of definition is the following:

Definition (Epsilon-Delta-definition of continuity)

A function with is continuous at , if and only if for any there is a , such that holds for all with . Written in mathematical symbols, that means is continuous at if and only if

Explanation of the quantifier notation:

The above definition describes continuity at a certain point (argument). An entire function is called continuous, when it is continuous - according to the epsilon-delta criterion - at each of its arguments in the domain of definition.

Derivation of the Epsilon-Delta criterion for discontinuity

[edit | edit source]

We may also obtain a criterion of discontinuity by simply negating the above definition. Negating mathematical propositions has already been treated in chapter „Aussagen negieren“ . While doing so, an all quantifier gets transformed into an existential quantifier and vice versa. Concerning inner implication, we have to keep in mind that the negation of is equivalent to . Negating the epsilon-delta criterion of discontinuity, we obtain:

This gets us the negation of continuity (i.e. discontinuity):

Epsilon-Delta criterion for discontinuity

[edit | edit source]

Definition (Epsilon-Delta definition of discontinuity)

A function with is discontinuous at , if and only if there is an , such that for all a with and exists. Mathematically written, is discontinuous at iff

Explanation of the quantifier notation:

Further explanations considering the Epsilon-Delta criterion

[edit | edit source]

The inequality means that the distance between and is smaller than . Analogously, tells us that the distance between and is smaller than . Therefor, the implication just says that whenever and are closer together than , then we know that the distance between and before applying the function must have been smaller than . Thus we may interpret the epsilon-delta criterion in the following way:


For continuous functions, we can control the error to be lower than by keeping the error in the argument sufficiently small (smaller than ). Finding a means answering the question: How low does my initial error in the argument have to be in order to get a final error smaller than . This may get interesting when doing numerical calculations or measurements. Imagine, you are measuring some and then using it to compute where is a continuous function. The epsilon-delta criterion allows you to find the maximal error in (i.e. ), which guarantees that the final error will be smaller than .

A may only be found if small changes around the argument also cause small changes around the function value . Hence, concerning functions continuous at , there has to be:

I.e.: whenever is sufficiently close to , then is approximately . This may also be described using the notion of an -neighborhood:


In topology, this description using neighborhoods will be generalized to a topological definition of continuity.

Visualization of the Epsilon-Delta criterion

[edit | edit source]

Description of continuity using the graph

[edit | edit source]

The epsilon-delta criterion may nicely be visualized by taking a look at the graph of a funtion. Let's start by getting a picture of the implication . This means, the distance between and is smaller than epsilon, whenever is closer to than . So for , there is . Hence, the point has to be inside the rectangle . This is a rectangle with width and height centered at :

The 2epsilon-2delta-rectangle
The 2epsilon-2delta-rectangle

We will call this the --rectangle and only consider its interior. That means, the boundary does not belong to the rectangle. Following the epsilon-delta criterion, the implication has to be fulfilled for all arguments . Thus, all points making up the graph of restricted to arguments inside the interval (in the interior of the --rectangle, which is marked green) must never be above or below the rectangle (the red area):

The 2epsilon-2delta-rectangle with allowed and forbidden areas
The 2epsilon-2delta-rectangle with allowed and forbidden areas

So graphically, we may describe the epsilon-delta criterion as follows:


Example of a continuous function

[edit | edit source]

For an example, consider the function . This fucntion is continuous everywhere - and hence also at the argument . There is . At first, consider a maximal final error of around . With , we can find a , such that the graph of is entirely situated inside the interior of the --rectangle:

Visualization of epsilon-delta continuity
Visualization of epsilon-delta continuity

But not only for , but for any we may find a , such that the graph of is situated entirely inside the respective --rectangle:

Example for a discontinuous function

[edit | edit source]

What happens if the function is discontinuous? Let's take the signum function , which is discontinuous at 0:

And here is its graph:

Graph of the signum function
Graph of the signum function

The graph intuitively allows to recognize that at , there certainly is a discontinuity. And we may see this using the rectangle visualization, as well. When choosing a rectangle height , smaller than the jump height (i.e. ), then there is no , such that the graph can be fitted entirely inside the --rectangle. For instance if , then for any - no matter how small - there will always be function values above or below the --rectangle. In fact, this apples to all values except for :

Dependence of delta or epsilon choice

[edit | edit source]

Continuity

[edit | edit source]

How does the choice of depend on and ? Suppose, an arbitrary is given in order to check continuity of . Now, we need to find a rectangle width , such that the restriction of the graph of to arguments inside the interval entirely fits into the epsilon-tube . This of course requires choosing sufficiently small. When is too large, there may be an argument in , where has escaped the tube, i.e. it has a distance to larger than  :

How small has to be chosen, will depend on three factors: The function , the given and the argument . Depending on the function slope, a different chosen (steep functions require a smaller ). Furthermore, for a smaller we also have to choose a smaller . The following diagrams illustrate this: Here, a quadratic function is plotted, which is continuous at . For a smaller , we also need to choose a smaller  :

Dependence of δ on ε: In general, δ has to be chosen smaller as ε shrinks.
Dependence of δ on ε: In general, δ has to be chosen smaller as ε shrinks.

The choice of will depend on the argument , as well. The more a function changes in the neighborhood of a certain point (i.e. it is steep around it), the smaller we have to choose . The following graphic demonstrates this: The -value proposed there is sufficiently small at , but too large at  :

The value for delta is sufficiently small for x_0, but too large for x_1.
The value for delta is sufficiently small for x_0, but too large for x_1.

In the vicinity of , the function has a higher slope compared to . Hence, we need to choose a smaller at . Let us denote the -values at and correspondingly by and - and choose to be smaller:

Both interval widths delta_1 and delta_2 are small enough for the given epsilon.
Both interval widths delta_1 and delta_2 are small enough for the given epsilon.

So, we have just seen that the choice of depends on the function to be considered, as well as the argument and the given .

Discontinuity

[edit | edit source]

For a discontinuity proof, the relations between the variables will interchange. This relates back to the interchange of the quantifiers under negation of propositions. In order to show discontinuity, we need to find an small enough, such that for no the graph of fits entirely into the --rectangle. In particular, if the discontinuity is caused by a jump, then must be chosen smaller than the jump height. For too large, there might be a , such that does fit into the --rectangle:

Which has to be chosen again depends on the function around . After has been chosen, an arbitrary will be considered. Then, an between and has to be found, such that has a distance larger than (or equal to) to . That means, the point has to be situated above or below the --rectangle. Which has to be chosen depends on a varety of parameters: the chosen and the arbitrarily given , the discontinuity and the behavior of the function around it.

Example problems

[edit | edit source]

Continuity

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe

Discontinuity

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe

Relation to the sequence criterion

[edit | edit source]

Now, we have two definitions of continuity: the epsilon-delta and the sequence criterion. In order to show that both definitions describe the same concept, we have to prove their equivalence. If the sequence criterion is fulfilled, it must imply that the epsilon-delta criterion holds and vice versa.

Epsilon-delta criterion implies sequence criterion

[edit | edit source]

Theorem (The epsilon-delta criterion implies the sequence criterion)

Let with be any function. If this function satisfies the epsilon-dela criterion at , then the sequence criterion is fulfilled at , as well.

How to get to the proof? (The epsilon-delta criterion implies the sequence criterion)

Let us assume that the function satisfies the epsilon-delta criterion at . That means:


We now want to prove that the sequence criterion is satisfied, as well. So we have to show that for any sequence of arguments converging to , there also has to be . We therefor consider an arbitrary sequence of arguments in the domain with . Our job is to show that the sequence of function values converges to . So by the definition of convergence:


Let be arbitrary. We have to find a suitable with for all sequence elements beyond that , i.e. . The inequality seems familiar, recalling the epsilon-delta criterion. The only difference is that the argument is replaced by a sequence element - so we consider a special case for . Let us apply the epsilon-delta criterion to that special case, with our arbitrarily chosen being given:


Our goal is coming closer. Whenever a sequence element is close to with , it will satisfy the inequality which we want to show, namely . It remains to choose an , where this is the case for all sequence elements beyond . The convergence implies that gets arbitrarily small. So by the definition of continuity, we may find an , with for all . This now plays the role of our . If there is , it follows that and hence by the epsilon-delta criterion. In fact, any will do the job. We now conclude our considerations and write down the proof:

Proof (The epsilon-delta criterion implies the sequence criterion)

Let e a function satisfying the epsilon-delta criterion at . Let be a sequence inside the domain of definition, i.e. for all coverging as . We would like to show that for any given there exists an , such that holds for all .

So let be given. Following the epsilon-delta criterion, there is a , with for all close to , i.e. . As converges to , we may find an with for all .

Now, let be arbitrary. Hence, . The epsilon-delta criterion now implies . This proves and therefore establishes the epsilon-delta criterion.

Sequence criterion implies epsilon-delta criterion

[edit | edit source]

Theorem (The sequence criterion implies the epsilon-delta criterion)

Let with be a function. If satisfies the sequence criterion at , then the epsilon-delta criterion is fulfilled there, as well.

How to get to the proof? (The sequence criterion implies the epsilon-delta criterion)

We need to show that the following implication holds:

This time, we do not show the implication directly, but using a contraposition. So we will prove the following implication (which is equivalent to the first one):

Or in other words:

So let be a function that violates the epsilon-delta criterion at . Hence, fulfills the discontinuity version of the epsilon-delta criterion at . We can find an ,such that for any there is a with but . It is our job now to prove, that the sequence criterion is violated, as well. This requires choosing a sequence of aguments , converging as but .

This choice will be done exploiting the discontinuity version of the epsilon-delta criterion. That version provides us with an , where holds (so continuity is violated) for certain arguments . We will now construct our sequence exclusively out of those certain . This will automatically get us .

So how to find a suitable sequence of arguments , converging to  ? The answer is: by choosing a null sequence . Practically, this is done as follows: we set . For any , we take one of the certain for as our argument . Then, but also . These make up the desired sequence . On one hand, there is and as , the convergence holds. But on the other hand , so the sequence of function values does not converge to . Let us put these thoughts together in a single proof:

Proof (The sequence criterion implies the epsilon-delta criterion)

We establish the theorem by contraposition. It needs to be shown that a function violating the epsilon-delta criterion at also violates the sequence criterion at . So let with be a function violating the epsilon-delta criterion at . Hence, there is an , such that for all an exists with but .

So for any , there is an with but . The inequality can also be written . As , there is both and . Thus, by the sandwich theorem, the sequence converges to .

But since for all , the sequence can not converge to . Therefore, the sequence criterion is violated at for the function  : We have found a sequence of arguments with but .

Exercises

[edit | edit source]

Quadratic function

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe

Concatenated absolute function

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe

Hyperbola

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe

Concatenated square root function

[edit | edit source]

Math for Non-Geeks: Composition of continuous functions

Discontinuity of the topological sine function

[edit | edit source]

Math for Non-Geeks: Template:Aufgabe