9 Subsequences
Highlights of this Chapter: We define the concept of subsequence, and investigate examples where subsequences behave much simpler than the overall sequence with the example of continued fractions. We then investigate the relationship between the convergence of subsequences and the convergence of a sequence as a whole. This leads to several nice theorems:
- A continued fraction description of the golden ratio and
- Theorem: a sequence converges if it is a union of subsequences converging to the same limit.
- Theorem: every bounded sequence contains a convergent subsequence.
Definition 9.1 A subsequence is a subset of a sequence which is itself a sequence. As sequences are infinite ordered lists of real numbers, an equivalent definition is that a subsequence is any infinite subset of a sequence.
We often denote an abstract subsequence like
Example 9.1 (Example Subsequences) In the sequence of all
Archimedes began his estimation of
9.1 Continued Fractions
In the previous section, we uncovered a beautiful formula for the golden ratio as the limit of an infinite process of square roots. However, practically speaking (if you were interested in calculating the value of the golden ratio, as the ancient mathematicians were) this series is useless. The golden ratio itself involves a square root, so if you are seeking a method of approximations its fair to assume that you cannot evaluate the square root function exactly. But what does our sequence of approximations look like? To calculate the
To be practical, we would like a sequence that (1) contains easy to compute terms, and (2) converges to the number we seek to understand. By ?thm-rational-sequence, we know for any real number there exists a sequence of rationals that converges to it, and so it’s natural to seek a method of producing such a thing.
One method is the continued fraction, which is best illustrated by example. We know that the golden ratio
Just like we did above, we can use this self-referential equation to produce a series, by plugging it into itself over and over. After one such substitution we get
And then after another such we get
Continuing this way over and over, we push the
Of course, this ‘infinite manipulation’ is not itself rigorous, but we can interpret this as a recursive sequence exactly as above. Setting
Example 9.2 (Continued Fraction of the Golden Ratio) The continued fration
A continued fraction is a recursive sequence, so we can compute everything with the starting value and a single simple rule. To get a feel for the sequence at hand, let’s compute the first few terms:
What’s one thing we notice about this sequence from its first few terms? Well - it looks like the fractions are all ratios of Fibonacci numbers! This won’t actually be relevant but it’s a good practice of induction with the sequence definition, so we might as well confirm it:
Example 9.3 (Fibonacci Numbers and the Golden Ratio) Recall that the Fibonacci numbers are defined by the recurrence relation
Proof. This is true for the first convergent which is
The more important thing we notice is that looking at the magnitude of the terms, it is neither increasing or decreasing, but it appears the sequence is zig-zagging up and down. Its straightforward to prove this is actually the case:
Example 9.4 If
Proof. Again, we proceed by induction: we prove only the first case, and leave the second as an exercise. Note first
Now, assume that
The last line of this computation is the definition of
While the overall sequence isn’t monotone, it seems to be built of two different monotone sequences, interleaved with one another! In particular the odd subsequence
To study these subsequences separately, we first need to find a recurrence relation that gives us
Example 9.5 The subsequence
Proof. We prove this by induction. Starting from
This completes the induction step, so the subsequence of odd terms is monotone increasing as claimed!
A nearly identical argument applies to the even subsequence:
Exercise 9.1 The subsequence
Exercise 9.2 Let
Now that we know each sequene is monotone, we are in a position similar to the previous chapter where we played two sequences off one another to learn about
Example 9.6 The odd subsequence of
Proof. The even subsequece is monotone decreasing, but consists completely of positive terms. Thus, its bounded below by zero. Now we turn our attention to the odd subsequence: if
Now we know by monotone convergence that both the even and odd subsequences converge! Next, we show they converge to the same value:
Example 9.7 Both the even and odd subsequences converge to the same value.
Proof. Let
Using the recurrence relation we see
Now we know that not only the even and odd subsequences converge but that they converge to the same limit! Its not too much more work to show that the entire sequence converges.
Example 9.8 The sequence
Proof. Call the common limit of the even and odd subsequences
Set
Finally! Starting with a zigzag sequence where monotone convergene did not apply, we broke it into two subsequences, each of which were monotone, and each of which we could prove converge. Then we showed these subsequences have the same limit and hence the overall sequence converges. We made it! Now its quick work to confirm the limit is what we expected from our construction: the golden ratio.
Example 9.9 The sequence
Proof. Since throwing away the first term of the sequence does not change the limit, we see
THus, the limit
We can apply this same process to discover another sequence of rational approximations to
We can get such a formula through some trickery: first, using the difference of squares
This is a self-referential equation, meaning
Example 9.10 (Continued Fraction of
9.2 Subsequences and Convergence
Hopefully this exploration into continued fractions has shown the usefulness of looking for easy-to-work-with subsequences, when theorems such as monotone convergence don’t automatically apply. It is then our goal to try and piece this information back together: if we know the limits of various subsequences, what can we say about the entire sequence?
A direct generalization of the even/odd case from our example above shows that if
Proposition 9.1 (Union of Two Subsequences) If
Proof. Let
Now choose arbitrary
Theorem 9.1 Let
Proof (Sketch). One can prove this directly, but choosing useful notation is tedious. The idea is as follows: for each of the
However, a simple example shows its not enough to simply say a sequence is a union of convergent subsequences: we do have to know they all have the same limit!
Example 9.11 The sequence
Or, more generally
Exercise 9.3 Prove that if a sequence
Remark 9.1. This can be turned into a useful technique to prove two sequences
9.3 Bolzano-Weierstrass
What about sequences that don’t converge? The theorem above says that it cannot be true that all their subsequences converge, but Example 9.11 does show that a divergent sequence can still contain convergent subsequences. A natural question then is - do they always? Alas, a simple counterexample shows us that is too much to ask:
Example 9.12 The sequence
But the problem here is not serious, its simply that the original sequence is unbounded and cannot possibly contain anything that converges. The perhaps surprising fact that this is the only constraint preventing the existence of a convergent subsequence is known as the Bolzano Weierstrass theorem.
Theorem 9.2 (Bolzano-Weierstrass) Every bounded sequence has a convergent subsequence
There are many ways to prove this, but a particularly elegant one uses (of course!) the monotone convergence theorem.
At first this sounds suspicious: we must confront head on the issue we ran into above, that not every sequence is monotone! However, the weaker property we actually need is true: while not every sequence is monotone, every sequence contains a monotone subsequence. There is a very clever argument for this, which needs one new definition.
Definition 9.2 (Peak of a Sequence) Let
Theorem 9.3 (Monotone Subsequences) Every sequence contains a monotone subsequence
Proof. Let
If
Otherwise, if
Now, given that every sequence has a monotone subsequence, we know that every bounded sequence has a monotone and bounded subsequence. Such things converge by MCT, so we know every sequence has a convergent subsequence! This is the Bolzano Weierstrass Theorem.
We will use this often in whats to come to produce examples of convergent subsequences where it might otherwise be difficult to do so. Here’s a first example of such an argument
Proposition 9.2 (Analyzing All Convergent Subsequences) If
Proof. Assume that every convergent (proper) subsequence of
In addition to applications like the above, in time will come to appreciate it as one of the most elegant tools available to us. There will come many times (soon, when dealing with functions) where we can easily produce a sequence of points satisfying some property, but to make progress we need a convergent sequence of such points. The BW theorem assures us that we don’t have to worry - we can always make one by just throwing out some terms, so long as the sequence we have is bounded.
9.4 Limsup and Liminf
When a sequence doesn’t converge, it can have various subsequences that converge to different limits. One way to reign in the complexity of such things is via the concepts of limit supremum and limit infimum.
Definition 9.3 (Limsup and Liminf) Let
We will have occasional use for this definition during the course, mostly because of the following: that the limsup and liminf exist for all (bounded) sequences, not just convergent ones.
Proposition 9.3 (Existence of Limsup, Liminf) Let
Proof. We verify for the limsup case, and leave the analgoous liminf as an exercise. For each
One use of these quantities is to bound the possible values of subsequential limits:
Exercise 9.4 (Bounding Subsequential Limits) Let
Proposition 9.4 A sequence
Proof. For any
It is often useful to broaden our use of
Exercise 9.5 (Subsequences & Limsup, Liminf) Let
9.5 Problems
Exercise 9.6 For any fixed
Exercise 9.7 (Continued Fractions for Roots) Let
Knowing such sequences is extremely useful for computation, in the age before computers: if
Exercise 9.8 Find a rational approximation to
We could also find a continued fraction directly for cases like this, with a little more care:
Exercise 9.9 Find the continued fraction expansion for
9.5.1 Limsup and Liminf
Exercise 9.10 Let
Provide counterexamples to show that equality does not always hold.
Exercise 9.11 Let
Exercise 9.12 Let
9.5.2 An Alternative Proof of Bolzano-Weierstrass
An alternative argument for the BW theorem proceeds via the nested interval property. Here’s an outline of how this works
- If
is bounded then there is some with for all . Call this interval , and inductively build a sequence of nested closed intervals as follows - At each stage
, bisect the interval with the midpoint . This divides into two sub-intervals, and since contains infinitely many points of the sequence, one of these two halves must still contain infinitely many points. Choose this as the interval . - Now, this sequence of nested intervals has nonempty intersection by the Nested Interval Property. So, let
be a point in the intersection. - Now, we just need to build a subsequence of
which converges to . We build it inductively as follows: let the first term be , and then for each choose some point that is distinct from all previously chosen points (we can do this because there are infinitely many points available in and we have only used finitely many so far in our subsequence). - This new sequence is trapped between
and , which both converge to . Thus it converges by the squeeze theorem!
Exercise 9.13 In this problem, you are to check the main steps of this proof to ensure it works. Namely, given the above situation prove that
- If
, the sequences and of endpoints converge. Hint: Monotone Convergence , so the Squeeze theorem really does apply *Hint: use that at each stage we are bisecting the intervals: can you find a formula for the sequence , and prove this converges to zero?
Exercise 9.14 (Simultaneous Bolzano Weierstrass) Given two bounded sequences