9  Subsequences

Highlights of this Chapter: We define the concept of subsequence, and investigate examples where subsequences behave much simpler than the overall sequence with the example of continued fractions. We then investigate the relationship between the convergence of subsequences and the convergence of a sequence as a whole. This leads to several nice theorems:

  • A continued fraction description of the golden ratio and 2
  • Theorem: a sequence converges if it is a union of subsequences converging to the same limit.
  • Theorem: every bounded sequence contains a convergent subsequence.

Definition 9.1 A subsequence is a subset of a sequence which is itself a sequence. As sequences are infinite ordered lists of real numbers, an equivalent definition is that a subsequence is any infinite subset of a sequence.

We often denote an abstract subsequence like snk, meaning that we have kept only the nk terms of the original, and discarded the rest.

Example 9.1 (Example Subsequences) In the sequence of all n-gons inscribed in a circle, the collection studied by archimedes (CITE EALRIER CHAP) by doubling is the subsequence P32k=(P321,P322,P323,P324,)=(P6,P12,P24,P48,)

Archimedes began his estimation of π using a simple idea: create a sequence of nested intervals (upper and lower bounds) from inscribing and circumscribing n-gons. But then he realized calculations would be much simpler if he focused only on a subsequence, namely that generated by side-doubling. We too will often run into situations like Archimedes, where the overall behavior of a sequence is difficult to understand, but we can pull out subsequences that are much easier to work with.

9.1 Continued Fractions

In the previous section, we uncovered a beautiful formula for the golden ratio as the limit of an infinite process of square roots. However, practically speaking (if you were interested in calculating the value of the golden ratio, as the ancient mathematicians were) this series is useless. The golden ratio itself involves a square root, so if you are seeking a method of approximations its fair to assume that you cannot evaluate the square root function exactly. But what does our sequence of approximations look like? To calculate the nth term, you need to take n square roots! The very terms of our convergent sequence are actually much much more algebraically complicated than their limiting value.

To be practical, we would like a sequence that (1) contains easy to compute terms, and (2) converges to the number we seek to understand. By ?thm-rational-sequence, we know for any real number there exists a sequence of rationals that converges to it, and so it’s natural to seek a method of producing such a thing.

One method is the continued fraction, which is best illustrated by example. We know that the golden ratio L satisfies the equation L2=L+1, and dividing by L this gives us an equation satisfied by L and 1/L:

L=1+1L

Just like we did above, we can use this self-referential equation to produce a series, by plugging it into itself over and over. After one such substitution we get

L=1+11+1L

And then after another such we get

L=1+11+11+1L

Continuing this way over and over, we push the L “off to infinity” on the right hand side, and are left with an infinite expression for L, as a limit of a sequence of fractions.

L=1+11+11+11+11+11+11+11+11+

Of course, this ‘infinite manipulation’ is not itself rigorous, but we can interpret this as a recursive sequence exactly as above. Setting s1=1, we have the rule sn+1=1+1sn, and we wish to understand limsn.

Example 9.2 (Continued Fraction of the Golden Ratio) The continued fration 1+11+11+11+11+11+11+11+11+ defined by the recursive sequence s1=1, sn+1=1+1sn limits to the golden ratio.

A continued fraction is a recursive sequence, so we can compute everything with the starting value and a single simple rule. To get a feel for the sequence at hand, let’s compute the first few terms:

s1=1,s2=2,s3=32,s4=53,s5=85,s6=138,s6=2113,

What’s one thing we notice about this sequence from its first few terms? Well - it looks like the fractions are all ratios of Fibonacci numbers! This won’t actually be relevant but it’s a good practice of induction with the sequence definition, so we might as well confirm it:

Example 9.3 (Fibonacci Numbers and the Golden Ratio) Recall that the Fibonacci numbers are defined by the recurrence relation F1=F1=2 and Fn+2=Fn+1+Fn. Show that the nth convergent sn of the continued fraction for the golden ratio is the ratio of the Fibonacci numbers Fn+1/Fn.

Proof. This is true for the first convergent which is 1, and F2/F1=1/1=1. Assume the nth convergent is sn=Fn+1/Fn, and consider the n+1st: this is sn+1=1+1sn=1+1Fn+1Fn =1+FnFn+1=Fn+1+FnFn+1=Fn+2Fn+1

The more important thing we notice is that looking at the magnitude of the terms, it is neither increasing or decreasing, but it appears the sequence is zig-zagging up and down. Its straightforward to prove this is actually the case:

Example 9.4 If n is odd, then sn<sn+1. If n is even, sn>sn+1.

Proof. Again, we proceed by induction: we prove only the first case, and leave the second as an exercise. Note first s1=1, s2=2 and s3=32 so s1<s2 and s2>s3: the base case of each is true.

Now, assume that n is odd, and sn<sn+1. Computing from here sn<sn+11sn>1sn+11+1sn>1+1sn+1

The last line of this computation is the definition of sn+1>sn+2,so we see the next one is decreasing as claimed. And applying the recurrence once more:

sn+1>sn+21sn+1<1sn+21+1sn+1<1+1sn+2 Where now the last line of the calculation is the definition of sn+2<sn+3, fininshing our induction step!

While the overall sequence isn’t monotone, it seems to be built of two different monotone sequences, interleaved with one another! In particular the odd subsequence s1,s3,s5, is monotone increasing, and the even subsequence s2,s4,s6, is monotone decreasing.

To study these subsequences separately, we first need to find a recurrence relation that gives us sn+2 in terms of sn: applying this to either s1 or s2 will then produce the entire even or odd subsequence.

sn+2=1+1sn+1=1+11+1sn

Example 9.5 The subsequence s1,s3,s5,s7, is monotone increasing.

Proof. We prove this by induction. Starting from s1=1, we compute s3=1+11+11=1+12=32 So s1<s3, completing the base case. Next, assume for induction that sn+2>sn. We wish to show that sn+4>sn+2. Calculating from our assumption:

sn+2>sn1sn+2<1sn1+1sn+2<1+1sn11+1sn+2>11+1sn1+11+1sn+2>1+11+1snsn+4>sn+2

This completes the induction step, so the subsequence of odd terms is monotone increasing as claimed!

A nearly identical argument applies to the even subsequence:

Exercise 9.1 The subsequence s2,s4,s6,s8, is monotone decreasing.

Exercise 9.2 Let f(x)=1+1x. Show that if x<y then f(x)>f(y); that is, f reverses the ordering of numbers. Use this to give a more streamlined proof that the even and odd subsequences are both monotone, but the overall sequence zigzags.

Now that we know each sequene is monotone, we are in a position similar to the previous chapter where we played two sequences off one another to learn about e. The same trick works to show they are bounded.

Example 9.6 The odd subsequence of sn is bounded above, and the even subsequence is bounded below.

Proof. The even subsequece is monotone decreasing, but consists completely of positive terms. Thus, its bounded below by zero. Now we turn our attention to the odd subsequence: if n is odd, we know that sn is bounded above by sn+1, but sn+1 is a member of the monotone decreasing even subsequence, so sn+1<s2=2. Thus, for all odd n, sn is bounded above by 2.

Now we know by monotone convergence that both the even and odd subsequences converge! Next, we show they converge to the same value:

Example 9.7 Both the even and odd subsequences converge to the same value.

Proof. Let en=s2n be the even subsequence and on=s2n1 the odd subsequence, and write limen=E and limon=Θ. We wish to show E=Θ.

Using the recurrence relation we see on+1=1+1enen=1+1on and so, using the limit laws and the convergence of en,on Θ=1+1EE=1+1Θ Therefore we see ΘE=1E1Θ, which after getting a common denominator implies ΘE=ΘEΘE So whatever number ΘE is, it has the property that it is unchanged when divided by the number ΘE. But the only number unchanged by multiplication and division is zero! Thus ΘE=0

Now we know that not only the even and odd subsequences converge but that they converge to the same limit! Its not too much more work to show that the entire sequence converges.

Example 9.8 The sequence sn converges.

Proof. Call the common limit of the even and odd subsequences L. Let ε>0 Since s2n1L we know there is an N1 with n>N1 implying |s2n1L|<ε. Similarly since s2nL we can find an N2 where n>N2 implies |s2nL|<ε.

Set N=max{N1,N2}. Then if n>N we see both the even and odd subsequences are within ε of L by construction, and thus all terms of the sequence are within ε of L. But this is the definition of convergence! Thus sn is convergent and limsn=L.

Finally! Starting with a zigzag sequence where monotone convergene did not apply, we broke it into two subsequences, each of which were monotone, and each of which we could prove converge. Then we showed these subsequences have the same limit and hence the overall sequence converges. We made it! Now its quick work to confirm the limit is what we expected from our construction: the golden ratio.

Example 9.9 The sequence sn converges to the golden ratio.

Proof. Since throwing away the first term of the sequence does not change the limit, we see limsn+1=limsn=L. Using the recurrence relation and the limit laws, this implies limsn+1=lim1+1sn=1+1L

THus, the limit L satisfies the equation L=1+1/L or L2=L+1. This has two solutions 1±52 Only one of which is positive. Thus this must be the limit 1+11+11+11+11+11+11+11+11+=1+52s

We can apply this same process to discover another sequence of rational approximations to 2, by algebraic means (in contrast wtih the geometric approach of the babylonians). To start, we need to find a recursive formula that is satisfied by 2, and involves a reciprocal: something like

2=Rational stuff+1Rational stuff and 2

We can get such a formula through some trickery: first, using the difference of squares a2b2=(a+b)(ab) we see that 1=21=(2+1)(21), which can be re-written

21=11+2 Now, substitute this into the obvious 2=1+21 to get

2=1+11+2

This is a self-referential equation, meaning 2 appears on both sides.

Example 9.10 (Continued Fraction of 2) The continued fraction 1+12+12+12+12+12+ converges to the square root of 2.

9.2 Subsequences and Convergence

Hopefully this exploration into continued fractions has shown the usefulness of looking for easy-to-work-with subsequences, when theorems such as monotone convergence don’t automatically apply. It is then our goal to try and piece this information back together: if we know the limits of various subsequences, what can we say about the entire sequence?

A direct generalization of the even/odd case from our example above shows that if sn can separated into two subsequences which we can (separately) prove have the same limit, then the entire sequence converges to that

Proposition 9.1 (Union of Two Subsequences) If sn is the union of two subsequences snk and sn which both converge to the same limit, then sn converges to that limit.

Proof. Let L be the common limit of snk and sn, and fix and ε>0. Then there is an N1 such that for all k>N1 we are assured that |snkL|<ε and there is an N2 such that for all >N2 we know |snL|<ε. Choosing any particular kN1 and N2 we set N=maxnk,n.

Now choose arbitrary n>N. The term sn is a a member of one of our two subsequences, but by design if n=nk then k>N1 and if n=n then >N2, so we know |snL|<ε, and our sequence converges as claimed.

Theorem 9.1 Let sn be a sequence, and assume that sn is the union of N subsequences, all of which converge to the same limit L. Then sn is convergent, with limit L.

Proof (Sketch). One can prove this directly, but choosing useful notation is tedious. The idea is as follows: for each of the N sequences, let M1,M2,MN be the threshold beyond which the subsequence is within ε of L for some fixed ε>0. Then set M=max{M1,,MN} and note that for all n>M each of the subsequences is within ε of L. Because the entire sequence is just the union of these N subsequences, this means that every term of the sequence is within ε of L. But this is precisely the definition of snL. So we are done.

However, a simple example shows its not enough to simply say a sequence is a union of convergent subsequences: we do have to know they all have the same limit!

Example 9.11 The sequence sn=(1)n diverges, but its even and odd subsequences form constant (thus convergent) subsequences: s2n=(1)2n=1,1,1,s2n+1=(1)2n1=1,1,1,

Or, more generally

Exercise 9.3 Prove that if a sequence sn has two subsequences which converge to different values, then the overall sequence diverges. Rephrasing this positively gives a useful criterion: If sn is a convergent sequence, then all of its subsequences converge, and have the same limit.

Remark 9.1. This can be turned into a useful technique to prove two sequences an,bn have the same limit: interleave their terms a1,b1,a2,b2,a3,b3, and try to prove the resulting sequence converges. If it does, then we know all subsequences have the same limit, and so both an and bn converge to L.

9.3 Bolzano-Weierstrass

What about sequences that don’t converge? The theorem above says that it cannot be true that all their subsequences converge, but does show that a divergent sequence can still contain convergent subsequences. A natural question then is - do they always? Alas, a simple counterexample shows us that is too much to ask:

Example 9.12 The sequence sn=n2 diverges, and all subsequences of it diverge.

But the problem here is not serious, its simply that the original sequence is unbounded and cannot possibly contain anything that converges. The perhaps surprising fact that this is the only constraint preventing the existence of a convergent subsequence is known as the Bolzano Weierstrass theorem.

Theorem 9.2 (Bolzano-Weierstrass) Every bounded sequence has a convergent subsequence

There are many ways to prove this, but a particularly elegant one uses (of course!) the monotone convergence theorem.

At first this sounds suspicious: we must confront head on the issue we ran into above, that not every sequence is monotone! However, the weaker property we actually need is true: while not every sequence is monotone, every sequence contains a monotone subsequence. There is a very clever argument for this, which needs one new definition.

Definition 9.2 (Peak of a Sequence) Let sn be a sequence and NN. Then sN is a peak if it is larger than all following terms of the sequence: sNsmm>N

Theorem 9.3 (Monotone Subsequences) Every sequence contains a monotone subsequence

Proof. Let sn be an arbitrary sequence. Then there are two options: either sn contains infinitely many peaks or it does not.

If sn contains infinitely many peaks, we can build the subsequence of all peaks. This is monotone decreasing: if p1 is the first peak, then its greater than or equal to all subsequent terms sn, and so its greater than or equal to the second peak p2. (But, nothing here is special about 1 and 2, this holds for the nth and n+1st peak without change).

Otherwise, if sn contains only finitely many peaks, we will construct a monotone increasing subsequence as follows. Since there are finitely many peaks there must be a last peak, say this occurs at position N. Then sN+1 is not a peak, and we will take this as the first term of our new sequence (let’s call it q1). Because its not a peak, by definition there is some term farther down the sequence which is larger than sN+1 - say this happens at index N2 and call it q2. But q2 is also not a peak (as there were only finitely many, and we are past all of them), so there’s a term even farther down - say at index N3 which is larger: call it q3. Now we have q1<q2<q3, and we can continue this procedure inductively to build a monotone increasing subsequence for all n.

Now, given that every sequence has a monotone subsequence, we know that every bounded sequence has a monotone and bounded subsequence. Such things converge by MCT, so we know every sequence has a convergent subsequence! This is the Bolzano Weierstrass Theorem.

We will use this often in whats to come to produce examples of convergent subsequences where it might otherwise be difficult to do so. Here’s a first example of such an argument

Proposition 9.2 (Analyzing All Convergent Subsequences) If sn is a bounded sequence such that every convergent subsequence converges to the same value, then sn converges.

Proof. Assume that every convergent (proper) subsequence of sn converges to L, but that sn itself does not. Then fixing some ε>0 for each n=1,2,3, we can find an k such that |snkL|>ε. This is an infinite sequence of terms all of which are farther than ε from L, and is bounded as sn itself was bounded. Thus, by the Bolzano Weierstrass theorem there is a subsequence of this that converges. Its limit cannot be L because all terms in the sequence are more than ε away from L, so we’ve found a subsequence of the original sequence that converges to a different value, contradicting the original assumption.

In addition to applications like the above, in time will come to appreciate it as one of the most elegant tools available to us. There will come many times (soon, when dealing with functions) where we can easily produce a sequence of points satisfying some property, but to make progress we need a convergent sequence of such points. The BW theorem assures us that we don’t have to worry - we can always make one by just throwing out some terms, so long as the sequence we have is bounded.

9.4 Limsup and Liminf

When a sequence doesn’t converge, it can have various subsequences that converge to different limits. One way to reign in the complexity of such things is via the concepts of limit supremum and limit infimum.

Definition 9.3 (Limsup and Liminf) Let sn be a bounded sequence, and for each NN define uN=supnN{sn}. Then we define the limit superior of sn as lim supsn:=limuN=limNsupnN{sn} Similarly, with N=infnN{sn} we define the limit inferior of sn to be lim infsn:=limN=limNinfnN{sn}

We will have occasional use for this definition during the course, mostly because of the following: that the limsup and liminf exist for all (bounded) sequences, not just convergent ones.

Proposition 9.3 (Existence of Limsup, Liminf) Let sn be a bounded sequence. Prove that lim supsn and lim infsn both exist

Proof. We verify for the limsup case, and leave the analgoous liminf as an exercise. For each N let uN=supnN{sn} and notice that uN is a monotone decreasing sequence as we are taking the supremum over smaller and smaller sets (). Its easy to construct a lower bound for uN: since sn is bounded we may take any lower bound L and note for any N this is a lower bound for the tail {snn>N}. As the supremum is an upper bound and all lower bounds are all upper bounds we see Lsupn>N{sn}=uN. Thus uN is a monotone decreasing sequence that is bounded below, which converges by the Monotone Convergence Theorem.

One use of these quantities is to bound the possible values of subsequential limits:

Exercise 9.4 (Bounding Subsequential Limits) Let sn be any bounded sequence and snk a convergent subsequence with limit L. Then lim infsnLlim supsn

Proposition 9.4 A sequence sn converges if and only if lim supsn=lim infsn

Proof. For any N we have N=infnNsnsNsupnNsn=uN. But limN=lim infsn=lim supsn=limuN by assumption, so the squeeze theorem () implies sN also converges, and has the same limit.

It is often useful to broaden our use of lim sup and lim inf to the extended reals R{±}. Here its true that every sequence has a limsup and liminf: either the sequence is bounded and they exist as proven above, or the sequence is unbounded with lim sup,lim inf=±. This slight generalization makes certain theorems easier to state, as one can use lim sup and lim inf without first checking they exist.

Exercise 9.5 (Subsequences & Limsup, Liminf) Let sn be a bounded sequence. Then there exists a subsequence which converges to the limsup and a subsequence which converges to the liminf.

9.5 Problems

Exercise 9.6 For any fixed n, prove that the following continued fraction exists, and find its vallue. 1n+1n+1n+1n+1n+1n+1n+1n+

Exercise 9.7 (Continued Fractions for Roots) Let p be any prime number, find the continued fraction for p.

Knowing such sequences is extremely useful for computation, in the age before computers: if n is a composite number we can find n by multiplying together the square roots of its prime factorization

Exercise 9.8 Find a rational approximation to 6 by calculating the first three terms in the continued fraction expansions for 2 and 3.

We could also find a continued fraction directly for cases like this, with a little more care:

Exercise 9.9 Find the continued fraction expansion for pq if p and q are primes. What happens to your procedure when p=q?

9.5.1 Limsup and Liminf

Exercise 9.10 Let an,bn be bounded sequences. Prove that lim sup(an+bn)lim supan+lim supbn lim infan+lim infbnlim inf(an+bn)

Provide counterexamples to show that equality does not always hold.

Exercise 9.11 Let an be convergent and bn be an arbitrary bounded sequence. Show that

lim sup(an+bn)=liman+lim supbn lim inf(an+bn)=liman+lim infbn

Exercise 9.12 Let an be convergent and bn be an arbitrary bounded sequence. Show that

lim sup(anbn)=(liman)(lim supbn) lim inf(anbn)=(liman)(lim infbn)

9.5.2 An Alternative Proof of Bolzano-Weierstrass

An alternative argument for the BW theorem proceeds via the nested interval property. Here’s an outline of how this works

  • If sn is bounded then there is some a,b with asnb for all n. Call this interval I0, and inductively build a sequence of nested closed intervals as follows
  • At each stage Ik=[ak,bk], bisect the interval with the midpoint mk=ak+bk2. This divides Ik into two sub-intervals, and since Ik contains infinitely many points of the sequence, one of these two halves must still contain infinitely many points. Choose this as the interval Ik+1.
  • Now, this sequence of nested intervals has nonempty intersection by the Nested Interval Property. So, let LR be a point in the intersection.
  • Now, we just need to build a subsequence of sn which converges to L. We build it inductively as follows: let the first term be s1, and then for each k choose some point snkIk that is distinct from all previously chosen points (we can do this because there are infinitely many points available in Ik and we have only used finitely many so far in our subsequence).
  • This new sequence is trapped between ak and bk, which both converge to L. Thus it converges by the squeeze theorem!

Exercise 9.13 In this problem, you are to check the main steps of this proof to ensure it works. Namely, given the above situation prove that

  • If Ik=[ak,bk], the sequences ak and bk of endpoints converge. Hint: Monotone Convergence
  • limak=limbk, so the Squeeze theorem really does apply *Hint: use that at each stage we are bisecting the intervals: can you find a formula for the sequence bkak, and prove this converges to zero?

Exercise 9.14 (Simultaneous Bolzano Weierstrass) Given two bounded sequences xn,yn there is a subsequence nk of indices such that both xnk and ynk converge. Prove this, and then use induction to prove that for any finite number of bounded sequences, one can choose a subsequence of indices so they all converge.