4.4 Analysis of Skiplists

In this section, we analyze the expected height, size, and length of the search path in a skiplist. This section requires a background in basic probability. Several proofs are based on the following basic observation about coin tosses.

Lemma 4..2   Let $T$ be the number of times a fair coin is tossed up to and including the first time the coin comes up heads. Then $\mathrm{E}[T]=2$.

Proof. Suppose we stop tossing the coin the first time it comes up heads. Define the indicator variable

$$I_{i} = \left\{\begin{array}{ll} 0 & \mbox{if the coin is tossed... ...\\ 1 & \mbox{if the coin is tossed $i$\ or more times} \end{array}\right.$$

Note that $I_i=1$ if and only if the first $i-1$ coin tosses are tails, so $\mathrm{E}[I_i]=\Pr\{I_i=1\}=1/2^{i-1}$. Observe that $T$, the total number of coin tosses, can be written as $T=\sum_{i=1}^{\infty} I_i$. Therefore,

$$\mathrm{E}[T] = \mathrm{E}\left[\sum_{i=1}^\infty I_i\right]$$

$$= \sum_{i=1}^\infty \mathrm{E}\left[I_i\right]$$

$$= \sum_{i=1}^\infty 1/2^{i-1}$$

$$= 1 + 1/2 + 1/4 + 1/8 + \cdots$$

$$= 2 \enspace . \qedhere$$

$\qedsymbol$

The next two lemmata tell us that skiplists have linear size:

Lemma 4..3   The expected number of nodes in a skiplist containing $\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}$ elements, not including occurrences of the sentinel, is $2\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}$.

Proof. The probability that any particular element, $\ensuremath{\ensuremath{\mathit{x}}}$, is included in list $L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$ is $1/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$, so the expected number of nodes in $L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$ is $\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$.^4.2 Therefore, the total expected number of nodes in all lists is

$$\sum_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}=0}^\infty... ...dots) = 2\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} \enspace . \qedhere$$

$\qedsymbol$

Lemma 4..4   The expected height of a skiplist containing $\ensuremath{\ensuremath{\mathit{n}}}$ elements is at most $\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + 2$.

Proof. For each $\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}\in\{1,2,3,\ldots,\infty\}$, define the indicator random variable

$$I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}} = \left\{\b... ...th{\ensuremath{\ensuremath{\mathit{r}}}}}$\ is non-empty} \end{array}\right.$$

The height, $\ensuremath{\ensuremath{\mathit{h}}}$, of the skiplist is then given by

$$\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}} = \sum_{i=1}^\infty I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}} \enspace .$$

Note that $I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$ is never more than the length, $\vert L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}\vert$, of $L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$, so

$$\mathrm{E}[I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]... ...mathit{n}}}}/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}} \enspace .$$

Therefore, we have

$$\mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}] = \mathrm{E}\left[\sum_{r=1}^\infty I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}\right]$$

$$= \sum_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}=1}^{\infty} E[I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]$$

$$= \sum_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}=1}^{\lf... ...}}}\rfloor+1}^{\infty} E[I_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]$$

$$\le \sum_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}=1}^{\... ...\ensuremath{\mathit{n}}}}/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$$

$$\le \log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + \sum... ...\mathit{r}}}}=0}^\infty 1/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$$

$$= \log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + 2 \enspace . \qedhere$$

$\qedsymbol$

Lemma 4..5   The expected number of nodes in a skiplist containing $\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}$ elements, including all occurrences of the sentinel, is $2\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}+O(\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}})$.

Proof. By Lemma 4.3, the expected number of nodes, not including the sentinel, is $2\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}$. The number of occurrences of the sentinel is equal to the height, $\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}$, of the skiplist so, by Lemma 4.4 the expected number of occurrences of the sentinel is at most $\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}+2 = O(\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}})$. $\qedsymbol$

Lemma 4..6   The expected length of a search path in a skiplist is at most $2\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + O(1)$.

Proof. The easiest way to see this is to consider the reverse search path for a node, $\ensuremath{\ensuremath{\mathit{x}}}$. This path starts at the predecessor of $\ensuremath{\ensuremath{\mathit{x}}}$ in $L_0$. At any point in time, if the path can go up a level, then it does. If it cannot go up a level then it goes left. Thinking about this for a few moments will convince us that the reverse search path for $\ensuremath{\ensuremath{\mathit{x}}}$ is identical to the search path for $\ensuremath{\ensuremath{\mathit{x}}}$, except that it is reversed.

The number of nodes that the reverse search path visits at a particular level, $\ensuremath{\ensuremath{\mathit{r}}}$, is related to the following experiment: Toss a coin. If the coin comes up as heads, then move up and stop. Otherwise, move left and repeat the experiment. The number of coin tosses before the heads represents the number of steps to the left that a reverse search path takes at a particular level.^4.3 Lemma 4.2 tells us that the expected number of coin tosses before the first heads is 1.

Let $S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$ denote the number of steps the forward search path takes at level $\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}$ that go to the right. We have just argued that $\mathrm{E}[S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]\le 1$. Furthermore, $S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}\le \vert L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}\vert$, since we can't take more steps in $L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$ than the length of $L_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$, so

$$\mathrm{E}[S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]... ...mathit{n}}}}/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}} \enspace .$$

We can now finish as in the proof of Lemma 4.4. Let $S$ be the length of the search path for some node, $\ensuremath{\ensuremath{\mathit{u}}}$, in a skiplist, and let $\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}$ be the height of the skiplist. Then

$$\mathrm{E}[S] = \mathrm{E}\left[ \ensuremath{\ensuremath{\ensuremath{\mathit{h}... ...t{r}}}}=0}^\infty S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}} \right]$$

$$= \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}] +... ...}}}=0}^\infty \mathrm{E}[S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]$$

$$= \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}] +... ...oor+1}^\infty \mathrm{E}[S_{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}]$$

$$\le \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}]... ...\ensuremath{\mathit{n}}}}/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$$

$$\le \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}]... ...athit{r}}}}=0}^{\infty} 1/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$$

$$\le \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}]... ...athit{r}}}}=0}^{\infty} 1/2^{\ensuremath{\ensuremath{\ensuremath{\mathit{r}}}}}$$

$$\le \mathrm{E}[\ensuremath{\ensuremath{\ensuremath{\mathit{h}}}}] + \log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + 3$$

$$\le 2\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + 5 \enspace . \qedhere$$

$\qedsymbol$

The following theorem summarizes the results in this section:

Theorem 4..3   A skiplist containing $\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}}$ elements has expected size $O(\ensuremath{\ensuremath{\ensuremath{\mathit{n}}}})$ and the expected length of the search path for any particular element is at most $2\log \ensuremath{\ensuremath{\ensuremath{\mathit{n}}}} + O(1)$.

Footnotes

....^4.2

See Section 1.3.4 to see how this is derived using indicator variables and linearity of expectation.

... level.^4.3

Note that this might overcount the number of steps to the left, since the experiment should end either at the first heads or when the search path reaches the sentinel, whichever comes first. This is not a problem since the lemma is only stating an upper bound.