Entropy-Based Bounds for Online Algorithms Gopal Pandurangan ∗ Eli Upfal † Abstract We focus in this work on an aspect of online computation that is not addressed by the stan- dard competitive analysis. Namely, identifying request sequences for which non-trivial online algorithms are useful versus request sequences for which all algorithms perform equally bad. The motivation for this work are advanced system and architecture designs which allow the operating system to dynamically allocate resources to online protocols such as prefetching and caching. To utilize these features the operating system needs to identify data streams that can benefit from more resources. Our approach in this work is based on the relation between entropy, compression and gam- bling, extensively studied in information theory. It has been shown that in some settings entropy can either fully or at least partially characterize the expected outcome of an iterative gambling game. Our goal is to study the extent to which the entropy of the input characterizes the ex- pected performance of online algorithms for problems that arise in computer applications. We study bounds based on entropy for three classical online problems — list accessing, prefetching, and caching. Our bounds relate the performance of the best online algorithm to the entropy, a parameter intrinsic to the characteristics of the request sequence. This is in contrast to the competitive ratio parameter of competitive analysis which quantifies the performance of the on- line algorithm with respect to an optimal offline algorithm. For the prefetching problem, we give explicit upper and lower bounds for the performance of the best prefetching algorithm in terms of the entropy of the request sequence. In contrast, we show that the entropy of the re- quest sequence alone does not fully capture the performance of online list accessing and caching algorithms. Keywords: Online Algorithms, Performance Bounds, Entropy, Stochastic Process, Prefetching, Caching, List Accessing. * Department of Computer Science, Purdue University, West Lafayette, IN 47907-2066, USA. E-mail: gopal@cs.purdue.edu. Part of this work was done while the author was at Brown University. † Department of Computer Science, Brown University, Providence, RI 02912-1910, USA. E-mail: eli@cs.brown.edu. The authors were supported in part by NSF grant CCR-9731477. Preliminary versions of this paper appeared in the proceedings of the 12th annual ACM-SIAM Symposium on Discrete Algorithms (SODA), Washington D.C., 2001, and in the proceedings of the 38th Annual Conference on Information Sciences and Systems (CISS), Princeton University, NJ, 2004.