Journal of Statistical Planning and Inference 107 (2002) 237 – 247 www.elsevier.com/locate/jspi The bias of linear rank tests when testing for stochastic order in ordered categorical data Vance W. Berger a ; * , Anastasia Ivanova b a Biometry Research Group, DCP, National Cancer Institute, Executive Plaza North, Suite 3131, 6130 Executive Blvd., MSC 7354, Bethesda, MD 20892-7354, USA b Department of Biostatistics, School of Public Health, CB 7420, 3103C McGavran-Greenberg Hall, University of North Carolina at Chapel Hill, NC 27599-7420, USA Abstract In many hypothesis testing problems, the alternative hypothesis is characterized by one or sev- eral restrictions arising from a natural ordering among the outcome levels. It is known that tests which ignore the ordering may lack adequate statistical power for the alternatives which are of the most interest. Considerably less, however, is known about developing tests which conform to a natural ordering. Stochastic order is an objective and compelling characterization of the superiority of one treatment over another. Consequently, testing for stochastic order is of con- siderable importance in applications involving the comparison of one treatment to another on the basis of ordered categorical data (e.g., in clinical trials). With few exceptions (that we identify), there is no optimal test for this problem, so it is reasonable to consider the class of tests that are simultaneously unbiased and admissible. There are known necessary and sucient conditions for admissibility, but unbiasedness is more elusive. It is known that a necessary condition for unbiasedness is exactness conditionally on the margins. Further, one can construct a test which is both admissible and unbiased by repeatedly improving the trivially unbiased “ignore-the-data” test. This complicated approach, however, does not, in general, lead to a nested family of tests. We provide a new necessary condition for unbiasedness, and show that linear rank tests, which are widely used and locally most powerful, fail this condition for certain sets of margins. For such margins, linear rank tests are severely biased (with power as low as zero to detect certain alternatives of interest) and least stringent. Published by Elsevier Science B.V. Keywords: Contingency table; Envelope power function; Exact conditional test; Linear rank test 1. Introduction In many hypothesis testing problems, the alternative hypothesis is characterized by one or several restrictions arising from a natural ordering among the outcome levels. It * Corresponding author. Tel.: +1-301-435-5303; fax: +1-301-402-0816. E-mail address: vb78c@nih.gov (V.W. Berger). 0378-3758/02/$ - see front matter Published by Elsevier Science B.V. PII:S0378-3758(02)00255-0