We study the classification problem for high-dimensional data with n observations on p features where the pxp covariance matrix Sigma exhibits a spiked eigenvalues structure and the vector zeta, given by the difference between the whitened mean vectors, is sparse with sparsity at most s. We propose an adaptive classifier (adaptive with respect to the sparsity s) that first performs dimension reduction on the feature vectors prior to classification in the dimensionally reduced space, i.e., the classifier whitened the data, then screen the features by keeping only those corresponding to the s largest coordinates of zeta and finally apply Fisher linear discriminant on the selected features. Leveraging recent results on entrywise matrix perturbation bounds for covariance matrices, we show that the resulting classifier is Bayes optimal whenever n diverges to infinity and s/nxln p convergs to 0. Experimental results on real and synthetic data sets indicate that the proposed classifier is competitive with existing state-of-the-art methods while also selecting a smaller number of features.