A method to sort 'Jonagold' apples based on the presence of defects was proposed. A multi-spectral vision system including four wavelength bands in the visible/NIR range was developed. Multi-spectral images of sound and defective fruits were acquired tending to cover the whole colour variability of this bicolour apple variety. Defects were grouped into four categories: slight defects, more serious defects, defects leading to the rejection of the fruit and recent bruises. Stem-ends/calyxes were detected using a correlation pattern matching algorithm. The efficiency of this method depended on the orientation of the stem-end/calyx according to the optical axis of the camera. Defect segmentation consisted in a pixel classification procedure based on the Bayes' theorem and non-parametric models of the sound and defective tissue. Fruit classification tests were performed in order to evaluate the efficiency of the proposed method. No error was made on rejected fruits and high classification rates were reached for apples presenting serious defects and recent bruises. Fruits with slight defects presented a more important misclassification rate but those errors fitted however the quality tolerances of the European standard. Considering an actual ratio of sound fruits of 90%, less than 2% of defective fruits were classified into the sound ones. (c) 2004 Elsevier Ltd. All rights reserved.