An objective numerical method of assessing reliability of time intensity panellists
A measure of the reliability (T-IR) of time-intensity measurements was developed based on the concept of standard deviation as a measure of panellist variability. The T-IR measure was applied to time-intensity data collected from 10 panellists evaluating the sweetness of 4 model sweetener solutions on horizontal and vertical time-intensity line orientations.
T-IR scores showed that the panellists were similarly reliable across the sweeteners and orientations. As well, independent of scale orientation, responses to sweeteners were similarly reliable. The T-IR measure can be used to maintain a high level of performance by monitoring time-intensity panellists. T-IR also provides an objective method of selecting panellists for time-intensity panels.
Bloom, K., Duizer, L.M., & Findlay, C. J. (1995). An objective numerical method of assessing reliability of time intensity panellists. Journal of Sensory Studies, 10(3), 285-294. http://dx.doi.org/10.1111/j.1745-459X.1995.tb00020.x