Randomization of CATA attributes: Should attribute lists be allocated to assessors or to samples?
For the check-all-that-apply (CATA) question format, it is good practice to vary the attribute list order between evaluations to account for possible (and likely) position bias in the data. If attribute lists are to be randomized, the question is how to allocate these attribute lists orders.