Why are the results from panel and panelist performance different?
Although the panel performance and the panellist
performance seems to be linked, at least from an interpretation point of view
(one could expect that the panel is discriminating if panellists are
discriminated), the analyses involved different data (the panellist performance
is based on subset of data, while the panel performance uses all the data at
once). Hence, it can happen that assessors are not so well discriminating while
once combined, the overall results show good discrimination.
The panel and panelist performance do not rely
on the same statistical analysis. Panel performance is based on ANOVA, and the
agreement is based on the product:assessor interaction.The panelist performance is taking only the
panelist data, and the agreement at an individual level is based on the
correlation between that assessor scores and the average across panels.These 2 stats are completely different, have completely
different implications/assumptions, so cannot be compared one to one. Also, in some situations, the lack of
disagreement can be simply due to a different use of the scale, meaning that
the assessors are still “ranking” the samples in the same way, BUT are
emphasizing more or less certain differences.
Related Articles
Panelist Performance Analysis
Purpose This analysis looks at the overall panel performance in terms of Discrimination, Agreement and Repeatability or Reproducibility, and then the performance of each individual in the panel in these terms. Data Format See the profiling dataset. ...
Direct Feedback, Panelist Feedback on a scale, Panelist Feedback
Direct Feedback The direct feedback function provides the feedback live to panelists. The mean and sd need to be specified for each attribute for each product, so you need to know ahead of the mean and the standard deviation value. When panelists are ...
How to add panellists in panel database
The Panel Database in EyeQuestion is where you can access a comprehensive list of all panelists, complete with their information stored within the system. Access to this page is restricted to users with a Panelist Manager profile. Adding Panellists ...
Importing Panelists into a Specific Panel Group
Introduction In sensory science, a panel group refers to a specialized group of individuals who are trained to evaluate sensory attributes such as taste, smell, texture, appearance, and overall sensory experience of products or stimuli. You can learn ...
Same-Different
Introduction During a Same-Different test, each panellist is presented with two (equal or different) products or samples. The panellist must state whether the products are equal or different. This method is used to determine whether a sensory ...