Why Can Averaging Ratios by Engine Be Wrong?
The principle for calculating an aggregate metric while preserving the numerator and denominator of each ratio. A simple average of ratios from engines with different answer counts gives the same weight to small and large samples. This can misrepresent the actual set of answers.

