Observation Cohorts: How Can We Avoid Mixing Rankings from Different Engines?
An observation cohort is a comparison unit that groups observations with the same question, engine and model, region, language, and device conditions. The same sentence can receive different answers when the model and market change. An average that removes these conditions may be easy to calculate, but it is hard to explain what changed.