Vidal's libraryTitle: | Information markets vs. opinion pools: An empirical comparison |
Author: | Yiling Chen, Tracy Mullen, Chao-Hsien Chu, and David M. Pennock |
Book Tittle: | Proceedings of the ACM Conference on Electronic Commerce |
Year: | 2005 |
Abstract: | In this paper, we examine the relative forecast accuracy of information markets versus expert aggregation. We leverage a unique data source of almost 2000 people's subjective probability judgments on 2003 US National Football League games and compare with the “market probabilities” given by two different information markets on exactly the same events. We combine assessments of multiple experts via linear and logarithmic aggregation functions to form pooled predictions. Prices in information markets are used to derive market predictions. Our results show that, at the same time point ahead of the game, information markets provide as accurate predictions as pooled expert assessments. In screening pooled expert predictions, we find that arithmetic average is a robust and efficient pooling function; weighting expert assessments according to their past performance does not improve accuracy of pooled predictions; and logarithmic aggregation functions offer bolder predictions than linear aggregation functions. The results provide insights into the predictive performance of information markets, and the relative merits of selecting among various opinion pooling methods. |
Cited by 2 - Google Scholar
@InProceedings{chen05a,
author = {Yiling Chen and Tracy Mullen and Chao-Hsien Chu and
David M. Pennock},
title = {Information markets vs. opinion pools: An empirical
comparison},
booktitle = {Proceedings of the {ACM} Conference on Electronic
Commerce},
year = 2005,
abstract = {In this paper, we examine the relative forecast
accuracy of information markets versus expert
aggregation. We leverage a unique data source of
almost 2000 people's subjective probability
judgments on 2003 US National Football League games
and compare with the ``market probabilities'' given
by two different information markets on exactly the
same events. We combine assessments of multiple
experts via linear and logarithmic aggregation
functions to form pooled predictions. Prices in
information markets are used to derive market
predictions. Our results show that, at the same time
point ahead of the game, information markets provide
as accurate predictions as pooled expert
assessments. In screening pooled expert predictions,
we find that arithmetic average is a robust and
efficient pooling function; weighting expert
assessments according to their past performance does
not improve accuracy of pooled predictions; and
logarithmic aggregation functions offer bolder
predictions than linear aggregation functions. The
results provide insights into the predictive
performance of information markets, and the relative
merits of selecting among various opinion pooling
methods.},
url = {http://jmvidal.cse.sc.edu/library/chen05a.pdf},
cluster = {16177829967646216575}
}
Last modified: Wed Mar 9 10:16:30 EST 2011