Experience: Extreme Selection Bias

One of the common critiques of statistical surveys is to assert there was selection bias in choosing the sample and to suggest that the sample is inappropriate for the population. While this is a very real criticism, it is typically
asserted by folks who rely on "experience" and qualitative information
to make their decisions. Considering that experience is not random, and that humans are severely afflicted with affect and availability heuristics, it is useful to consider someone's experience as an extreme form of selection bias.