Twitter

Monday, July 21, 2008

The Black Swan

"The Black Swan" is a best-seller by Nassim Nicholas Taleb, the author of another bigger best-seller "Fooled by Randomness." Both books received more than 300 reviews on Amazon.com. I flipped through the second book in the bookstore and thought it was an interesting book, especially for teaching statistics to curious and skeptical undergraduate students.

Today, I stumbled over a special issue in The American Statistician (August 2007) designated to the praises and criticisms (mainly the latter) of "The Black Swan." The reason for such strong reaction from the usually low-key statistical profession is pretty obvious from a small number of excerpts quoted in TAS:

“Statisticians . . . are computing people, not thinkers.”

“Statisticians, it has been shown, tend to leave their brains in the classroom, and engage in the most trivial inferential errors when they are let out on the streets.”

It is worth mentioning that this special issue even caught the attention of the Bloomberg news and the editor of TAS was interviewed for a news coverage of this book.

TAS also invited Taleb to write a response in this special issue. In this response, Taleb said the main criticism for statistics in his book is for

1. The unrigorous use of statistics, and reliance on probability in domains where the current methods can lead us to make consequential mistakes (the “high impact”)where, on logical grounds, we need to force ourselves to be suspicious of inference about low probabilities.

2. The psychological effects of statistical numbers in lowering risk consciousness and the suspension of healthy skepticism—in spite of the unreliability of the numbers
produced about low-probability events.

3. Finally TBS is critical of the use of commoditized metrics such as “standard deviation,” “Sharpe ratio,” “mean-variance,”and so on in fat-tailed domains where these terms have little practical meaning, and where reliance by the untrained has
been significant, unchecked and, alas, consequential.

This is essentially about cautions on prediction (extrapolation) based on models, effects of outliers and rare events, and uses of statistics that are motivated by specific probability models. I don't think any good applied statistican will deny the importance of cautionary interpretation of statistical analysis and will not "commit" the mistakes outlined above. Actually, sometimes I feel the conclusion that can be made from data analysis is very limited. The usefulness of statistical inference and analysis lies primarily in narrowing down hypotheses and possbilities.

11 comments:

Yihui Xie said...

Here is a joke by Robert Hacker:

What's the difference between a physicist, a mathematician, and a statistician?

The physicist calculates until he gets a correct result and concludes that he has proven a fact.

The mathematician calculates until he gets a wrong result and concludes that he has proven the contrary of a fact.

The statistician calculates until he gets a correct result about an obviously wrong proposition and concludes NOTHING, because the explanation is the task of the scientist who consulted the statistician.

alizybeth said...

This blog is to help inform the public on the truth and medical benefits of cannabis. It also contains info to help teach others the healthiest and safest way to grow or acquire their medicine, Cannabis oil

Anonymous said...

I find this article useful. Kindly share more such articles so that I can get better insight. Statistical Analysis Services

Statswork said...

It is really look so amazing and show your efforts that you spend to make this article but I truly excited to read out this instruction. I appreciate you for post this amazing artwork with us but I enjoyed much to get some best tips. Statistical Data Analysis Services

john said...

your website is awesome good luck guys.
دانلود آهنگ جدید

sara said...

Nice . how can i contact with you ?
آهنگ

Unknown said...


This content is really unique and amazing. This is really helpful and explained very well. So I am really thankful to you for sharing keep it up..
Online Company Registration

contentrist.blog said...

It is really look so amazing and show your efforts that you spend to make this article but I truly excited to read out this instruction. I appreciate you for post this amazing artwork with us but I enjoyed much to get some best tips. Dark Humor Jokes

Health Yell said...

Thank you for sharing good knowledge and information it's very helpful and understanding.. as we are looking for this information for a long time.
you can also visit our blog: what does pr mean in gym

Unknown said...

Excellent read, Positive site, where did u come up with the information on this posting? I have read a few of the articles on your website now, and I really like your style. Thanks a million and please keep up the effective work.
you can also visit our blog: could not communicate with your chromecast

Blogs samples said...

harga ssl certificate