Posts tagged ‘data mining’
A Reality Check for Data Snooping (paper)
Do we really know what we think we know? White’s famous paper on his “Reality Check” procedure:
“Data Snooping occurs when a given set of data is used more than once for purposes of inference or model selection. When such data reuse occurs, there is always the possibility that any satisfactory results obtained may simply be due to chance rather than to any merit inherent in the method yielding the results. Our new procedure, the Reality Check, provides simple and straightforward procedures for testing the null that the best model encountered has no predictive superiority over a given benchmark model…”
Data Mining Bias: The Risk of Picking an Inferior Rule
A quick study on how to avoid every algo trader’s worst enemy (or at least one of them): the dreaded Data Mining Bias (click title for article).