Misleading Results From Widely-Used Machine-Learning Data Analysis Techniques

Long-time Slashdot reader kbahey writes: The increased reliance on machine-learning techniques used by thousands of scientists to analyze data, is producing results that are misleading and often completely wrong, according to the BBC.

Dr. Genevera Allen from Rice University in Houston said that the increased use of such systems was contributing to a 'crisis in science'.

She warned scientists that if they didn't improve their techniques they would be wasting both time and money. Her research was presented at the American Association for the Advancement of Science in Washington.

This is the oft-discussed 'reproducibility problem' in modern science.
The BBC writes that this irreproducibility happens when experiments 'aren't designed well enough to ensure that the scientists don't fool themselves and see what they want to see in the results.' But machine learning now has apparently become part of the problem.

Dr. Allen asks 'If we had an additional dataset would we see the same scientific discovery or principle...? Unfortunately the answer is often probably not.â

Read more of this story at Slashdot.