Does the abundance of data facilitate the end of theory?
The idea of "data without theory" (my phrasing) is put forward by Chris Anderson in The End of Theory: The Data Deluge Makes the Scientific Method Obsolete.
Some quotes:
Google's founding philosophy is that we don't know why this page is better than that one: If the statistics of incoming links say it is, that's good enough. No semantic or causal analysis is required. That's why Google can translate languages without actually "knowing" them (given equal corpus data, Google can translate Klingon into Farsi as easily as it can translate French into German).
But faced with massive data, this approach to science — hypothesize, model, test — is becoming obsolete
There is now a better way. Petabytes allow us to say: "Correlation is enough." We can stop looking for models. We can analyze the data without hypotheses about what it might show. We can throw the numbers into the biggest computing clusters the world has ever seen and let statistical algorithms find patterns where science cannot.
The new availability of huge amounts of data, along with the statistical tools to crunch these numbers, offers a whole new way of understanding the world. Correlation supersedes causation, and science can advance even without coherent models, unified theories, or really any mechanistic explanation at all.
W.r.t. Google cf. Kaplan's notion of linguistic capitalism: Kaplan, “Linguistic Capitalism and Algorithmic Mediation”, Representations 27 (2014), pp. 57–63.
Kevin Kelly objected that, behind every automated understanding of a set of facts, there lies a hidden theory, whether there is awareness of it or not, and, in the latter case, it is a theory awaiting formulation. What this means for us, if not for Kelly himself, is that behind and beyond all fact, there is a law. Stiegler-Automatic_Society_1_introduction.md:13
Kelly reference: Kevin Kelly, “On Chris Anderson’s The End of Theory”, Edge: The Reality Club (30 June 2008), available at: http://edge.org/discourse/the_end_of_theory.html#kelly.
See http://edge.org/discourse/the_end_of_theory.html for more responses.