“Deep learning is a bit like anything goes,” states the interviewer, encapsulating a sentiment echoed by Noam Chomsky, suggesting that while powerful, current AI models lack the fundamental theoretical underpinnings that define true scientific understanding. This provocative opening sets the stage for a compelling discussion with Chris Kempes, a professor at the Santa Fe Institute, who spoke with the interviewer about the pursuit of a universal theory of life and its profound implications for fields ranging from biology to artificial intelligence. Kempes, whose background spans physics, biophysics, ecology, and astrobiology, represents the interdisciplinary ethos of the Santa Fe Institute, an organization dedicated to tackling complex problems by integrating diverse academic perspectives.
Kempes and his colleagues at the Santa Fe Institute champion a "multi-disciplinary lens on science," advocating for the integration of three distinct scientific cultures: variance, exactitude, and coarse-grained abstraction. The variance culture, prevalent in biology, focuses on diversity and deviation. The exactitude culture, empowered by modern computational capabilities, aims for high-resolution modeling of every detail. Lastly, the coarse-grained abstract culture, akin to physics, seeks universal principles and simple equations. Historically, physics thrived through a "magic loop" of observation leading to theory, and theory leading to new, surprising predictions that were then tested by observation. This iterative process allowed for significant compression of knowledge into elegant, transmissible forms.
However, Kempes argues that fields like biology, economics, and intelligence—all grappling with immensely harder questions than planetary motion—have yet to fully leverage this "magic loop." The advent of "exactitude culture" in the age of AI, with its capacity to simulate complex systems down to minute details, presents a new challenge. While Galileo was *forced* to seek compressed mathematical representations due to computational limitations, today's scientists can model almost anything. This capability, while powerful, risks obscuring the underlying simple theories that might exist. Kempes's core insight is that each culture offers unique benefits and drawbacks, and true scientific progress requires "walking amongst the corners of that triangle" to synthesize knowledge.
