HealthFormer: A Generative Health World Model

The intricate dynamics of human health over time, and the profound variability in individual responses to interventions, present a persistent challenge in medicine. Addressing this requires a paradigm shift in how we model physiological trajectories. The HealthFormer AI model, detailed in recent arXiv findings, introduces a novel decoder-only transformer designed to generatively model these complex human physiological journeys.

Tokenizing the Human Physiological Trajectory

Trained on the extensive Human Phenotype Project dataset, encompassing over 15,000 deeply phenotyped individuals, HealthFormer processes multi-visit health data. Each participant's health trajectory is meticulously tokenized across 667 distinct measurements spanning seven critical domains: blood biomarkers, body composition, sleep physiology, continuous glucose monitoring, gut microbiome, wearable-derived physiology, and behavioral/medication exposure. This comprehensive tokenization forms the foundation for a unified generative objective.

Unlocking Predictive Power and Intervention Simulation

From this single generative framework, HealthFormer demonstrates remarkable versatility. Without requiring task-specific fine-tuning, the model exhibits strong transfer learning capabilities, successfully generalizing to four independent cohorts. It significantly enhances prediction accuracy for 27 out of 30 incident-disease and mortality endpoints, outperforming established clinical risk scores in all comparative instances. Crucially, the HealthFormer AI model can simulate interventions in silico. In a personalized nutrition trial, intervention-conditioned predictions accurately mirrored individual six-month biomarker changes, achieving a Pearson correlation of 0.78 for diastolic blood pressure. Furthermore, across 41 randomized intervention-outcome comparisons from published trials, the predicted direction of effect was universally accurate, with the predicted mean falling within the reported 95% confidence interval in 30 cases. This positions HealthFormer as an initial health world model, capable of generating forecasts, stratifying risk, and simulating interventions, paving the way for advanced clinical digital twins.