Semiconductors

Qualcomm's Write-Once Chip Dream Is Unproven

Chris Lattner pitches Mojo and Max as write-once AI software. The proof on performance and openness is still missing.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

The obvious read from Chris Lattner's appearance on The TWIML AI Podcast with Sam Charrington is that chip portability is solved. I do not buy it yet.

Lattner, now EVP of advanced AI software and platforms at Qualcomm after its Modular acquisition, made the claim fairly. He said Modular rebuilt the stack from silicon up with Mojo as the language and Max as the serving layer, according to the outlet. Batching, KV cache handling and speculative decoding stay common, Lattner said, while only the inner matrix math gets tuned per chip, which is how six architectures from six vendors were supported ahead of ModCon.

Can You Switch AI Chips Without Rewriting Your Stack? | Chris Lattner - TWIML
Can You Switch AI Chips Without Rewriting Your Stack? | Chris Lattner, TWIML

Portability without penalty has never existed.

What Lattner did not show is the hard part. There were no performance comparisons, no cost of the specialized kernels, and no named user running the same model in production on Nvidia and Qualcomm. Max remains gated too, since Lattner said Mojo is now Apache licensed but an open alliance around Max is coming later this year. That means the portability layer itself is still not fully open.

For the obvious reading to hold, the common code would have to be fast enough and the per-chip kernels would have to stay current with Nvidia CUDA and Google TPUs. The fair concession is that Qualcomm has incentive to try, since Qualcomm said in its closing announcement that Modular will keep its open, multi-hardware approach. That pledge matters because a startup could only afford to chase cloud, while Qualcomm needs software for data center and phones, laptops, watches and IoT.

If you are choosing silicon this quarter, do not bet your roadmap on write once.

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsChris LattnerQualcommModularMojoMaxNvidiaGoogle

StartupHub.ai Staff

Written by

StartupHub.ai StaffEditorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer

Reviewed by

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.