Posted:

PrismML brings its tiny LLMs to Qualcomm-powered smart glasses
The AI Lab PrismML â founded by Caltech researchers and advised by UC BerkeleyâÂÂs Ion Stoica â has created a version of its tiny language models for smart glasses running on QualcommâÂÂs Snapdragon chips.
On Wednesday, at QualcommâÂÂs Snapdragon Summit, the chipmaker showcased PrismMLâÂÂs 1-bit Bonsai LLM, which can be run locally on AI smart glasses built on the Snapdragon AR1 Gen 1 Platform.
As TechCrunch previously reported, PrismMLâÂÂs claim to fame is that it shrinks larger models substantially (in this case, by 4x), while retaining almost all of their performance on standard benchmarks. The smart glasses version is a 2-billion-parameter model tuned for vision and language, so wearers can ask what theyâÂÂre looking at in real time.
PrismâÂÂs larger goal is open-weight AI that runs on devices and makes better use of the computing power they already have. The startup pitches this as an alternative to depending on the privacy promises of proprietary AI labs and their insatiable need for more compute.
Releasing a model for QualcommâÂÂs chip is a step toward that vision. But no smart glasses running PrismML have been announced yet.