Story details

The preprint examines whether smartphone neural processing units can help fine-tune language models locally with low-rank adaptation. It focuses on the repeated operations involving frozen model weights that remain costly even when only a small number of parameters are trained.

The motivation is to keep personal data on-device during adaptation. The work is a systems research study; its feasibility claims should be read within the phones, models and tests reported by the authors.