Small models, big results: Achieving superior intent extraction through decomposition

Google Research presents a novel approach for understanding user intents from UI interaction trajectories using small multimodal LLMs.

The method decomposes the task into two stages: first summarizing each screen individually, then extracting intent from the summaries.

The approach shows results comparable to larger models and is suitable for on-device applications.