Zhongzhi Yu

Exploring how attention sinks impact language model performance and introducing a calibration technique.

A new framework improves how large language models can work on edge devices.

KVMerger reduces memory use in language models while maintaining performance through effective state merging.

A new system enhances adaptability of large language models across devices.