Yingcong Li

A look into how transformers use attention layers for better language processing.

A closer look at self-attention mechanisms in language processing models.

Study reveals insights into in-context learning performance across various model architectures.