The Hakubi Project

｜　JAPANESE　｜

Assistant Professor Han Bao (12 batch・Department of Informatics) presents a paper titled "Self-attention Networks Localize When QK-eigenspectrum Concentrates" at International Conference on Machine Learning.

【Full list of the author name】Han Bao, Ryuichiro Hataya, Ryo Karakida

【Title】Self-attention Networks Localize When QK-eigenspectrum Concentrates

【Journal Name】International Conference on Machine Learning

【Publication date】July 17, 2024

【Volume and Page number】235:2903-2922

https://proceedings.mlr.press/v235/bao24b.html