Assistant Professor Han Bao (12 batch・Department of Informatics) presents a paper titled “Self-attention Networks Localize When QK-eigenspectrum Concentrates” at International Conference on Machine Learning.
【Full list of the author name】Han Bao, Ryuichiro Hataya, Ryo Karakida
【Title】Self-attention Networks Localize When QK-eigenspectrum Concentrates
【Journal Name】International Conference on Machine Learning
【Publication date】July 17, 2024
【Volume and Page number】235:2903-2922