Classification of Heads in Multi-head Attention Mechanisms

Feihu Huang, Min Jiang*, Fang Liu, Dian Xu, Zimeng Fan, Yonghao Wang

*Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    Original languageEnglish
    Title of host publicationKnowledge Science, Engineering and Management - 15th International Conference, KSEM 2022, Proceedings
    EditorsGerard Memmi, Baijian Yang, Linghe Kong, Tianwei Zhang, Meikang Qiu
    PublisherSpringer Science and Business Media Deutschland GmbH
    Pages681-692
    Number of pages12
    ISBN (Print)9783031109881
    DOIs
    Publication statusPublished (VoR) - 2022
    Event15th International Conference on Knowledge Science, Engineering and Management, KSEM 2022 - Singapore, Singapore
    Duration: 6 Aug 20228 Aug 2022

    Publication series

    NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    Volume13370 LNAI
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Conference

    Conference15th International Conference on Knowledge Science, Engineering and Management, KSEM 2022
    Country/TerritorySingapore
    CitySingapore
    Period6/08/228/08/22

    Keywords

    • Attention
    • Classification
    • Multi-head attention
    • NLP
    • Transformer

    Fingerprint

    Dive into the research topics of 'Classification of Heads in Multi-head Attention Mechanisms'. Together they form a unique fingerprint.

    Cite this