Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2022 · 39 citations · 34 references
ComputingComputer ScienceBiomedical Text MiningNatural Language ProcessingText AnalyticsClinical Natural Language ProcessingData SummarizationLanguage ModelingText SummarizationTopic ModelingAblation StudiesBiomedical Text SummarizationClinical Text SummarizationDocument SummarizationMulti-document SummarizationSocial ImpactSummarization Of Biomedical TextsSummarization Of Clinical Texts
Although current state-of-the-art Transformerbased solutions succeeded in a wide range for single-document NLP tasks, they still struggle to address multi-input tasks such as multidocument summarization. Many solutions truncate the inputs, thus ignoring potential summary-relevant contents, which is unacceptable in the medical domain where each information can be vital. Others leverage linear model approximations to apply multi-input concatenation, worsening the results because all information is considered, even if it is conflicting or noisy with respect to a shared background. Despite the importance and social impact of medicine, there are no ad-hoc solutions for multi-document summarization. For this reason, we propose a novel discriminative marginalized probabilistic method (DAMEN) trained to discriminate critical information from a cluster of topic-related medical documents and generate a multi-document summary via token probability marginalization. Results prove we outperform the previous state-of-theart on a biomedical dataset for multi-document summarization of systematic literature reviews. Moreover, we perform extensive ablation studies to motivate the design choices and prove the importance of each module of our method. 1
34
Abstractive Text Summarization using Sequence-to-sequence RNNs and Beyond
Ramesh Nallapati, Bowen Zhou, Cícero dos Santos et al. · 2016 · 2.2K citations · Full text
Longformer: The Long-Document Transformer
arXiv (Cornell University) · 2020 · 2.2K citations · Full text
Text Summarization with Pretrained Encoders
Yang Liu, Mirella Lapata · 2019 · 1.6K citations · Full text