Journal Of Big Data · 2020 · 77 citations · 20 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingSentiment AnalysisText SummarizationAttentionConvolutional Neural NetworksEncoder-decoder ArchitecturesNeural SummarizationNeural Text SummarizationSummarizationSummarization Datasets
Deep learning has advanced NLP tasks, with sequence‑to‑sequence encoder–decoder models, attention, and copy mechanisms enabling improved text summarization. The study aims to reimplement a sequence‑to‑sequence summarization model for Arabic, a language previously lacking such an approach. The authors constructed a 300‑k‑entry Arabic headline dataset, applied baseline seq‑to‑seq summarization models, and evaluated them with ROUGE scores.
Abstract Natural language processing has witnessed remarkable progress with the advent of deep learning techniques. Text summarization, along other tasks like text translation and sentiment analysis, used deep neural network models to enhance results. The new methods of text summarization are subject to a sequence-to-sequence framework of encoder–decoder model, which is composed of neural networks trained jointly on both input and output. Deep neural networks take advantage of big datasets to improve their results. These networks are supported by the attention mechanism, which can deal with long texts more efficiently by identifying focus points in the text. They are also supported by the copy mechanism that allows the model to copy words from the source to the summary directly. In this research, we are re-implementing the basic summarization model that applies the sequence-to-sequence framework on the Arabic language, which has not witnessed the employment of this model in the text summarization before. Initially, we build an Arabic data set of summarized article headlines. This data set consists of approximately 300 thousand entries, each consisting of an article introduction and the headline corresponding to this introduction. We then apply baseline summarization models to the previous data set and compare the results using the ROUGE scale.
20
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
The Stanford CoreNLP Natural Language Processing Toolkit
Christopher D. Manning, Mihai Surdeanu, John Bauer et al. · 2014 · 7.2K citations · Full text