International Journal of Data Science and Analytics · 2021 · 31 citations · 11 references
ComputingComputer ScienceFinanceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningDocument RepresentationInformation ExtractionLanguage ModelingText MiningText RepresentationAnonymizationContextual Word EmbeddingsContextual Word LearningContextual Word RepresentationNeural Language ModelsRecurrent Neural Network Language ModelsRecurrent Neural NetworksTransformer Models
Abstract The automatization and digitalization of business processes have led to an increase in the need for efficient information extraction from business documents. However, financial and legal documents are often not utilized effectively by text processing or machine learning systems, partly due to the presence of sensitive information in these documents, which restrict their usage beyond authorized parties and purposes. To overcome this limitation, we develop an anonymization method for German financial and legal documents using state-of-the-art natural language processing methods based on recurrent neural nets and transformer architectures. We present a web-based application to anonymize financial documents and a large-scale evaluation of different deep learning techniques.
11
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention
Ikuya Yamada, Akari Asai, Hiroyuki Shindo et al. · 2020 · 564 citations · Full text