2018 · 16 citations · 28 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningNatural Language ProcessingDeep LearningDocument Image AnalysisNamed Entity RecognitionParsingPattern RecognitionSupport Vector MachinesAutomated Document ProcessingCharacter-level Named Entity RecognitionConditional Random FieldsDocument Image PreprocessingNeural Network ClassificationNeural ParsingRegular Expressions
Postal applications are among the first beneficiaries of the advancements in document image processing techniques due to their economic significance. To automate the process of postal services, it is necessary to integrate contributions from a wide range of image processing domains, from image acquisition and preprocessing to interpretation through symbol, character and word recognition. Lately, machine learning approaches are deployed for postal address processing. Parsing problem has been explored using different techniques, like regular expressions, Conditional Random Fields (CRFs), Hidden Markov Models (HMMs), Decision Trees and Support Vector Machines (SVMs). These traditional techniques are designed on the assumption that the data is free from OCR errors which decreases the adaptability of the architecture in the real-world scenarios. Furthermore, their performance is affected in the presence of non-standardized addresses resulting in intermixing of similar classes. In this paper, we present the first trainable neural network based robust architecture DeepParse for postal address parsing that tackles these issues and can be applied to any Named Entity Recognition (NER) problem. The architecture takes the input at different granularity levels: characters, trigram characters and words to extract and learn the features and classify the addresses. The model was trained on a synthetically generated dataset and tested on the real-world addresses. DeepParse has also been tested on the NER dataset i.e. CoNLL2003 and gave the result of 90.44% which is on par with the state-of-art technique.
28
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Natural Language Processing (almost) from Scratch
Ronan Collobert, Jason Weston, Léon Bottou et al. · arXiv (Cornell University) · 2011 · 5.2K citations · Full text