Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2022 · 12 citations · 35 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingNamed Entity RecognitionRepresentation LearningSupervised LearningConfirmation BiasDistant SupervisionLabel Noise MitigationLabel Noise ModelingLabel Noise RobustnessLabelsPrediction Distributions
Fine-grained Entity Typing (FET) has made great progress based on distant supervision but still suffers from label noise. Existing FET noise learning methods rely on prediction distributions in an instance-independent manner, which causes the problem of confirmation bias. In this work, we propose a clustering-based loss correction framework named Feature Cluster Loss Correction (FCLC), to address these two problems. FCLC first train a coarse backbone model as a feature extractor and noise estimator. Loss correction is then applied to each feature cluster, learning directly from the noisy labels. Experimental results on three public datasets show that FCLC achieves the best performance over existing competitive systems. Auxiliary experiments further demonstrate that FCLC is stable to hyperparameters and it does help mitigate confirmation bias. We also find that in the extreme case of no clean data, the FCLC framework still achieves competitive performance.
35
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Distant supervision for relation extraction without labeled data
Mike D. Mintz, Steven Bills, Rion Snow et al. · 2009 · 2.9K citations · Full text
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification