ACM Transactions on Knowledge Discovery from Data · 2024 · 11 citations · 54 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingCross-linguistic TransferDeep LearningEvent DetectionKnowledge GraphsMultilingual Natural Language ProcessingWord EmbeddingsCross-lingual Event DetectionCross-lingual Representation LearningCross-lingual TransferCross-lingual Transfer LearningCross-lingual Word EmbeddingsGraph Neural NetworksGraph-based Event DetectionLow-resource Language Processing
Recently published graph neural networks (GNNs) show promising performance at social event detection tasks. However, most studies are oriented toward monolingual data in languages with abundant training samples. This has left the common lesser-spoken languages relatively unexplored. Thus, in this work, we present a GNN-based framework that integrates cross-lingual word embeddings into the process of graph knowledge distillation for detecting events in low-resource language data streams. To achieve this, a novel cross-lingual knowledge distillation framework, called CLKD, exploits prior knowledge learned from similar threads in English to make up for the paucity of annotated data. Specifically, to extract sufficient useful knowledge, we propose a hybrid distillation method that consists of both feature-wise and relation-wise information. To transfer both kinds of knowledge in an effective way, we add a cross-lingual module in the feature-wise distillation to eliminate the language gap and selectively choose beneficial relations in the relation-wise distillation to avoid distraction caused by teachers’ misjudgments. Our proposed CLKD framework also adopts different configurations to suit both offline and online situations. Experiments on real-world datasets show that the framework is highly effective at detection in languages where training samples are scarce.
54
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
FaceNet: A unified embedding for face recognition and clustering
2015 · 11.2K citations · Full text