AltibbiVec: A Word Embedding Model for Medical and Health Applications in the Arabic Language

Abstract

In recent years, the utilization of natural language processing (NLP) and Machine Learning (ML) techniques in clinical decision support systems have shown their ability in improving and automating the diagnosis process and reduce the potential for clinical errors. NLP in the Arabic language is more intricate due to several limitations, such as the lack of datasets and analytical resources compared to other languages like English. However, a clinical decision support system in the Arabic context is of significant importance. A fundamental process in NLP is extracting features from textual data via text embedding. Word embedding is a representation of words in a numeric format that encodes the statistic, semantic, or context information. Building a neural word embedding model requires hundreds of thousands of data instances to find hidden patterns of relationships within sentences. Essentially, extracting relevant and informative features promotes the performance of the learning algorithms. The objective of this paper is to propose an Arabic neural-based word embedding model in the medical and healthcare context (called “AltibbiVec”). Around 1.5 million medical consultations and questions are used to train the embedding model. Three different embedding models are developed and compared, which are based on Word2Vec, FastText, and GloVe. The trained models are evaluated by different criteria, including the word clustering and the similarity of words. Besides, they are evaluated by performing a specialty-based question classification. Word2Vec and FastText capture sufficiently the semantics of text more than GloVe. Hence, they are recommended for utilization in healthcare NLP applications. The developed models are available on Github repository: https://github.com/altibbi-com/AltibbiVec.