Proceedings of the AAAI Conference on Artificial Intelligence · 2019 · 61 citations · 34 references
ManagementComputer ScienceHuman Resource ManagementHuman-computer InteractionNatural Language ProcessingRecruitmentConversation AnalysisInterview MethodsQuestion AnsweringRecruitment SystemsRecruitment TechnologyVideo RecordingInterview Question SequencingSignalsVideo Interviewing SystemsVideo Question AnsweringVideo-recorded Interviews
New technologies drastically change recruitment techniques. Some research projects aim at designing interactive systems that help candidates practice job interviews. Other studies aim at the automatic detection of social signals (e.g. smile, turn of speech, etc...) in videos of job interviews. These studies are limited with respect to the number of interviews they process, but also by the fact that they only analyze simulated job interviews (e.g. students pretending to apply for a fake position). Asynchronous video interviewing tools have become mature products on the human resources market, and thus, a popular step in the recruitment process. As part of a project to help recruiters, we collected a corpus of more than 7000 candidates having asynchronous video job interviews for real positions and recording videos of themselves answering a set of questions. We propose a new hierarchical attention model called HireNet that aims at predicting the hirability of the candidates as evaluated by recruiters. In HireNet, an interview is considered as a sequence of questions and answers containing salient socials signals. Two contextual sources of information are modeled in HireNet: the words contained in the question and in the job position. Our model achieves better F1-scores than previous approaches for each modality (verbal content, audio and video). Results from early and late multimodal fusion suggest that more sophisticated fusion schemes are needed to improve on the monomodal results. Finally, some examples of moments captured by the attention mechanisms suggest our model could potentially be used to help finding key moments in an asynchronous job interview.
34
Distributed Representations of Sentences and Documents
Quoc V. Le, Tomáš Mikolov · arXiv (Cornell University) · 2014 · 5.1K citations · Full text
Hierarchical Attention Networks for Document Classification
Zichao Yang, Diyi Yang, Chris Dyer et al. · 2016 · 4.8K citations · Full text
OpenFace 2.0: Facial Behavior Analysis Toolkit
Tadas Baltrušaitis, Amir Zadeh, Yao Chong Lim et al. · 2018 · 1.8K citations