2023 · 29 citations · 13 references
ComputingComputer SciencePediatricsAutism Spectrum DisordersComputer VisionMachine LearningDeep LearningFace PerceptionFace RecognitionFacial ExpressionMedical Image AnalysisPattern RecognitionDecoder DesignFace Feature ExtractionFace Representation LearningFacial Expression AnalysisFacial Expression RepresentationModel TransferabilityNeurodevelopmental Disorder DiagnosisVision Transformers
Autism spectrum disorder (ASD) is a lifelong neurodevelopmental disorder with very high prevalence around the world. Research progress in the field of ASD facial analysis in pediatric patients has been hindered due to a lack of well-established baselines. In this paper, we propose the use of the Vision Transformer (ViT) for the computational analysis of pediatric ASD. The presented model, known as ViTASD, distills knowledge from large facial expression datasets and offers model structure transferability. Specifically, ViTASD employs a vanilla ViT to extract features from patients’ face images and adopts a lightweight decoder with a Gaussian Process layer to enhance the robustness for ASD analysis. Extensive experiments conducted on standard ASD facial analysis benchmarks show that our method outperforms all of the representative approaches in ASD facial analysis, while the ViTASD-L achieves a new state-of-the-art. Our code and pretrained models are available at https://github.com/IrohXu/ViTASD.
13
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov et al. · arXiv (Cornell University) · 2020 · 21.6K citations · Full text
Intriguing Properties of Vision Transformers
Muzammal Naseer, Kanchana Ranasinghe, Salman Khan et al. · arXiv (Cornell University) · 2021 · 301 citations · Full text