An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, +9

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringMachine LearningImage RetrievalMultimodal Llm +19

In Defense of the Triplet Loss for Person Re-Identification

Alexander Hermans, Lucas Beyer, Bastian Leibe

arXiv (Cornell University)

Geometric LearningConvolutional Neural NetworkEngineeringMachine LearningBiometrics +15

MLP-Mixer: An all-MLP Architecture for Vision

Ilya Tolstikhin, Neil Houlsby, Alexander Kolesnikov, +9

arXiv (Cornell University)

Event CameraConvolutional Neural NetworkEngineeringMachine LearningImage Classification +17

Scaling Vision Transformers

Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, +1

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Convolutional Neural NetworkEngineeringMachine LearningVision TransformersTransformer Language Models +17

Revisiting Self-Supervised Visual Representation Learning

Alexander Kolesnikov, Xiaohua Zhai, Lucas Beyer

Anonymity RequirementsConvolutional Neural NetworkEngineeringMachine LearningRepresentation Learning +15

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, +9

International Conference on Learning Representations

Convolutional Neural NetworkEngineeringMachine LearningImage RetrievalMultimodal Llm +19

Sigmoid Loss for Language Image Pre-Training

Xiaohua Zhai, Basil Mustafa, Lucas Beyer

Few-shot LearningImagetext Pre-trainingConvolutional Neural NetworkEngineeringMachine Learning +15

LiT: Zero-Shot Transfer with Locked-image text Tuning

Xiaohua Zhai, Xiao Wang, Basil Mustafa, +4

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Knowledge distillation: A good teacher is patient and consistent

Lucas Beyer, Xiaohua Zhai, Amélie Royer, +3

2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Convolutional Neural NetworkEngineeringMachine LearningEducationTeacher Education +17

PaLI: A Jointly-Scaled Multilingual Language-Image Model

Xi Chen, Xiao Wang, Soravit Changpinyo, +25

arXiv (Cornell University)

EngineeringMachine LearningMultilingualismJoint ScalingMultilingual Pretraining +15