Emerging Properties in Self-Supervised Vision Transformers

Mathilde Caron, Hugo Touvron, Ishan Misra, +4

2021 IEEE/CVF International Conference on Computer Vision (ICCV)

Self-supervised Vit FeaturesImage ClassificationConvolutional Neural NetworkImage AnalysisMachine Vision +13

LLaMA: Open and Efficient Foundation Language Models

Hugo Touvron, Thibaut Lavril, Gautier Izacard, +11

arXiv (Cornell University)

Llm Fine-tuningEngineeringMachine LearningLarge Language ModelLarge Language Models +14

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin H. Stone, +65

arXiv (Cornell University)

Llm Fine-tuningChatbotEngineeringFine-tuned LlmsSpoken Dialog System +17

ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training

Hugo Touvron, Piotr Bojanowski, Mathilde Caron, +8

IEEE Transactions on Pattern Analysis and Machine Intelligence

Few-shot LearningConvolutional Neural NetworkEngineeringMachine LearningMultimodal Llm +17

ConViT: improving vision transformers with soft convolutional inductive biases*

Stéphane d’Ascoli, Hugo Touvron, Matthew L. Leavitt, +3

Journal of Statistical Mechanics Theory and Experiment

Convolutional Neural NetworkMachine VisionMachine LearningData ScienceImage Analysis +10

XCiT: Cross-Covariance Image Transformers

Alaaeldin El-Nouby, Hugo Touvron, Mathilde Caron, +8

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringMachine LearningMulti-image FusionNatural Language Processing +17

Training data-efficient image transformers & distillation through attention

Hugo Touvron, Matthieu Cord, Matthijs Douze, +3

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringMachine LearningData-efficient Image TransformersMultimodal Llm +15

LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inference

Ben Graham, Alaaeldin El-Nouby, Hugo Touvron, +4

arXiv (Cornell University)

Convolutional Neural NetworkEngineeringMachine LearningImage ClassificationImage Analysis +15

Going deeper with Image Transformers

Hugo Touvron, Matthieu Cord, Alexandre Sablayrolles, +2

2021 IEEE/CVF International Conference on Computer Vision (ICCV)

Convolutional Neural NetworkDeep Neural NetworksMachine VisionImage AnalysisData Science +13

Fixing the train-test resolution discrepancy: FixEfficientNet

Hugo Touvron, Andrea Vedaldi, Matthijs Douze, +1

arXiv (Cornell University)

Convolutional Neural NetworkEfficientnet Image ClassifiersMachine LearningEngineeringMeasurement +19