Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Zihang Dai, Zhilin Yang, Yiming Yang, +3

Unsupervised Data Augmentation for Consistency Training

Qizhe Xie, Zihang Dai, Eduard Hovy, +2

arXiv (Cornell University)

Few-shot LearningEngineeringMachine LearningAutoencodersNatural Language Processing +15

Gemini: A Family of Highly Capable Multimodal Models

Gemini Robotics Team, Rohan Anil, Sebastian Borgeaud, +741

arXiv (Cornell University)

Artificial IntelligenceNatural Language ProcessingNew FamilyLarge Ai ModelImage Analysis +13

CoAtNet: Marrying Convolution and Attention for All Data Sizes

Zihang Dai, Hanxiao Liu, Quoc V. Le, +1

arXiv (Cornell University)

Convolutional Neural NetworkMachine VisionMachine LearningData ScienceImage Analysis +11

Bootstrapping a Data-Set and Model for Question-Answering in Portuguese (Short Paper)

Zihang Dai, Zhilin Yang, Yiming Yang

arXiv (Cornell University)

Meta Pseudo Labels

Hieu Pham, Zihang Dai, Qizhe Xie, +1

Artificial IntelligenceMetatheoryMeta-learning (Computer Science)EngineeringMachine Learning +11

Characterizing and Avoiding Negative Transfer

Zi-Rui Wang, Zihang Dai, Barnabás Póczos, +1

Artificial IntelligenceFew-shot LearningNegative TransferEngineeringMachine Learning +15

SimVLM: Simple Visual Language Model Pretraining with Weak Supervision

Zirui Wang, Jiahui Yu, Adams Wei Yu, +3

arXiv (Cornell University)

EngineeringMachine LearningPretraining ProcedureMultilingual PretrainingNatural Language Processing +14

Good Semi-supervised Learning that Requires a Bad GAN

Zihang Dai, Zhilin Yang, Fan Yang, +2

arXiv (Cornell University)

Artificial IntelligenceJoint TrainingGood Semi-supervised LearningGenerative SystemMachine Vision +12

Unsupervised Data Augmentation for Consistency Training

Qizhe Xie, Zihang Dai, Eduard Hovy, +2

Neural Information Processing Systems

Data AugmentationEngineeringMachine LearningData ScienceData Mining +5