mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

Chenliang Li, Haiyang Xu, Junfeng Tian, +12

EngineeringMachine LearningPart-of-speech TaggingMultimodal LearningLanguage Processing +20

mPLUG-OwI2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration

Qinghao Ye, Haiyang Xu, Jiabo Ye, +6

Smart Living Using Bluetooth-Based Android Smartphone

Ming Yan, Hao Shi

International Journal of Wireless & Mobile Networks

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video

Haiyang Xu, Qinghao Ye, Ming Yan, +12

arXiv (Cornell University)

EngineeringMachine LearningMultimodal LearningMultimedia AnalysisNatural Language Processing +14

UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Model

Jiabo Ye, Anwen Hu, Haiyang Xu, +11

Jiabo YeEmnlp 2023EngineeringCorpus LinguisticsLanguage Processing +23

Hallucination Augmented Contrastive Learning for Multimodal Large Language Model

Chaoya Jiang, Haiyang Xu, Mengfan Dong, +7

Intrusion detection based on improved density peak clustering for imbalanced data on sensor-cloud systems

Ming Yan, Yewang Chen, Xiaoliang Hu, +3

Journal of Systems Architecture

Cluster ComputingAnomaly DetectionEngineeringData ScienceData Mining +6

A lightweight weakly supervised learning segmentation algorithm for imbalanced image based on rotation density peaks

Ming Yan, Yewang Chen, Yi Chen, +3

Knowledge-Based Systems

Lightweight WeaklyImage ClassificationMultiple Instance LearningImage AnalysisMachine Learning +11

CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions

Ming Yan, Xin Wang, Yudi Dai, +5

EngineeringMachine LearningHuman Pose EstimationLong-standing Research Problem3D Pose Estimation +19

Health disparities among older adults following tropical cyclone exposure in Florida

Kate Burrows, G. Brooke Anderson, Ming Yan, +6

Nature Communications