Visual Instruction Tuning

Haotian Liu, Chunyuan Li, Qingyang Wu, +1

arXiv (Cornell University)

EngineeringMachine LearningVisual Instruction TuningMultimodal LearningLarge Language Models +18

GLIGEN: Open-Set Grounded Text-to-Image Generation

Yuheng Li, Haotian Liu, Qingyang Wu, +5

Natural Language ProcessingArtificial IntelligenceLarge MarginMultimodal LlmImage Analysis +13

LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day

Chunyuan Li, Cliff Wong, Sheng Zhang, +6

arXiv (Cornell University)

Artificial IntelligenceEngineeringMachine LearningUnimodal TextMultimodal Learning +17

YolactEdge: Real-time Instance Segmentation on the Edge

Haotian Liu, Rafael A. Rivera Soto, Fanyi Xiao, +1

Convolutional Neural NetworkScene AnalysisEngineeringMachine LearningTemporal Redundancy +19

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, +5

arXiv (Cornell University)

EngineeringMachine LearningEvaluation MetricsLarge Language ModelNatural Language Processing +17

ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

Mu Cai, Haotian Liu, Siva Karthik Mustikovela, +4

Automated lesion segmentation in fundus images with many-to-many reassembly of features

Qing Liu, Haotian Liu, Wei Ke, +1

Pattern Recognition

Image AnalysisEngineeringMedical ImagingMany-to-many ReassemblyDigital Pathology +11

Predictive value of remnant cholesterol inflammatory index for stroke risk: Evidence from the China health and Retirement Longitudinal study

Jiaying Chen, Qiheng Wu, Haotian Liu, +4

Journal of Advanced Research

Learning Customized Visual Models with Retrieval-Augmented Knowledge

Haotian Liu, Kilho Son, Jianwei Yang, +4

Few-shot LearningEngineeringMachine LearningImage RetrievalRetrieval-augmented Customization +16

Multiswarm Artificial Bee Colony algorithm based on spark cloud computing platform for medical image registration

Tingxi Wen, Haotian Liu, Luxin Lin, +5

Computer Methods and Programs in Biomedicine

Search OptimizationEngineeringMedical Image RegistrationFirefly AlgorithmSpark Cloud +3