Proceedings of the 30th ACM International Conference on Multimedia · 2022 · 12 citations · 16 references
ComputingComputer ScienceComputer VisionMachine LearningNatural Language ProcessingDeep LearningGenerative ModelingLanguage ModelingObject RecognitionVisual Question AnsweringImage CaptioningImage Question AnsweringNeural Language ModelsOpen CaptioningOut-of-distribution Detection
Image captioning research achieved breakthroughs in recent years by developing neural models that can generate diverse and high-quality descriptions for images drawn from the same distribution as training images. However, when facing out-of-distribution (OOD) images, such as corrupted images, or images containing unknown objects, the models fail in generating relevant captions.
16
Show and tell: A neural image caption generator
Oriol Vinyals, Alexander Toshev, Samy Bengio et al. · 2015 · 6.4K citations
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Peter Anderson, Xiaodong He, Chris Buehler et al. · 2018 · 5.1K citations