Extractive Text Summarization with Image Captions

The goal of this research is to investigate effects of image captions in text summarization.


poster
Poster

The goal of this research is to investigate effects of image captions in text summarization. Most of the news contain additional information such as images, image captions and titles in the body part, however text summarization only studies text of the document. It is shown that image captions and titles of texts can improve ROUGE score on text summarization task. However, I showed that image captions increase quality of the summarization in unsupervised models, too. Recent papers about text summarization study multi-document text summarization. Yet it looks harder task than single document summarization, more materials in multiple documents help to find salient information. I believe that image captions contain important aspects of news to understand them and find their summarizations.