This is an abstractive summarization demo program. It was mainly used to summarize opinions, but since it does not rely on any domain information, it can be used to summarize any highly redundant text.
This paper presents a flexible framework for generating very short abstractive summaries. The key idea is to use a word graph data structure referred to as the Opinosis-Graph to represent the text to be summarized. Then, we repeatedly find paths through this graph to produce concise summaries. We consider Opinosis a "shallow" abstractive summarizer as it uses the original text itself to generate summaries. This is unlike a true abstractive summarizer that would need a deeper level of natural language understanding.
While the evaluation is on an opinion dataset, the approach itself is general in that, it can be applied to any corpus containing high amounts of redundancies, for example, Twitter comments or user comments on blog/news articles. A very similar work to ours (published at the same time and at the same conference) is the following:
Multi-sentence compression: Finding shortest paths in word graphs
Proceedings of the 23rd International Conference on Computaional Linguistics (COLING 10). Beijing, China, August 23-27, 2010. Katja Filippova
Katja's work was evaluated on a news dataset (google news) for both English and Spanish while ours was evaluated on user reviews from various sources (English only). She studies the informativeness and grammaticality of sentences and in a similar way we evaluate these aspects by studying how close the Opinosis summaries are compared to the human composed summaries in terms of information overlap and readability (using a human assessor).
ROUGE 2.0 is a Java Package for Evaluation of Summarization Tasks building on the Perl Implementation of ROUGE with some updated and improved measures.
L. Rino, T. Pardo, C. Silla Jr., C. Kaestner, and M. Pombo. Proceedings of the 17th Brazilian Symposium on Artificial Intelligence (SBIA), page 235-244. São Luis-MA, Brazil, (September 2004)
L. Rino, and T. Pardo. Anais do XXIII Congresso da Sociedade Brasileira de Computação - Volume VIII: III Jornada de Minicursos de Inteligência Artificial, page 203-245. (2003)
J. Kupiec, J. Pedersen, and F. Chen. Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, page 68-73. New York, NY, USA, ACM Press, (1995)