ROUGE 2.0 is a Java Package for Evaluation of Summarization Tasks building on the Perl Implementation of ROUGE with some updated and improved measures.
This paper presents a flexible framework for generating very short abstractive summaries. The key idea is to use a word graph data structure referred to as the Opinosis-Graph to represent the text to be summarized. Then, we repeatedly find paths through this graph to produce concise summaries. We consider Opinosis a "shallow" abstractive summarizer as it uses the original text itself to generate summaries. This is unlike a true abstractive summarizer that would need a deeper level of natural language understanding.
While the evaluation is on an opinion dataset, the approach itself is general in that, it can be applied to any corpus containing high amounts of redundancies, for example, Twitter comments or user comments on blog/news articles. A very similar work to ours (published at the same time and at the same conference) is the following:
Multi-sentence compression: Finding shortest paths in word graphs
Proceedings of the 23rd International Conference on Computaional Linguistics (COLING 10). Beijing, China, August 23-27, 2010. Katja Filippova
Katja's work was evaluated on a news dataset (google news) for both English and Spanish while ours was evaluated on user reviews from various sources (English only). She studies the informativeness and grammaticality of sentences and in a similar way we evaluate these aspects by studying how close the Opinosis summaries are compared to the human composed summaries in terms of information overlap and readability (using a human assessor).
This is an abstractive summarization demo program. It was mainly used to summarize opinions, but since it does not rely on any domain information, it can be used to summarize any highly redundant text.
L. Antiqueira, und M. Nunes. 3rd Workshop on MSc dissertation and PhD thesis in Artificial Inteligence (WTDIA'06) in the Proceedings of International Joint Conference IBERAMIA-SBIA-SBRN, Ribeirão Preto, Brazil, ICMC-USP, (Oktober 2006)
O. Boydell, und B. Smyth. IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces, Seite 42--51. New York, NY, USA, ACM Press, (2007)
O. Boydell, und B. Smyth. IUI '07: Proceedings of the 12th international conference on Intelligent user interfaces, Seite 42--51. New York, NY, USA, ACM Press, (2007)
J. Clarke, und M. Lapata. Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), (2007)
J. Delort, und E. Alfonseca. Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL'12), Avignon, France, (2012)