ROUGE 2.0 is a Java Package for Evaluation of Summarization Tasks building on the Perl Implementation of ROUGE with some updated and improved measures.
This is an abstractive summarization demo program. It was mainly used to summarize opinions, but since it does not rely on any domain information, it can be used to summarize any highly redundant text.
This paper presents a flexible framework for generating very short abstractive summaries. The key idea is to use a word graph data structure referred to as the Opinosis-Graph to represent the text to be summarized. Then, we repeatedly find paths through this graph to produce concise summaries. We consider Opinosis a "shallow" abstractive summarizer as it uses the original text itself to generate summaries. This is unlike a true abstractive summarizer that would need a deeper level of natural language understanding.
While the evaluation is on an opinion dataset, the approach itself is general in that, it can be applied to any corpus containing high amounts of redundancies, for example, Twitter comments or user comments on blog/news articles. A very similar work to ours (published at the same time and at the same conference) is the following:
Multi-sentence compression: Finding shortest paths in word graphs
Proceedings of the 23rd International Conference on Computaional Linguistics (COLING 10). Beijing, China, August 23-27, 2010. Katja Filippova
Katja's work was evaluated on a news dataset (google news) for both English and Spanish while ours was evaluated on user reviews from various sources (English only). She studies the informativeness and grammaticality of sentences and in a similar way we evaluate these aspects by studying how close the Opinosis summaries are compared to the human composed summaries in terms of information overlap and readability (using a human assessor).
D. Nguyen, and J. Leveling. Natural Language Processing and Information Systems - 18th International Conference on Applications of Natural Language to Information Systems, NLDB 2013, Salford, UK, June 2013, Proceedings, volume 7934 of Lecture Notes in Computer Science (LNCS), page 90--101. Springer, (2013)
R. Ribaldo, A. Akabane, L. Rino, and T. Pardo. Computational Processing of the Portuguese Language, volume 7243 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, (2012)
R. Ribaldo, A. Akabane, L. Rino, and T. Pardo. Computational Processing of the Portuguese Language, volume 7243 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, (2012)
S. Mohammad, B. Dorr, M. Egan, A. Hassan, P. Muthukrishan, V. Qazvinian, D. Radev, and D. Zajic. Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, page 584--592. Stroudsburg, PA, USA, Association for Computational Linguistics, (2009)
S. Miranda-Jiménez, A. Gelbukh, and G. Sidorov. Proceedings of the 21th International Conference on Conceptual Structures (ICCS 2013), volume 7735 of Lecture Notes in Computer Science, page 245-253. Springer, (2013)
M. Hu, and B. Liu. Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, page 168--177. New York, NY, USA, ACM, (2004)
J. Delort, and E. Alfonseca. Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL'12), Avignon, France, (2012)