ROUGE 2.0 is a Java Package for Evaluation of Summarization Tasks building on the Perl Implementation of ROUGE with some updated and improved measures.
This is an abstractive summarization demo program. It was mainly used to summarize opinions, but since it does not rely on any domain information, it can be used to summarize any highly redundant text.
This paper presents a flexible framework for generating very short abstractive summaries. The key idea is to use a word graph data structure referred to as the Opinosis-Graph to represent the text to be summarized. Then, we repeatedly find paths through this graph to produce concise summaries. We consider Opinosis a "shallow" abstractive summarizer as it uses the original text itself to generate summaries. This is unlike a true abstractive summarizer that would need a deeper level of natural language understanding.
While the evaluation is on an opinion dataset, the approach itself is general in that, it can be applied to any corpus containing high amounts of redundancies, for example, Twitter comments or user comments on blog/news articles. A very similar work to ours (published at the same time and at the same conference) is the following:
Multi-sentence compression: Finding shortest paths in word graphs
Proceedings of the 23rd International Conference on Computaional Linguistics (COLING 10). Beijing, China, August 23-27, 2010. Katja Filippova
Katja's work was evaluated on a news dataset (google news) for both English and Spanish while ours was evaluated on user reviews from various sources (English only). She studies the informativeness and grammaticality of sentences and in a similar way we evaluate these aspects by studying how close the Opinosis summaries are compared to the human composed summaries in terms of information overlap and readability (using a human assessor).
A. Nenkova, and R. Passonneau. Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics: HLT-NAACL 2004, page 145--152. Boston, Massachusetts, USA, Association for Computational Linguistics, (2004)
H. Zhou, C. Otto, and R. Ewerth. Digital Libraries for Open Knowledge - 23rd International Conference on Theory and Practice of Digital Libraries, TPDL 2019, Oslo, Norway, September 9-12, 2019, Proceedings, volume 11799 of Lecture Notes in Computer Science, page 327-335. Springer, (2019)
T. Takeda, and A. Takasu. JCDL '07: Proceedings of the 7th ACM/IEEE joint conference on Digital libraries, page 438--439. New York, NY, USA, ACM, (2007)
S. Xu, H. Jiang, and F. Lau. IUI '09: Proceedingsc of the 13th international conference on Intelligent user interfaces, page 7--16. New York, NY, USA, ACM, (2008)
S. Tucker, and S. Whittaker. Proceedings of the 13th international conference on Intelligent user interfaces, page 37--46. New York, NY, USA, ACM, (2009)
S. Tucker, and S. Whittaker. Proceedings of the 13th international conference on Intelligent user interfaces, page 37--46. New York, NY, USA, ACM, (2009)
R. Yu, U. Gadiraju, X. Zhu, B. Fetahu, and S. Dietze. The Semantic Web - ESWC 2016 Satellite Events, Heraklion, Crete, Greece, May 29 - June 2, 2016, Revised Selected Papers, page 69--73. (2016)
T. Tran, C. Niederée, N. Kanhabua, U. Gadiraju, and A. Anand. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015, page 1201--1210. (2015)
D. Nguyen, and J. Leveling. Natural Language Processing and Information Systems - 18th International Conference on Applications of Natural Language to Information Systems, NLDB 2013, Salford, UK, June 2013, Proceedings, volume 7934 of Lecture Notes in Computer Science (LNCS), page 90--101. Springer, (2013)
R. Ribaldo, A. Akabane, L. Rino, and T. Pardo. Computational Processing of the Portuguese Language, volume 7243 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, (2012)
R. Ribaldo, A. Akabane, L. Rino, and T. Pardo. Computational Processing of the Portuguese Language, volume 7243 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, (2012)