A Deep Neural Architecture for Decision-Aware Meta-Review Generation

Automatically generating meta-reviews from peer-reviews is a new and challenging task. Although close, the task is not precisely summarizing the peer-reviews. Usually, a conference chair or a journal editor writes a meta-review after going through the reviews written by the appointed reviewers, roun...

Full description

Saved in:
Bibliographic Details
Published in:2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL) pp. 222 - 225
Main Authors: Kumar, Asheesh, Ghosal, Tirthankar, Ekbal, Asif
Format: Conference Proceeding
Language:English
Published: IEEE 01.09.2021
Subjects:
Codes
decision prediction
deep learning
Libraries
Measurement
meta-review generation
Open Access
Task analysis
Transformers
Writing
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automatically generating meta-reviews from peer-reviews is a new and challenging task. Although close, the task is not precisely summarizing the peer-reviews. Usually, a conference chair or a journal editor writes a meta-review after going through the reviews written by the appointed reviewers, rounds of discussions with them, finally arriving at a consensus on the paper's fate. In essence, the meta-review texts are decision-aware, i.e., the meta reviewer already forms the decision before writing the meta-review, and the corresponding text conforms to that decision. We leverage this seed idea and design a deep neural architecture to generate decision-aware meta-reviews in this work. We propose a multi-encoder transformer network for peer-review decision prediction and subsequent meta-review generation. We analyze our output quantitatively and qualitatively and argue that quantitative text summarization metrics are not suitable for evaluating the generated meta-reviews. Our proposed model performs comparably with the recent state-of-the-art text summarization approaches. Qualitative evaluation of our model-generated output is encouraging on an open access peer reviews dataset that we curate from the open review platform. We make our data and codes available 1 1 https://www.iitp.ac.in/~ai-nlp-ml/resources.html# decision-aware-meta-review.
DOI:10.1109/JCDL52503.2021.00064