Sharing is Caring! Joint Multitask Learning Helps Aspect-Category Extraction and Sentiment Detection in Scientific Peer Reviews

The peer-review process is the benchmark of research validation. Peer-reviewed texts are the artifacts via which the editors/chairs decide the inclusion/exclusion of a paper in a journal or conference proceedings. Hence it is important for the editors/chairs to carefully analyze the peer-review text...

Full description

Saved in:
Bibliographic Details
Published in:2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL) pp. 270 - 273
Main Authors: Kumar, Sandeep, Ghosal, Tirthankar, Bharti, Prabhat Kumar, Ekbal, Asif
Format: Conference Proceeding
Language:English
Published: IEEE 01.09.2021
Subjects:
aspect extraction
Benchmark testing
Codes
deep learning
Libraries
peer review
sentiment analysis
Task analysis
text classification
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Abstract The peer-review process is the benchmark of research validation. Peer-reviewed texts are the artifacts via which the editors/chairs decide the inclusion/exclusion of a paper in a journal or conference proceedings. Hence it is important for the editors/chairs to carefully analyze the peer-review text from various aspects of the paper (e.g., novelty, substance, soundness, etc.), identify the underlying sentiment of the reviewers, and thereby validate the informativeness of the reviews before making a decision. With the rise in research paper submissions, the current peer-review system is experiencing an unprecedented information overload. Sometimes it becomes stressful for the chairs/editors to make a reasonable decision within the stringent timelines. Here in this work, we attempt an interesting problem to automatically extract the aspect and sentiment from the peer-review texts. We design an end-to-end deep multitask learning model to perform aspect extraction and sentiment classification simultaneously. We show that both these tasks help each other in the predictions. We achieve encouraging performance on a recently released dataset of peer-review texts. We make our codes available for further research 1 1 https://www.iitp.ac.in/~ai-nlp-ml/resources.html#aspect-category-sentiment.
AbstractList The peer-review process is the benchmark of research validation. Peer-reviewed texts are the artifacts via which the editors/chairs decide the inclusion/exclusion of a paper in a journal or conference proceedings. Hence it is important for the editors/chairs to carefully analyze the peer-review text from various aspects of the paper (e.g., novelty, substance, soundness, etc.), identify the underlying sentiment of the reviewers, and thereby validate the informativeness of the reviews before making a decision. With the rise in research paper submissions, the current peer-review system is experiencing an unprecedented information overload. Sometimes it becomes stressful for the chairs/editors to make a reasonable decision within the stringent timelines. Here in this work, we attempt an interesting problem to automatically extract the aspect and sentiment from the peer-review texts. We design an end-to-end deep multitask learning model to perform aspect extraction and sentiment classification simultaneously. We show that both these tasks help each other in the predictions. We achieve encouraging performance on a recently released dataset of peer-review texts. We make our codes available for further research 1 1 https://www.iitp.ac.in/~ai-nlp-ml/resources.html#aspect-category-sentiment.
Author Kumar, Sandeep
Ekbal, Asif
Bharti, Prabhat Kumar
Ghosal, Tirthankar
Author_xml – sequence: 1
  givenname: Sandeep
  surname: Kumar
  fullname: Kumar, Sandeep
  email: sandeep_2121cs29@iitp.ac.in
  organization: IIT Patna,CSE Department,India
– sequence: 2
  givenname: Tirthankar
  surname: Ghosal
  fullname: Ghosal, Tirthankar
  email: ghosal@ufal.mff.cuni.cz
  organization: UFAL, MFF Charles University,CZ
– sequence: 3
  givenname: Prabhat Kumar
  surname: Bharti
  fullname: Bharti, Prabhat Kumar
  email: prabhat_1921cs32@iitp.ac.in
  organization: IIT Patna,CSE Department,India
– sequence: 4
  givenname: Asif
  surname: Ekbal
  fullname: Ekbal, Asif
  email: asif@iitp.ac.in
  organization: IIT Patna,CSE Department,India
BookMark eNotUM1OAjEYrIkmKvIEeqgPsNgf2m6PZEGRrNGInkm3_RYboUva-sPJVxfEy8xkZjKHOUfHoQuA0BUlA0qJvplV41owQfiAEUYHhJCSHqG-ViWVUgypUkSfon5KviFCMSEJ12foZ_5mog9L7BOu_tQ1nnU-ZPzwsco-m_SOazAx7DtTWG0SHqUN2FxUJsOyi1s8-c7R2Oy7gE1weA4h-_UO8BgyHHwf8Nz6fdB6i58AIn6GTw9f6QKdtGaVoP_PPfR6O3mppkX9eHdfjerCsFLkgisjwRDXmIaDACdFCayUrnHCCOe4lLYV0gJRFpqhHoKksmVWMgqt1arhPXR52PUAsNhEvzZxu9BS0N0__BeHX2Lz
CODEN IEEPAD
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/JCDL52503.2021.00081
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9781665417709
1665417706
EndPage 273
ExternalDocumentID 9651781
Genre orig-research
GroupedDBID 6IE
6IL
ACM
ALMA_UNASSIGNED_HOLDINGS
APO
CBEJK
LHSKQ
RIE
RIL
ID FETCH-LOGICAL-a285t-37a6ea0dbab3e5ed658e286dbd5a5dd366cf56ce07ceb494e616f2c621efc97b3
IEDL.DBID RIE
ISICitedReferencesCount 15
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000760315700035&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
IngestDate Wed Aug 27 02:33:24 EDT 2025
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a285t-37a6ea0dbab3e5ed658e286dbd5a5dd366cf56ce07ceb494e616f2c621efc97b3
PageCount 4
ParticipantIDs ieee_primary_9651781
PublicationCentury 2000
PublicationDate 2021-Sept.
PublicationDateYYYYMMDD 2021-09-01
PublicationDate_xml – month: 09
  year: 2021
  text: 2021-Sept.
PublicationDecade 2020
PublicationTitle 2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL)
PublicationTitleAbbrev JCDL
PublicationYear 2021
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssib057256039
Score 1.8692708
Snippet The peer-review process is the benchmark of research validation. Peer-reviewed texts are the artifacts via which the editors/chairs decide the...
SourceID ieee
SourceType Publisher
StartPage 270
SubjectTerms aspect extraction
Benchmark testing
Codes
deep learning
Libraries
peer review
sentiment analysis
Task analysis
text classification
Title Sharing is Caring! Joint Multitask Learning Helps Aspect-Category Extraction and Sentiment Detection in Scientific Peer Reviews
URI https://ieeexplore.ieee.org/document/9651781
WOSCitedRecordID wos000760315700035&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3NS8MwFA9zePCksonfRPBot37kozlKtyFjjIEKu42keZMitKPtRE_-6yZpnQhevKW5pLyX9JfX936_h9AtiYUvpQlylFTSI9zErDIUxLO8EiElD2PtdGZnfD6Pl0ux6KC7HRcGAFzxGQzs0OXydZFu7a-yoWA04JZnvcc5a7ha33uHcovdkWjZcYEvhtNkNLNJu8hEgWEwcOj3q4eKg5DJ4f8WP0L9Hy4eXuxQ5hh1IO-hT6uzbB5xVuHEjW7wtMjyGjeEWlm94lY59QUbZNlU-N5xKr3EKkMU5Qcev9dlQ2rAMtf40VYN2TfAI6ihmc9y7I6-KyfCC4ASN6mEqo-eJ-On5MFrWykYy8e0Np8RyUD62ngkAgra3DsgjJlWmkqqdcRYuqYsBZ-noIggwAK2DlMWBmB8xlV0grp5kcMpwoSkAeVrc3EjkkCoBFNKCC2J1kSnjJyhnjXeatOoZaxau53_PX2BDqx3mqqtS9Styy1cof30rc6q8tq5-Au936tT
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3PS8MwFA5jCnpS2cTfRvBot_5I0uYodWPOOgZO2G2kzZsUoR1tJ3ryXzdJ60Tw4i3NJeW9pF9e3_u-h9A1CbgthApyYhELi_gqZhUuJ5bmlXAhfDeQRmc28ieTYD7n0xa62XBhAMAUn0FPD00uX-bJWv8q63NGHV_zrLcoIa5ds7W-dw_1NXp7vOHHOTbvj8O7SKftPBUHuk7P4N-vLioGRIZ7_1t-H3V_2Hh4usGZA9SCrIM-tdKyesRpiUMzusLjPM0qXFNqRfmKG-3UF6ywZVXiW8OqtEKtDZEXH3jwXhU1rQGLTOInXTek3wDfQQX1fJphc_hNQRGeAhS4TiaUXfQ8HMzCkdU0U1C2D2ilPiSCgbCl8okHFKS6eYAbMBlLKqiUHmPJkrIEbD-BmHACzGFLN2GuA8prfuwdonaWZ3CEMCGJQ_2luroRQcCNOYtjzqUgUhKZMHKMOtp4i1Wtl7Fo7Hby9_Ql2hnNHqNFdD95OEW72lN1DdcZalfFGs7RdvJWpWVxYdz9BdBFrpo
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2021+ACM%2FIEEE+Joint+Conference+on+Digital+Libraries+%28JCDL%29&rft.atitle=Sharing+is+Caring%21+Joint+Multitask+Learning+Helps+Aspect-Category+Extraction+and+Sentiment+Detection+in+Scientific+Peer+Reviews&rft.au=Kumar%2C+Sandeep&rft.au=Ghosal%2C+Tirthankar&rft.au=Bharti%2C+Prabhat+Kumar&rft.au=Ekbal%2C+Asif&rft.date=2021-09-01&rft.pub=IEEE&rft.spage=270&rft.epage=273&rft_id=info:doi/10.1109%2FJCDL52503.2021.00081&rft.externalDocID=9651781