Please use this identifier to cite or link to this item:
http://drsr.daiict.ac.in//handle/123456789/1122
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.contributor.advisor | Majumder, Prasenjit | - |
dc.contributor.author | Ranpara, Tarang J. | - |
dc.date.accessioned | 2024-08-22T05:21:05Z | - |
dc.date.available | 2024-08-22T05:21:05Z | - |
dc.date.issued | 2022 | - |
dc.identifier.citation | Ranpara, Tarang J. (2022). Finding Proxy For Human Evaluation Re-evaluating the evaluation of news summarization. Dhirubhai Ambani Institute of Information and Communication Technology. xi, 51 p. (Acc. # T01042). | - |
dc.identifier.uri | http://drsr.daiict.ac.in//handle/123456789/1122 | - |
dc.description.abstract | Engaging human annotators to evaluate every summary in a content summarization system is not feasible. Automatic evaluation metrics act as a proxy for human evaluation. A high correlation with human evaluation determines the effectiveness of a given metric. This thesis compares 40 different evaluation metrics with human judgments in terms of correlation and investigates whether the contextual similarity based metrics are better than lexical overlap based metrics, i.e., ROUGE score. The comparison shows that contextual similarity based metrics have a high correlation with human judgments than lexical overlap based metrics. Thus, such metrics can act as a good proxy for human judgment. | - |
dc.publisher | Dhirubhai Ambani Institute of Information and Communication Technology | - |
dc.subject | News Summarization | - |
dc.subject | Evaluation | - |
dc.subject | Lexical overlap | - |
dc.subject | Contextual Similarity | - |
dc.subject | ROUGE | - |
dc.subject | Transformers | - |
dc.subject | Uord2vec | - |
dc.classification.ddc | 523.1 RAN | - |
dc.title | Finding Proxy For Human Evaluation Re-evaluating the evaluation of news summarization | - |
dc.type | Dissertation | - |
dc.degree | M. Tech | - |
dc.student.id | 202011057 | - |
dc.accession.number | T01042 | - |
Appears in Collections: | M Tech Dissertations |
Files in This Item:
File | Size | Format | |
---|---|---|---|
202011057.pdf | 1.32 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.