Loading...
Thumbnail Image
Item

Parsing AUC result-figures in machine learning specific scholarly documents for semantically-enriched summarization

Safder, Iqra
Batool, Hafsa
Sarwar, Raheem
Zaman, Farooq
Aljohani, Naif Radi
Nawaz, Raheel
Gaber, Mohamed
Hassan, Saeed-Ul
Alternative
Abstract
Machine learning specific scholarly full-text documents contain a number of result-figures expressing valuable data, including experimental results, evaluations, and cross-model comparisons. The scholarly search system often overlooks this vital information while indexing important terms using conventional text-based content extraction approaches. In this paper, we propose creating semantically enriched document summaries by extracting meaningful data from the results-figures specific to the evaluation metric of the area under the curve (AUC) and their associated captions from full-text documents. At first, classify the extracted figures and analyze them by parsing the figure text, legends, and data plots – using a convolutional neural network classification model with a pre-trained ResNet-50 on 1.2 million Images from ImageNet. Next, we extract information from the result figures specific to AUC by approximating the region under the function's graph as a trapezoid and calculating its area, i.e., the trapezoidal rule. Using over 12,000 figures extracted from 1000 scholarly documents, we show that figure specialized summaries contain more enriched terms about figure semantics. Furthermore, we empirically show that the trapezoidal rule can calculate the area under the curve by dividing the curve into multiple intervals. Finally, we measure the quality of specialized summaries using ROUGE, Edit distance, and Jaccard Similarity metrics. Overall, we observed that figure specialized summaries are more comprehensive and semantically enriched. The applications of our research are enormous, including improved document searching, figure searching, and figure focused plagiarism. The data and code used in this paper can be accessed at the following URL: https://github.com/slab-itu/fig-ir/.
Citation
Safder, I., Batool, H., Sarwar, R., Zaman, F., Aljohani, N.R., Nawaz, R., Gaber, M. and Hassan, S. (2021) Parsing AUC Result-Figures in Machine Learning Specific Scholarly Documents for Semantically-enriched Summarization, Applied Artificial Intelligence, 36(1), 2004347.
Research Unit
PubMed ID
PubMed Central ID
Embedded videos
Type
Journal article
Language
en
Description
© 2021 The Authors. Published by Taylor & Francis. This is an open access article available under a Creative Commons licence. The published version can be accessed at the following link on the publisher’s website: https://doi.org/10.1080/08839514.2021.2004347
Series/Report no.
ISSN
0883-9514
EISSN
ISBN
ISMN
Gov't Doc #
Sponsors
Rights
Research Projects
Organizational Units
Journal Issue
Embedded videos