Parsing AUC result-figures in machine learning specific scholarly documents for semantically-enriched summarization
Authors
Safder, IqraBatool, Hafsa
Sarwar, Raheem
Zaman, Farooq
Aljohani, Naif Radi
Nawaz, Raheel
Gaber, Mohamed
Hassan, Saeed-Ul
Issue Date
2021-11-14
Metadata
Show full item recordAbstract
Machine learning specific scholarly full-text documents contain a number of result-figures expressing valuable data, including experimental results, evaluations, and cross-model comparisons. The scholarly search system often overlooks this vital information while indexing important terms using conventional text-based content extraction approaches. In this paper, we propose creating semantically enriched document summaries by extracting meaningful data from the results-figures specific to the evaluation metric of the area under the curve (AUC) and their associated captions from full-text documents. At first, classify the extracted figures and analyze them by parsing the figure text, legends, and data plots – using a convolutional neural network classification model with a pre-trained ResNet-50 on 1.2 million Images from ImageNet. Next, we extract information from the result figures specific to AUC by approximating the region under the function's graph as a trapezoid and calculating its area, i.e., the trapezoidal rule. Using over 12,000 figures extracted from 1000 scholarly documents, we show that figure specialized summaries contain more enriched terms about figure semantics. Furthermore, we empirically show that the trapezoidal rule can calculate the area under the curve by dividing the curve into multiple intervals. Finally, we measure the quality of specialized summaries using ROUGE, Edit distance, and Jaccard Similarity metrics. Overall, we observed that figure specialized summaries are more comprehensive and semantically enriched. The applications of our research are enormous, including improved document searching, figure searching, and figure focused plagiarism. The data and code used in this paper can be accessed at the following URL: https://github.com/slab-itu/fig-ir/.Citation
Safder, I., Batool, H., Sarwar, R., Zaman, F., Aljohani, N.R., Nawaz, R., Gaber, M. and Hassan, S. (2021) Parsing AUC Result-Figures in Machine Learning Specific Scholarly Documents for Semantically-enriched Summarization, Applied Artificial Intelligence, 36(1), 2004347.Publisher
Taylor & FrancisJournal
Applied Artificial IntelligenceType
Journal articleLanguage
enDescription
© 2021 The Authors. Published by Taylor & Francis. This is an open access article available under a Creative Commons licence. The published version can be accessed at the following link on the publisher’s website: https://doi.org/10.1080/08839514.2021.2004347ISSN
0883-9514ae974a485f413a2113503eed53cd6c53
10.1080/08839514.2021.2004347
Scopus Count
Except where otherwise noted, this item's license is described as https://creativecommons.org/licenses/by/4.0/