Neural sentiment analysis of user reviews to predict user ratings
MetadataShow full item record
AbstractThe significance of user satisfaction is increasing in the competitive open source software (OSS) market. Application stores let users send their feedbacks for applications, which are in the form of user reviews or ratings. Developers are informed about bugs or any additional requirements with the help of this feedback and use it to increase the quality of the software. Moreover, potential users rely on this information as a success indicator to decide downloading the applications. Since it is usually costly to read all the reviews and evaluate their content, the ratings are taken as the base for the assessment. This makes the consistency of the contents with the ratings of the reviews important for healthy evaluation of the applications. In this study, we use recurrent neural networks to analyze the reviews automatically, and thereby predict the user ratings based on the reviews. We apply transfer learning from a huge volume, gold dataset of Amazon Customer Reviews. We evaluate the performance of our model on three mobile OSS applications in the Google Play Store and compare the predicted ratings and the original ratings of the users. Eventually, the predicted ratings have an accuracy of 87.61% compared to the original ratings of the users, which seems promising to obtain the ratings from the reviews especially if the former is absent or its consistency with the reviews is weak.
CitationGezici, B., Bölücü, N., Tarhan, A. and Can, B. (2019) Neural sentiment analysis of user reviews to predict user ratings, in 2019 4th International Conference on Computer Science and Engineering (UBMK).
DescriptionThis is an accepted manuscript of an article published by IEEE in 2019 4th International Conference on Computer Science and Engineering (UBMK) on 21/11/2019, available online: https://ieeexplore.ieee.org/document/8907234 The accepted version of the publication may differ from the final published version.
Except where otherwise noted, this item's license is described as https://creativecommons.org/licenses/by-nc-nd/4.0/