Abstract
In this study, we approach the problem of distinguishing general profanity from hate speech in social media, something which has not been widely considered. Using a new dataset annotated specifically for this task, we employ supervised classification along with a set of features that includes -grams, skip-grams and clustering-based word representations. We apply approaches based on single classifiers as well as more advanced ensemble classifiers and stacked generalisation, achieving the best result of accuracy for this 3-class classification task. Analysis of the results reveals that discriminating hate speech and profanity is not a simple task, which may require features that capture a deeper understanding of the text not always possible with surface -grams. The variability of gold labels in the annotated data, due to differences in the subjective adjudications of the annotators, is also an issue. Other directions for future work are discussed.Citation
Malmasi, S., Zampieri, M. (2017) 'Challenges in discriminating profanity from hate speech'. Journal of Experimental & Theoretical Artificial Intelligence, 30 (2), pp. 187-202.Publisher
Taylor & FrancisJournal
Journal of Experimental & Theoretical Artificial IntelligenceAdditional Links
https://www.tandfonline.com/doi/full/10.1080/0952813X.2017.1409284Type
Journal articleLanguage
enDescription
This is an accepted manuscript of an article published by Taylor and Francis in Journal of Experimental & Theoretical Artificial Intelligence on 13/12/2017, available online: https://doi.org/10.1080/0952813X.2017.1409284 The accepted version of the publication may differ from the final published version.ISSN
0952-813Xae974a485f413a2113503eed53cd6c53
10.1080/0952813X.2017.1409284
Scopus Count
Collections
The following licence applies to the copyright and re-use of this item:
- Creative Commons
Except where otherwise noted, this item's license is described as https://creativecommons.org/CC BY-NC-ND 4.0