6
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Offensive Language and Hate Speech Detection for Danish

      Preprint
      ,

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          The presence of offensive language on social media platforms and the implications this poses is becoming a major concern in modern society. Given the enormous amount of content created every day, automatic methods are required to detect and deal with this type of content. Until now, most of the research has focused on solving the problem for the English language, while the problem is multilingual. We construct a Danish dataset containing user-generated comments from \textit{Reddit} and \textit{Facebook}. It contains user generated comments from various social media platforms, and to our knowledge, it is the first of its kind. Our dataset is annotated to capture various types and target of offensive language. We develop four automatic classification systems, each designed to work for both the English and the Danish language. In the detection of offensive language in English, the best performing system achieves a macro averaged F1-score of \(0.74\), and the best performing system for Danish achieves a macro averaged F1-score of \(0.70\). In the detection of whether or not an offensive post is targeted, the best performing system for English achieves a macro averaged F1-score of \(0.62\), while the best performing system for Danish achieves a macro averaged F1-score of \(0.73\). Finally, in the detection of the target type in a targeted offensive post, the best performing system for English achieves a macro averaged F1-score of \(0.56\), and the best performing system for Danish achieves a macro averaged F1-score of \(0.63\). Our work for both the English and the Danish language captures the type and targets of offensive language, and present automatic methods for detecting different kinds of offensive language such as hate speech and cyberbullying.

          Related collections

          Most cited references4

          • Record: found
          • Abstract: not found
          • Conference Proceedings: not found

          Hateful Symbols or Hateful People? Predictive Features for Hate Speech Detection on Twitter

            Bookmark
            • Record: found
            • Abstract: not found
            • Conference Proceedings: not found

            Deep Learning for Hate Speech Detection in Tweets

              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Data Statements for Natural Language Processing: Toward Mitigating System Bias and Enabling Better Science

              In this paper, we propose data statements as a design solution and professional practice for natural language processing technologists, in both research and development. Through the adoption and widespread use of data statements, the field can begin to address critical scientific and ethical issues that result from the use of data from certain populations in the development of technology for other populations. We present a form that data statements can take and explore the implications of adopting them as part of regular practice. We argue that data statements will help alleviate issues related to exclusion and bias in language technology, lead to better precision in claims about how natural language processing research can generalize and thus better engineering results, protect companies from public embarrassment, and ultimately lead to language technology that meets its users in their own preferred linguistic style and furthermore does not misrepresent them to others.
                Bookmark

                Author and article information

                Journal
                13 August 2019
                Article
                1908.04531
                1595fed2-7167-4cb2-858e-75a2f19f4d57

                http://creativecommons.org/licenses/by/4.0/

                History
                Custom metadata
                cs.CL

                Theoretical computer science
                Theoretical computer science

                Comments

                Comment on this article