Blog
About

6
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Unsupervised Identification of Translationese

      Preprint

      ,

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Translated texts are distinctively different from original ones, to the extent that supervised text classification methods can distinguish between them with high accuracy. These differences were proven useful for statistical machine translation. However, it has been suggested that the accuracy of translation detection deteriorates when the classifier is evaluated outside the domain it was trained on. We show that this is indeed the case, in a variety of evaluation scenarios. We then show that unsupervised classification is highly accurate on this task. We suggest a method for determining the correct labels of the clustering outcomes, and then use the labels for voting, improving the accuracy even further. Moreover, we suggest a simple method for clustering in the challenging case of mixed-domain datasets, in spite of the dominance of domain-related features over translation-related ones. The result is an effective, fully-unsupervised method for distinguishing between original and translated texts that can be applied to new domains with reasonable accuracy.

          Related collections

          Most cited references 10

          • Record: found
          • Abstract: not found
          • Article: not found

          Least squares quantization in PCM

           S E Lloyd (1982)
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            The WEKA data mining software

              Bookmark
              • Record: found
              • Abstract: not found
              • Article: not found

              Divergence measures based on the Shannon entropy

               J J Lin (1991)
                Bookmark

                Author and article information

                Journal
                2016-09-11
                1609.03205

                http://arxiv.org/licenses/nonexclusive-distrib/1.0/

                Custom metadata
                TACL2015, 14 pages
                cs.CL

                Theoretical computer science

                Comments

                Comment on this article