Comparative Study of CNN and RNN for Natural Language Processing

There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

Abstract

Deep neural networks (DNN) have revolutionized the field of natural language processing (NLP). Convolutional neural network (CNN) and recurrent neural network (RNN), the two main types of DNN architectures, are widely explored to handle various NLP tasks. CNN is supposed to be good at extracting position-invariant features and RNN at modeling units in sequence. The state of the art on many NLP tasks often switches due to the battle between CNNs and RNNs. This work is the first systematic comparison of CNN and RNN on a wide range of representative NLP tasks, aiming to give basic guidance for DNN selection.

Related collections

Most cited references 5

Record: found
Abstract: not found
Conference Proceedings: not found

Document Modeling with Gated Recurrent Neural Network for Sentiment Classification

Duyu Tang, Ting Ting Liu, Bing Qin (2015)

0 comments Cited 155 times – based on 0 reviews

Bookmark

Record: found
Abstract: not found
Conference Proceedings: not found

Domain adaptation with structural correspondence learning

John Blitzer, Ryan McDonald, Fernando Levino Pereira (2006)

0 comments Cited 152 times – based on 0 reviews

Bookmark

Record: found
Abstract: found
Article: found

Is Open Access

A large annotated corpus for learning natural language inference

Gabor Angeli, Christopher Potts, Christopher D Manning … (2015)

Understanding entailment and contradiction is fundamental to understanding natural language, and inference about entailment and contradiction is a valuable testing ground for the development of semantic representations. However, machine learning research in this area has been dramatically limited by the lack of large-scale resources. To address this, we introduce the Stanford Natural Language Inference corpus, a new, freely available collection of labeled sentence pairs, written by humans doing a novel grounded task based on image captioning. At 570K pairs, it is two orders of magnitude larger than all other resources of its type. This increase in scale allows lexicalized classifiers to outperform some sophisticated existing entailment models, and it allows a neural network-based model to perform competitively on natural language inference benchmarks for the first time.