A Taxonomy for Deep Learning in Natural Language Processing

Abstract

Despite a large number of available techniques around Deep Learning in Natural Language Processing (NLP), no holistic framework exists which supports researchers and practitioners to organise knowledge when designing, comparing and evaluating NLP applications. This paper addresses this lack of a holistic framework by developing a taxonomy for Deep Learning in Natural Language Processing. Based on a systematic literature review as proposed by Webster and Watson and vom Brocke et al. and the iterative taxonomy development process of Nickerson et al. we derived five novel dimensions and 38 characteristics based on a sample of 205 papers. Our research suggests, that a Deep Learning NLP approach can be distinguished by five dimensions which were partly derived from the CRISP-DM methodology: application understanding, data preparation, modeling, learning technique and evaluation. We, therefore, hope to provide guidance and support for researchers and practitioners when using Deep Learning for NLP to design, compare and evaluate NLP applications.