Tensors and Neural Networks for Computational Creativity

Introduction

Creativity in language is ubiquitous. It is abundantly present in work with an explicit creative intention - such as literary novels or poems - but weighty doses of creativity also pervade everyday language use.

Research Objective

We believe that a computational model of creativity that focuses on language will shed light on the enigmatic processes and interactions that come into play when we humans express ourselves in creative ways. Moreover, natural language generation systems - in order to produce realistic utterances - need to be endowed with a certain capacity for creativity.

The main goal of this research project is to develop unsupervised models of language that exhibit creativity.

Proposed Approach

In order to do so, we propose an integrated approach that combines a number of important and innovative techniques:

1. Tensors in Language Representation
   First of all, we rely on constructs from linear algebra called tensors in order to express language content according to different parameters. Using tensors, we are able to induce latent semantics from multi-way co-occurrences of textual content, which can subsequently be used for the generation of creative expressions.

2. Neural Networks for Language Processing
   Secondly, we rely on advanced machine learning techniques, notably neural networks. Neural network techniques have recently shown impressive performance in a number of natural language processing tasks. Yet, these techniques are mainly mimicking human language production, and thus are showing little creativity in language generation.

   By adapting neural network approaches in various ways, as well as integrating them with our tensor-based approach, we expect to develop algorithms that are able to grasp the meaning of textual content in a more profound and elaborate way, and at the same time are able to express it with creative intent.

Potential Impact

The project has the potential for groundbreaking results, not only because it would deepen our understanding of creativity, but also because of practical applications within the field of natural language processing.