Back to section
Event · 2014-09

Machine perception

Sequence to Sequence

One network encoded a sequence and another generated a new one, creating a general template for translation and generation.

Seq2Seq separated input encoding from output generation and showed that a learned system could translate without hand-written linguistic rules. The bottleneck of a fixed memory vector later helped motivate attention.

Sources
arXivOpen primary source