Event · 2013-01
Machine perception
Word2vec
Word meaning became geometry: similar words occupied nearby regions of a learned vector space.
Word2vec showed that useful relationships between words could emerge from predicting context without a hand-built feature dictionary. Vector representations became a transferable internal language for neural networks and helped prepare the move from task-specific classifiers to large pretrained models.
Sources
arXivOpen primary source