EigenNoise: A Contrastive Prior to Warm-Start Representations
Novel initialization scheme for word vectors based on dense co-occurrence modeling, achieving competitive performance with GloVe without requiring …
Arxiv-2022
2 posts tagged with arxiv-2022.
To Know by the Company Words Keep and What Else Lies in the Vicinity
Analytical model of statistics learned by Word2Vec and GloVe, deriving the first known solution to Word2Vec's softmax-optimized skip-gram algorithm …