From Encodings to Embeddings