🔮The Codex
Embedding
A numerical representation of text that captures its meaning in a format AI can process.
📖 Apprentice Explanation
Embeddings turn words and sentences into numbers that represent their meaning. Similar concepts get similar numbers, which helps AI understand relationships between ideas.
🧙 Archmage Notes
Text embeddings map tokens to dense vectors in high-dimensional space. Modern embedding models (e.g., OpenAI ada-002, Cohere embed) produce vectors of 768-3072 dimensions. Used in semantic search, clustering, and RAG systems.