NLP Core Concepts for Generative AI Engineers: Tokenization & Embeddings

Master the foundational NLP concepts of tokenization and embeddings essential for designing, developing, and fine-tuning large-scale generative AI models.
...

Tokenization Strategies for Large Language Models

Unit 1: The Tokenization Foundation

Unit 2: Advanced Tokenization Strategies

Unit 3: Practical Tokenization for LLMs

Understanding and Applying Embeddings in Generative AI

Unit 1: The Essence of Embeddings

Unit 2: Types of Embeddings

Unit 3: Embeddings in Practice