Artificial Intelligence
27 notes in this chapter
Artificial Intelligence MOC
27 core AI concepts, from classical foundations to modern LLM agents. Each note has: definition, how it works, why it matters, common pitfalls, related terms, and a concrete example.
Foundations
Language & NLP
- Natural Language Processing (NLP)
- Tokenization
- Embeddings
- Large Language Model (LLM)
- Transformer Architecture
- Attention Mechanism
- Prompt Engineering
- Retrieval-Augmented Generation (RAG)
- Fine-Tuning
- Hallucination
- Cosine Similarity
Vision & Perception
Agents & Systems
- Multi-Agent System
- Function Calling (Tool Use)
- Model Context Protocol (MCP)
- Agent SDKs and Frameworks
- RLHF (Reinforcement Learning from Human Feedback)
Ethics & Safety
How to use this
Skim a category before diving into an AI project or reading a paper. For the underlying math/architecture (neural nets, gradients, training), see Machine Learning and Deep Learning Terms MOC.
Suggested order if starting from zero
- Intelligent Agent → Search Algorithms → Knowledge Representation — the classical AI mindset
- Tokenization → Embeddings → Transformer Architecture → Attention Mechanism — how modern language models actually work
- Large Language Model (LLM) → Hallucination → Retrieval-Augmented Generation (RAG) → Prompt Engineering — using LLMs in practice
- Function Calling (Tool Use) → Model Context Protocol (MCP) → Agent SDKs and Frameworks → Multi-Agent System — building AI agents
- AI Alignment → AI Bias and Fairness → Explainable AI (XAI) — the responsibility layer