Foundation Models - Study Materials

Foundation Models Learning Guide

00_Overview.md

Foundation Model Paradigm

01_Foundation_Model_Paradigm.md

Scaling Laws

02_Scaling_Laws.md

Emergent Abilities

03_Emergent_Abilities.md

04. Pre-training Objectives

04_Pretraining_Objectives.md

05. Data Curation

05_Data_Curation.md

06. Pre-training Infrastructure

06_Pretraining_Infrastructure.md

07. Tokenization Deep Dive

07_Tokenization_Deep_Dive.md

LLaMA Family

08_LLaMA_Family.md

Mistral & Mixture of Experts

09_Mistral_MoE.md

10. Long Context Models

10_Long_Context_Models.md

11. Small Language Models

11_Small_Language_Models.md

DINOv2 & Self-Supervised Vision

12_DINOv2_Self_Supervised.md

Segment Anything Model (SAM)

13_Segment_Anything.md

14. Unified Vision Models

14_Unified_Vision_Models.md

15. Advanced Image Generation

15_Image_Generation_Advanced.md

16. Advanced Vision-Language

16_Vision_Language_Advanced.md

17. GPT-4V, GPT-4o, Gemini & Claude 3

17_GPT4V_Gemini.md

18. Audio/Video Foundation Models

18_Audio_Video_Foundation.md

19. PEFT (Parameter-Efficient Fine-Tuning) Unified

19_PEFT_Unified.md

20. Instruction Tuning

20_Instruction_Tuning.md

21. Continued Pre-training

21_Continued_Pretraining.md

22. Inference Optimization

22_Inference_Optimization.md

23. Advanced RAG

23_Advanced_RAG.md

24. API & Evaluation

24_API_and_Evaluation.md

25. Research Frontiers

25_Research_Frontiers.md