Foundation Model

• Foundation Models are trained on a wide variety of input data (unlabeled data)
• Foundation models may cost tens of millions of dollars to train
• FMs can be fine-tuned if necessary to better fit the use-case

Generative modality

• Modalities
• Text: LLMs
• Image: Diffusion models
• Vision

• Embedding

• Some models are multimodal