Advanced TopicsΒΆ

:gutter: 3

Single GPU Billion-scale Model Training via Parameter-Efficient Finetuning

:link: efficient_finetuning_basic.html

How to take advantage of large foundation models with the help of parameter-efficient finetuning. In the tutorial, we will use combine IA^3, BitFit, and gradient checkpointing to finetune FLAN-T5-XL.

Hyperparameter Optimization in AutoMM

:link: hyperparameter_optimization.html

How to do hyperparameter optimization in AutoMM.

Knowledge Distillation in AutoMM

:link: model_distillation.html

How to do knowledge distillation in AutoMM.

Customize AutoMM

:link: customization.html

How to customize AutoMM configurations.

AutoMM Presets

:link: presets.html

How to use AutoMM presets.

Few Shot Learning with AutoMM

:link: few_shot_learning.html

How to use foundation models + SVM for few shot learning.

Handling Class Imbalance with AutoMM - Focal Loss

:link: focal_loss.html

How to use AutoMM to handle class imbalance.

Faster Prediction with TensorRT

:link: tensorrt.html

How to use TensorRT in accelerating AutoMM model inference.

Continuous Training with AutoMM

:link: continuous_training.html

Different use cases for continuous training with AutoMM.