Skip to main content

Leverage pre-trained models and transfer learning for AI/ML development

Description

Training an AI model has a significant carbon footprint. As part of your AI/ML process, you should evaluate using a pre-trained model and use transfer learning to avoid training a new model from scratch.

Solution

Evaluate and select pre-trained models and use transfer learning to avoid training a new model from scratch.

SCI Impact

SCI = (E * I) + M per R

Software Carbon Intensity Spec

Leveraging a pre-trained model would impact SCI as follows:

  • E: Having a pre-trained model reduces energy consumption for your AI/ML development as you don’t need to train the entire model from scratch.
  • M: Transfer learning does not require as many servers as you don’t need to train the entire model from scratch. By reducing the total number of servers required to run a process, the total embodied carbon is lower.

Assumptions

None

Considerations

None

References