Skip to main content

Optimize the size of AI/ML models

Description

Large-scale AI/ML models require significant storage space and take more resources to run as compared to optimized models.

Solution

Optimizing the size of the AI/ML model can save on storage space and take up less memory. Apply strategies like quantization and evaluate the optimization changes against the desired accuracy.

SCI Impact

SCI = (E * I) + M per R

Software Carbon Intensity Spec

Optimizing the AI/ML model impacts SCI as follows:

  • E: Having an optimized AI model would reduce the energy consumption for your AI/ML inference, save storage space and network bandwidth and consequently, the E number should decrease.

Assumptions

None

Considerations

None

References

Model optimization