Accelerate Amazon SageMaker inference with C6i Intel-based Amazon EC2 instances
AWS Machine Learning
MARCH 20, 2023
Overview of the technology EC2 C6i instances are powered by third-generation Intel Xeon Scalable processors (also called Ice Lake) with an all-core turbo frequency of 3.5 Refer to the appendix for instance details and benchmark data. We use Intel extensions for PyTorch for an effective INT8 deployment workflow.
Let's personalize your content