Introducing the Amazon SageMaker Serverless Inference Benchmarking Toolkit
AWS Machine Learning
OCTOBER 26, 2022
To help determine whether a serverless endpoint is the right deployment option from a cost and performance perspective, we have developed the SageMaker Serverless Inference Benchmarking Toolkit , which tests different endpoint configurations and compares the most optimal one against a comparable real-time hosting instance. Solution overview.
Let's personalize your content