Remove Analytics Remove APIs Remove Benchmark Remove Calibration
article thumbnail

Face-off Probability, part of NHL Edge IQ: Predicting face-off winners in real time during televised games

AWS Machine Learning

We explored nearest neighbors, decision trees, neural networks, and also collaborative filtering in terms of algorithms, while trying different sampling strategies (filtering, random, stratified, and time-based sampling) and evaluated performance on Area Under the Curve (AUC) and calibration distribution along with Brier score loss.

article thumbnail

Boost inference performance for Mixtral and Llama 2 models with new Amazon SageMaker containers

AWS Machine Learning

In this post, we explore the latest features introduced in this release, examine performance benchmarks, and provide a detailed guide on deploying new LLMs with LMI DLCs at high performance. Be mindful that LLM token probabilities are generally overconfident without calibration. Qing Lan is a Software Development Engineer in AWS.