Remove 2012 Remove Big data Remove Examples Remove Scripts
article thumbnail

Machine learning with decentralized training data using federated learning on Amazon SageMaker

AWS Machine Learning

Usually, if the dataset or model is too large to be trained on a single instance, distributed training allows for multiple instances within a cluster to be used and distribute either data or model partitions across those instances during the training process. We use a VPC peering configuration within the Region in this example.

Scripts 72
article thumbnail

Securing MLflow in AWS: Fine-grained access control with AWS native services

AWS Machine Learning

We provide examples demonstrating experiment tracking and using the model registry with MLflow from SageMaker training jobs and Studio, respectively, in the provided notebook. The following code is an example of the buildspec.yaml file: version: "1.0" How to use MLflow as a centralized repository in a multi-account setup.

APIs 72
article thumbnail

Four approaches to manage Python packages in Amazon SageMaker Studio notebooks

AWS Machine Learning

A public GitHub repo provides hands-on examples for each of the presented approaches. When you open a notebook in Studio, you are prompted to set up your environment by choosing a SageMaker image, a kernel, an instance type, and, optionally, a lifecycle configuration script that runs on image startup. Define a Dockerfile.