Remove Accountability Remove APIs Remove Government
article thumbnail

Centralize model governance with SageMaker Model Registry Resource Access Manager sharing

AWS Machine Learning

We recently announced the general availability of cross-account sharing of Amazon SageMaker Model Registry using AWS Resource Access Manager (AWS RAM) , making it easier to securely share and discover machine learning (ML) models across your AWS accounts. Human oversight : Including human involvement in AI decision-making processes.

article thumbnail

Governing ML lifecycle at scale: Best practices to set up cost and usage visibility of ML workloads in multi-account environments

AWS Machine Learning

For a multi-account environment, you can track costs at an AWS account level to associate expenses. A combination of an AWS account and tags provides the best results. Tagging is an effective scaling mechanism for implementing cloud management and governance strategies.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Amazon Bedrock launches Session Management APIs for generative AI applications (Preview)

AWS Machine Learning

Amazon Bedrock announces the preview launch of Session Management APIs, a new capability that enables developers to simplify state and context management for generative AI applications built with popular open source frameworks such as LangGraph and LlamaIndex. Building generative AI applications requires more than model API calls.

APIs 119
article thumbnail

Enable Amazon Bedrock cross-Region inference in multi-account environments

AWS Machine Learning

Importantly, cross-Region inference prioritizes the connected Amazon Bedrock API source Region when possible, helping minimize latency and improve overall responsiveness. The customers AWS accounts that are allowed to use Amazon Bedrock are under an Organizational Unit (OU) called Sandbox. Sonnet v2 model using cross-Region inference.

article thumbnail

Secure distributed logging in scalable multi-account deployments using Amazon Bedrock and LangChain

AWS Machine Learning

Some companies go to great lengths to maintain confidentiality, sometimes adopting multi-account architectures, where each customer has their data in a separate AWS account. In this post, we present a solution for securing distributed logging multi-account deployments using Amazon Bedrock and LangChain.

article thumbnail

Build a multi-tenant generative AI environment for your enterprise on AWS

AWS Machine Learning

We also dive deeper into access patterns, governance, responsible AI, observability, and common solution designs like Retrieval Augmented Generation. It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. API Gateway is serverless and hence automatically scales with traffic.

article thumbnail

Improve governance of models with Amazon SageMaker unified Model Cards and Model Registry

AWS Machine Learning

You can now register machine learning (ML) models in Amazon SageMaker Model Registry with Amazon SageMaker Model Cards , making it straightforward to manage governance information for specific model versions directly in SageMaker Model Registry in just a few clicks.