article thumbnail

How Vericast optimized feature engineering using Amazon SageMaker Processing

AWS Machine Learning

This includes gathering, exploring, and understanding the business and technical aspects of the data, along with evaluation of any manipulations that may be needed for the model building process. One aspect of this data preparation is feature engineering. However, generalizing feature engineering is challenging.

article thumbnail

Use AWS PrivateLink to set up private access to Amazon Bedrock

AWS Machine Learning

It allows developers to build and scale generative AI applications using FMs through an API, without managing infrastructure. Customers are building innovative generative AI applications using Amazon Bedrock APIs using their own proprietary data.

APIs 121
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Use Amazon SageMaker pipeline sharing to view or manage pipelines across AWS accounts

AWS Machine Learning

You can now use cross-account support for Amazon SageMaker Pipelines to share pipeline entities across AWS accounts and access shared pipelines directly through Amazon SageMaker API calls. To further monitor those workflows, data scientists now require cross-account read-only permission to the deployed pipeline in the test account.

article thumbnail

Use RAG for drug discovery with Knowledge Bases for Amazon Bedrock

AWS Machine Learning

The Retrieve and RetrieveAndGenerate APIs allow your applications to directly query the index using a unified and standard syntax without having to learn separate APIs for each different vector database, reducing the need to write custom index queries against your vector store.

APIs 110
article thumbnail

­­Speed ML development using SageMaker Feature Store and Apache Iceberg offline store compaction

AWS Machine Learning

As feature data grows in size and complexity, data scientists need to be able to efficiently query these feature stores to extract datasets for experimentation, model training, and batch scoring. SageMaker Feature Store automatically builds an AWS Glue Data Catalog during feature group creation.

Scripts 73
article thumbnail

Amazon SageMaker Feature Store now supports cross-account sharing, discovery, and access

AWS Machine Learning

Let’s demystify this using the following personas and a real-world analogy: Data and ML engineers (owners and producers) – They lay the groundwork by feeding data into the feature store Data scientists (consumers) – They extract and utilize this data to craft their models Data engineers serve as architects sketching the initial blueprint.

article thumbnail

Simplify data prep for generative AI with Amazon SageMaker Data Wrangler

AWS Machine Learning

Let’s invoke the Amazon OpenSearch API to search relevant documents for the generated vector embeddings. The same feature engineering code is often run again and again, wasting time and compute resources on repeating the same operations. To avoid the reprocessing of features, we’ll export our data flow to an Amazon SageMaker pipeline.