AWS Machine Learning

MAY 7, 2024

Amazon Transcribe The transcription for the entire video is generated using the StartTranscriptionJob API. The solution runs Amazon Rekognition APIs for label detection , text detection, celebrity detection , and face detection on videos. The metadata generated for each video by the APIs is processed and stored with timestamps.

APIs 100

APIs Advertising Entertainment Metrics 100

AWS Machine Learning

NOVEMBER 9, 2022

You can easily view the performance metrics for your endpoints in Amazon CloudWatch , automatically scale endpoints based on traffic, and update your models in production without losing any availability. In this post, we discuss SageMaker multi-variant endpoints and best practices for optimization.

Best practices 52

Best practices Construction Metrics Enterprise 52

AWS Machine Learning

NOVEMBER 30, 2023

Let’s say you have a chat application that helps tourists understand local customs and best practices built using two variants of Llama 2: one fine-tuned for European visitors and the other fine-tuned for American visitors. We also walk you through deploying multiple models using inference components and APIs.

APIs 82

APIs Metrics Engineering Best practices 82

AWS Machine Learning

APRIL 23, 2024

The AWS Well-Architected Framework provides best practices and guidelines for designing and operating reliable, secure, efficient, and cost-effective systems in the cloud. It calls the CreateDataSource and DeleteDataSource APIs. Minimally, you must specify the following properties: Name – Specify a name for the knowledge base.

APIs 99

APIs Enterprise Scripts Accountability 99

AWS Machine Learning

OCTOBER 16, 2023

Apart from GPU provisioning, this setup also required data scientists to build a REST API wrapper for each model, which was needed to provide a generic interface for other company services to consume, and to encapsulate preprocessing and postprocessing of model data. Two MMEs were created at Veriff, one for staging and one for production.

APIs 80

APIs Best practices Engineering Metrics 80

AWS Machine Learning

APRIL 29, 2024

This often means the method of using a third-party LLM API won’t do for security, control, and scale reasons. It provides an approachable, robust Python API for the full infrastructure stack of ML/AI, from data and compute to workflows and observability. The following figure illustrates this workflow.

APIs 94

APIs Engineering Scripts Management 94

AWS Machine Learning

NOVEMBER 24, 2023

SageMaker Canvas now collects Amazon CloudWatch metrics that provide insight into app usage and idleness. To limit the cost associated with the workspace instances, as a best practice, you must log out, do not close the browser tab. Today, we’re introducing a new way to further optimize costs for SageMaker Canvas applications.

APIs 87

APIs Metrics Engineering Scripts 87

AWS Machine Learning

FEBRUARY 19, 2024

Inference API – The server exposes an API that allows client applications to send input data and receive predictions from the deployed models. Integration with backend engines – Model servers have integrations with backend frameworks like DeepSpeed and FasterTransformer to partition large models and run highly optimized inference.

APIs 89

APIs Engineering Scripts Metrics 89

Cincom

MAY 8, 2024

Integration with Existing Systems: APIs facilitate data sharing between CPQ and other core platforms like CRM, ERP, accounting, e-commerce, and more. Configurable rules encode compliance requirements and best practices to guide users and skip unnecessary steps. What Makes Cincom’s CPQ Solutions Stand Out?

Enterprise 52

Enterprise Sales CRM Engineering 52

AWS Machine Learning

SEPTEMBER 28, 2023

Customers tell us they need a choice of models, security and privacy assurances, a data-first approach, cost-effective ways to run models, and capabilities like prompt engineering, retrieval augmented generation (RAG), agents, and more to create customized applications.

APIs 112

APIs Enterprise Best practices Government 112

AWS Machine Learning

SEPTEMBER 28, 2023

A Generative AI Gateway can help large enterprises control, standardize, and govern FM consumption from services such as Amazon Bedrock , Amazon SageMaker JumpStart , third-party model providers (such as Anthropic and their APIs), and other model providers outside of the AWS ecosystem. What is a Generative AI Gateway?

APIs 92

APIs Government Enterprise Engineering 92

AWS Machine Learning

JANUARY 26, 2024

The goal of this post is to empower AI and machine learning (ML) engineers, data scientists, solutions architects, security teams, and other stakeholders to have a common mental model and framework to apply security best practices, allowing AI/ML teams to move fast without trading off security for speed.

Best practices 117

Best practices Government Engineering Accountability 117

AWS Machine Learning

APRIL 22, 2024

It provides examples of use cases and best practices for using generative AI’s potential to accelerate sustainability and ESG initiatives, as well as insights into the main operational challenges of generative AI for sustainability. Throughout this lifecycle, implementing AWS Well-Architected Framework best practices is recommended.

Best practices 106

Best practices Benchmark Transportation Engineering 106

AWS Machine Learning

MAY 8, 2023

To serve models, Triton supports various backends as engines to support the running and serving of various ML models for inference. With kernel auto-tuning, the engine selects the best algorithm for the target GPU, maximizing hardware utilization. Import the ONNX model into TensorRT and generate the TensorRT engine.

Engineering 82

Engineering APIs Best practices Scripts 82

AWS Machine Learning

OCTOBER 18, 2023

The solution uses the following services: Amazon API Gateway is a fully managed service that makes it easy for developers to publish, maintain, monitor, and secure APIs at any scale. Purina’s solution is deployed as an API Gateway HTTP endpoint, which routes the requests to obtain pet attributes.

APIs 90

APIs Metrics Consulting Consulting 90

AWS Machine Learning

NOVEMBER 22, 2023

The AWS Well-Architected Framework provides a systematic way for organizations to learn operational and architectural best practices for designing and operating reliable, secure, efficient, cost-effective, and sustainable workloads in the cloud. This helps you avoid throttling limits on API calls due to polling the Get* APIs.

APIs 89

APIs Metrics Enterprise Benchmark 89

AWS Machine Learning

JUNE 27, 2023

This post explains how Provectus and Earth.com were able to enhance the AI-powered image recognition capabilities of EarthSnap, reduce engineering heavy lifting, and minimize administrative costs by implementing end-to-end ML pipelines, delivered as part of a managed MLOps platform and managed AI services.

Engineering 91

Engineering APIs Scripts Entertainment 91

AWS Machine Learning

JANUARY 13, 2023

In 1992, Thomson Reuters (TR) released its first AI legal research service, WIN (Westlaw Is Natural), an innovation at the time, as most search engines only supported Boolean terms and connectors. Historically at TR, ML has been a capability for teams with advanced data scientists and engineers. The challenges. Solution overview.

Government 74

Government Engineering Enterprise APIs 74

AWS Machine Learning

NOVEMBER 22, 2023

It also provides guidance to tackle common challenges, enabling you to architect your IDP workloads according to best practices. Focus areas The design principles and best practices of the Cost Optimization pillar are based on insights gathered from our customers and our IDP technical specialist communities.

Finance 78

Finance Best practices APIs Accountability 78

AWS Machine Learning

APRIL 19, 2024

Solution overview In this section, we present a generic architecture that is similar to the one we use for our own workloads, which allows elastic deployment of models using efficient auto scaling based on custom metrics. The reverse proxy collects metrics about calls to the service and exposes them via a standard metrics API to Prometheus.

Metrics 95

Metrics APIs Scripts Construction 95

AWS Machine Learning

MAY 7, 2024

Rather than requiring extensive feature engineering and dataset labeling, LLMs can be fine-tuned on small amounts of domain-specific data to quickly adapt to new use cases. This post walks through examples of building information extraction use cases by combining LLMs with prompt engineering and frameworks such as LangChain.

Engineering 91

Engineering Technical Support Chatbots Best practices 91

AWS Machine Learning

NOVEMBER 17, 2022

Their production segment is therefore an integral building block for delivering on their mission—with a clearly stated ambition to become world-leading on metrics such as safety, environmental footprint, quality, and production costs. Yara has built APIs using Amazon API Gateway to expose the sensor data to applications such as ELC.

APIs 91

APIs Accountability Metrics Engineering 91

AWS Machine Learning

SEPTEMBER 9, 2022

The platform has shown a 3% boost to customer engagement metrics tracked (liking a show, following a creator, enabling upcoming show notifications) since its launch in May 2022. The independent nature of each individual metric transformation also makes Lambda, which is a stateless service on its own, a good fit for this problem.

Personalization 71

Personalization APIs Engineering Metrics 71

AWS Machine Learning

MARCH 19, 2024

Furthermore, the use of prompt engineering can notably enhance their performance. With the batch inference API, you can use Amazon Bedrock to run inference with foundation models in batches and get responses more efficiently. The service is in preview as of this writing and only available through the API. split("/")[-1]}.out'

APIs 97

APIs Benchmark SaaS Engineering 97

AWS Machine Learning

MAY 30, 2023

Data Wrangler reduces the time it takes to aggregate and prepare data by simplifying the process of data source integration and feature engineering using a single visual interface and a fully distributed data processing environment. Alternatively, you can use the list_processing_jobs API. You can choose from two methods to do this.

Scripts 64

Scripts Best practices Metrics APIs 64

AWS Machine Learning

FEBRUARY 8, 2023

Although you can integrate the model directly into an application, the approach that works well for production-grade applications is to deploy the model behind an endpoint and then invoke the endpoint via a RESTful API call to obtain the inference. The following diagram illustrates these metrics and the endpoint architecture.

Benchmark 74

Benchmark Metrics APIs Engineering 74

AWS Machine Learning

MAY 31, 2023

Triton supports various backends as engines to power the running and serving of different framework models , like PyTorch, TensorFlow, TensorRT, or ONNX Runtime. Triton with PyTorch backend The PyTorch backend is designed to run TorchScript models using the PyTorch C++ API. This is the key differentiator. 4xlarge instance).

APIs 79

APIs Scripts Engineering Accountability 79

AWS Machine Learning

MARCH 13, 2023

This post is co-written with Mahima Agarwal, Machine Learning Engineer, and Deepak Mettem, Senior Engineering Manager, at VMware Carbon Black VMware Carbon Black is a renowned security solution offering protection against the full spectrum of modern cyberattacks.

Engineering 80

Engineering APIs Metrics Management 80

AWS Machine Learning

NOVEMBER 22, 2023

Hear best practices for using unstructured (video, image, PDF), semi-structured (Parquet), and table-formatted (Iceberg) data for training, fine-tuning, checkpointing, and prompt engineering. This session uses the Claude 2 LLM as an example of how prompt engineering helps to solve complex customer use cases.

Engineering 105

Engineering Best practices APIs Government 105

AWS Machine Learning

MAY 9, 2023

In addition, you can now use Application Auto Scaling with provisioned concurrency to address inference traffic dynamically based on target metrics or a schedule. In this post, we discuss what provisioned concurrency and Application Auto Scaling are, how to use them, and some best practices and guidance for your inference workloads.

Metrics 65

Metrics Best practices APIs Engineering 65

AWS Machine Learning

MAY 8, 2023

In this post, we address these limitations by implementing the access control outside of the MLflow server and offloading authentication and authorization tasks to Amazon API Gateway , where we implement fine-grained access control mechanisms at the resource level using Identity and Access Management (IAM). Adds an IAM authorizer.

APIs 69

APIs Government Accountability Scripts 69

AWS Machine Learning

AUGUST 10, 2023

As recommended by AWS as a best practice , customers have used separate accounts to simplify policy management for users and isolate resources by workloads and account. SageMaker services, such as Processing, Training, and Hosting, collect metrics and logs from the running instances and push them to users’ Amazon CloudWatch accounts.

Scripts 77

Scripts Accountability Metrics APIs 77

AWS Machine Learning

DECEMBER 8, 2022

On some large batch ML workloads, ExaDeploy has reduced costs by over 85% without sacrificing on latency or accuracy, with integration time as low as one engineer-day. Out-of-the-box monitoring : ExaDeploy provides Prometheus metrics and Grafana dashboards to visualize accelerator resource usage and other system metrics.

Engineering 67

Engineering APIs Metrics SaaS 67

AWS Machine Learning

NOVEMBER 16, 2022

For an example account structure to follow organizational unit best practices to host models using SageMaker endpoints across accounts, refer to MLOps Workload Orchestrator. Some things to note in the preceding architecture: Accounts follow a principle of least privilege to follow security best practices. Prerequisites.

Accountability 81

Accountability Best practices Scripts Engineering 81

AWS Machine Learning

SEPTEMBER 1, 2023

These teams are as follows: Advanced analytics team (data lake and data mesh) – Data engineers are responsible for preparing and ingesting data from multiple sources, building ETL (extract, transform, and load) pipelines to curate and catalog the data, and prepare the necessary historical data for the ML use cases.

Engineering 98

Engineering Accountability Construction APIs 98

AWS Machine Learning

OCTOBER 5, 2022

Each year, bad actors compromise billions of accounts through stolen credentials, phishing, social engineering, and multiple forms of ATO. For a real-time prediction, you call the GetEventPrediction API after a user presents valid login credentials to quantify the risk of ATO. billion in 2021 compared with 2020. Upload event data.

Accountability 69

Accountability APIs Metrics Engineering 69

AWS Machine Learning

SEPTEMBER 9, 2022

Amp wanted a scalable data and analytics platform to enable easy access to data and perform machine leaning (ML) experiments for live audio transcription, content moderation, feature engineering, and a personal show recommendation service, and to inspect or measure business KPIs and metrics. This post is the first in a two-part series.

Analytics 68

Analytics Engineering APIs Metrics 68