Accelerated PyTorch inference with torch.compile on AWS Graviton processors aws.amazon.com Post date July 2, 2024 No Comments on Accelerated PyTorch inference with torch.compile on AWS Graviton processors External Tags Amazon EC2, Amazon Machine Learning, best-practices, Expert (400), Graviton, how-to, Natural Language Processing, open source, pytorch, PyTorch on AWS, Technical How-to
Host the Whisper Model on Amazon SageMaker: exploring inference options aws.amazon.com Post date January 16, 2024 No Comments on Host the Whisper Model on Amazon SageMaker: exploring inference options External Tags Advanced (300), Amazon SageMaker, best-practices, PyTorch on AWS, Technical How-to
Enable faster training with Amazon SageMaker data parallel library aws.amazon.com Post date December 5, 2023 No Comments on Enable faster training with Amazon SageMaker data parallel library External Tags Amazon SageMaker, Announcements, artificial-intelligence, Expert (400), pytorch, PyTorch on AWS
Optimize AWS Inferentia utilization with FastAPI and PyTorch models on Amazon EC2 Inf1 & Inf2 instances aws.amazon.com Post date July 24, 2023 No Comments on Optimize AWS Inferentia utilization with FastAPI and PyTorch models on Amazon EC2 Inf1 & Inf2 instances External Tags AWS Inferentia, pytorch, PyTorch on AWS
Fine-tune GPT-J using an Amazon SageMaker Hugging Face estimator and the model parallel library aws.amazon.com Post date June 12, 2023 No Comments on Fine-tune GPT-J using an Amazon SageMaker Hugging Face estimator and the model parallel library External Tags Amazon SageMaker, best-practices, generative-ai, PyTorch on AWS, Technical How-to
Host ML models on Amazon SageMaker using Triton: CV model with PyTorch backend aws.amazon.com Post date May 31, 2023 No Comments on Host ML models on Amazon SageMaker using Triton: CV model with PyTorch backend External Tags Advanced (300), Amazon SageMaker, PyTorch on AWS, Technical How-to