From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Amazon· Bedrock / NovaSimplify and support your TorchServe workloads using Ray Serve Deep Learning Containers
AWS announced the Ray Serve Deep Learning Container (DLC), a pre-built Docker image for model inference that bundles PyTorch, Ray Serve, and the GPU stack.
The post demonstrates deploying a Qwen3-VL-2B vision-language model on Amazon EKS using the new container.
From the source
With the launch of the Ray Serve DLC , that same approach now extends to inference. You get a container purpose-built for serving models behind an HTTP endpoint, maintained and tested by AWS, with the full inference stack already assembled.
aws.amazon.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCoreAmazon · 2 OctFine-tune a search agent with multi-turn RL on Amazon SageMaker AIAmazon · 1 OctServe live, governed data in AI-built apps with Amazon Quick