{"id":7573,"date":"2025-05-17T02:16:06","date_gmt":"2025-05-16T17:16:06","guid":{"rendered":"https:\/\/aireviewirush.com\/?p=7573"},"modified":"2025-05-17T02:16:06","modified_gmt":"2025-05-16T17:16:06","slug":"new-amazon-ec2-p6-b200-cases-powered-by-nvidia-blackwell-gpus-to-speed-up-ai-improvements","status":"publish","type":"post","link":"https:\/\/aireviewirush.com\/?p=7573","title":{"rendered":"New Amazon EC2 P6-B200 cases powered by NVIDIA Blackwell GPUs to speed up AI improvements"},"content":{"rendered":"


\n<\/p>\n

\n\n\n\n
\n
\n \"Voiced<\/a>\n <\/div>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

As we speak, we\u2019re saying the overall availability of Amazon Elastic Compute Cloud (Amazon EC2)<\/a> P6-B200 cases<\/a> powered by NVIDIA B200 to handle buyer wants for prime efficiency and scalability in synthetic intelligence (AI)<\/a>, machine studying (ML)<\/a>, and excessive efficiency computing (HPC)<\/a> functions.<\/p>\n

Amazon EC2 P6-B200 cases speed up a broad vary of GPU-enabled workloads however are particularly well-suited for large-scale distributed AI coaching and inferencing for basis fashions (FMs)<\/a> with reinforcement studying (RL) and distillation, multimodal coaching and inference, and HPC functions similar to local weather modeling, drug discovery, seismic evaluation, and insurance coverage threat modeling.<\/p>\n

When mixed with Elastic Material Adapter<\/a> (EFAv4) networking, hyperscale clustering by EC2 UltraClusters<\/a>, and superior virtualization and safety capabilities by AWS Nitro System<\/a>, you possibly can prepare and serve FMs with elevated velocity, scale, and safety. These cases additionally ship as much as two instances the efficiency for AI coaching (time to coach) and inference (tokens\/sec) in comparison with EC2 P5en cases<\/a>.<\/p>\n

You’ll be able to speed up time-to-market for coaching FMs and ship sooner inference throughput, which lowers inference price and helps enhance adoption of generative AI functions in addition to elevated processing efficiency for HPC functions.<\/p>\n

EC2 P6-B200 cases specs<\/u><\/strong>
New EC2 P6-B200 cases present eight NVIDIA B200 GPUs with 1440 GB of excessive bandwidth GPU reminiscence, fifth Era Intel Xeon Scalable processors (Emerald Rapids), 2 TiB of system reminiscence, and 30 TB of native NVMe storage.<\/p>\n

Listed below are the specs for EC2 P6-B200 cases:<\/p>\n\n\n\n\n
Occasion dimension<\/strong><\/td>\nGPUs (NVIDIA B200)<\/strong><\/td>\nGPU
reminiscence (GB)<\/strong><\/td>\n		vCPUs<\/strong><\/td>\nGPU Peer to see (GB\/s)<\/strong><\/td>\nOccasion storage (TB)<\/strong><\/td>\nCommunity bandwidth (Gbps)<\/strong><\/td>\nEBS bandwidth (Gbps)<\/strong><\/td>\n<\/tr>\n
P6-b200.48xlarge<\/strong><\/td>\n8<\/td>\n1440 HBM3e<\/td>\n192<\/td>\n1800<\/td>\n8 x 3.84 NVMe SSD<\/td>\n8 x 400<\/td>\n100<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

These cases characteristic as much as 125 % enchancment in GPU TFLOPs, 27 % enhance in GPU reminiscence dimension, and 60 % enhance in GPU reminiscence bandwidth in comparison with P5en cases.<\/p>\n

P6-B200 cases in motion<\/u><\/strong>
You need to use P6-B200 cases within the US West (Oregon) AWS Area<\/a> by way of EC2 Capability Blocks for ML<\/a>. To order your EC2 Capability Blocks, select Capability Reservations<\/strong> on the Amazon EC2 console<\/a>.<\/p>\n

\"\"<\/p>\n

Choose Buy Capability Blocks for ML<\/strong> after which select your complete capability and specify how lengthy you want the EC2 Capability Block for p6-b200.48xlarge<\/strong> cases. The entire variety of days you can reserve EC2 Capability Blocks is 1-14 days, 21 days, 28 days, or multiples of seven as much as 182 days. You’ll be able to select your earliest begin date for as much as 8 weeks upfront.<\/p>\n

Now, your EC2 Capability Block shall be scheduled efficiently. The entire worth of an EC2 Capability Block is charged up entrance, and the worth doesn\u2019t change after buy. The fee shall be billed to your account inside 12 hours after you buy the EC2 Capability Blocks. To be taught extra, go to Capability Blocks for ML<\/a> within the Amazon EC2 Person Information.<\/p>\n

When launching P6-B200 cases, you should utilize AWS Deep Studying AMIs<\/a> (DLAMI) to assist EC2 P6-B200 cases. DLAMI supplies ML practitioners and researchers with the infrastructure and instruments to rapidly construct scalable, safe, distributed ML functions in preconfigured environments.<\/p>\n

To run cases, you should utilize AWS Administration Console<\/a>, AWS Command Line Interface (AWS CLI)<\/a> or AWS SDKs<\/a>.<\/p>\n

You’ll be able to combine EC2 P6-B200 cases seamlessly with varied AWS managed providers similar to Amazon Elastic Kubernetes Companies (Amazon EKS)<\/a>, Amazon Easy Storage Service (Amazon S3)<\/a>, and Amazon FSx for Lustre<\/a>. Help for Amazon SageMaker HyperPod<\/a> can be coming quickly.<\/p>\n

Now accessible<\/u><\/strong>
Amazon EC2 P6-B200 cases can be found in the present day within the US West (Oregon) Area and could be bought as EC2 Capability blocks for ML<\/a>.<\/p>\n

Give Amazon EC2 P6-B200 cases a attempt within the Amazon EC2 console<\/a>. To be taught extra, discuss with the Amazon EC2 P6 occasion web page<\/a> and ship suggestions to AWS re:Submit for EC2<\/a> or by way of your typical AWS Help contacts.<\/p>\n

\u2014 Channy<\/a><\/p>\n\n

How is the Information Weblog doing? Take this 1 minute survey<\/a>!<\/p>\n

(This survey<\/a> is hosted by an exterior firm. AWS handles your data as described within the AWS Privateness Discover<\/a>. AWS will personal the information gathered by way of this survey and won’t share the knowledge collected with survey respondents.)<\/em><\/p>\n

\n <\/div>\n