Amazon data center Available

AWS Trainium2

Trainium ยท Trainium 2nd Gen Architecture

AWS Trainium2 is Amazon's next-generation custom AI training chip, delivering 4x the compute performance of the first-generation Trainium. Designed for training the largest foundation models, Trainium2 powers EC2 Trn2 instances and UltraClusters connecting tens of thousands of chips via high-bandwidth interconnect. It is the chip behind Amazon's own foundation models and is optimized for use with the AWS Neuron SDK.

Key Features

4x performance over Trainium NeuronCore architecture High-bandwidth chip-to-chip interconnect EC2 Trn2 instances AWS Neuron SDK support

Full Specifications

Compute

Architecture Trainium2

Memory

Memory Type HBM

Power & Physical

Form Factor Custom ASIC

Features & Connectivity

NVLink Support No
Multi-GPU Support Yes

Availability

MSRP (USD) Contact for pricing
Release Date Nov 2024
Status Available

Industries

Use Cases

LLM Training Foundation Model Training Generative AI Multi-modal AI Training

Interested in the AWS Trainium2?

Get pricing, availability, and bulk discount information from our team.

Enquire Now

Related GPUs

Amazon data center

AWS Trainium

Memory

512GB HBM (per node)

FP16

190 TFLOPS

Available View Specs
Amazon data center

AWS Inferentia2

Memory

32GB HBM

FP16

190 TFLOPS

Available View Specs
Amazon data center

AWS Inferentia

Memory

8GB DDR4

Available View Specs