Intel data center Available

Intel Gaudi 3

Gaudi ยท Gaudi 3 Architecture

The Intel Gaudi 3 is a purpose-built AI training accelerator designed to compete with NVIDIA H100. With 128GB of HBM2e memory, 64 Tensor Processor Cores, and 1835 TFLOPS of BF16 performance, it delivers exceptional price-performance for large language model training and generative AI workloads. Built on an open software ecosystem, Gaudi 3 offers a cost-effective alternative for enterprises building AI infrastructure.

Key Features

64 Tensor Processor Cores 128GB HBM2e 3.7 TB/s memory bandwidth Integrated RoCE networking Native BF16/FP8 support Open software stack

Full Specifications

Compute

Architecture Gaudi
Process Node 5nm TSMC
Tensor Processor Cores 64
Tensor Cores 64
Boost Clock 1850 MHz
FP16 Performance 1835 TFLOPS
BF16 Performance 1835 TFLOPS
INT8 Performance 3670 TOPS

Memory

Memory Size 128 GB
Memory Type HBM2e
Memory Bus 8192-bit
Memory Bandwidth 3700 GB/s

Power & Physical

TDP 900W
Form Factor OAM
Power Connectors OAM connector

Features & Connectivity

PCIe Version PCIe 5.0
NVLink Support No
Multi-GPU Support Yes

Availability

MSRP (USD) Contact for pricing
Release Date Apr 2024
Status Available

Industries

Use Cases

LLM Training Large-scale Inference Generative AI Deep Learning Recommendation Systems

Interested in the Intel Gaudi 3?

Get pricing, availability, and bulk discount information from our team.

Enquire Now

Related GPUs

Intel data center

Intel Gaudi 2

Memory

96GB HBM2e

TDP

600W

FP16

865 TFLOPS

Available View Specs
Intel data center

Intel Data Center GPU Max 1550

Memory

128GB HBM2e

FP32

52 TFLOPS

TDP

600W

FP16

104 TFLOPS

Available View Specs
Intel data center

Intel Data Center GPU Max 1100

Memory

48GB HBM2e

FP32

22 TFLOPS

TDP

300W

FP16

44 TFLOPS

Available View Specs