New NVIDIA B300 · 288 GB HBM3e servers — from $4,019/mo per GPU

See the B300

GPU comparison · Blackwell vs Ada Lovelace

NVIDIA RTX 5090 vs L40S.

A Blackwell GeForce card against the Ada data-center GPU. The L40S has 48 GB of GDDR6 with ECC, about 1.75× the dense FP8 throughput and servers of up to 8 GPUs. The RTX 5090 has 32 GB of GDDR7, about twice the memory bandwidth (1.79 against 0.86 TB/s), FP4 tensor cores and costs $329 against $789 per GPU per month.

  • 32 vs 48 GBGPU memory
  • 1.79 vs 0.86 TB/smemory bandwidth
  • $329 vs $789per GPU, per month

RTX 5090 vs L40S: which one to rent.

Choose the RTX 5090 if

  • Your model fits in 32 GB per card: up to about 24B parameters in FP8 or 45B in 4-bit by our sizing rule.
  • Your workload is bound by memory bandwidth rather than tensor throughput, such as single-user token generation on a model that fits.
  • You want the lower price per GB of GPU memory: $10.28 against $16.44 a month.

NVIDIA RTX 5090 servers from $329/mo

Choose the L40S if

  • Your model needs more than 32 GB per GPU: 48 GB holds about 36B parameters in FP8 or 67B in 4-bit by our sizing rule.
  • You need ECC memory or a server of 8 GPUs: GeForce servers stop at 4 cards.
  • You serve in FP8 at volume: 733 TFLOPS of dense FP8 tensor throughput against 419 on the RTX 5090.

NVIDIA L40S servers from $789/mo

RTX 5090 vs L40S specs, side by side.

Figures from NVIDIA’s published specifications, per GPU. Tensor figures are peak dense throughput.

RTX 5090 vs L40S specifications
Per GPUNVIDIA RTX 5090NVIDIA L40SL40S / RTX 5090
ArchitectureBlackwellAda Lovelace—
Form factorPCIe Gen5 graphics cardDual-slot PCIe card, passive—
GPU memory32 GB GDDR7, 512-bit48 GB GDDR6 with ECC1.5×
Memory bandwidth1,792 GB/s864 GB/s0.48×
GPU-to-GPU linkNone (PCIe Gen5)None (PCIe Gen4 x16)—
FP4 tensor (dense)1.7 PFLOPSNot supported—
FP8 tensor (dense)419 TFLOPS733 TFLOPS1.75×
FP16 / BF16 tensor (dense)209.5 TFLOPS362 TFLOPS1.73×
FP64———
Max power575 W350 W—
GPUs per server1, 2, 41, 2, 4, 8—
Per GPU in our servers16 vCPU · 64 GB RAM · 1 TB12 vCPU · 96 GB RAM · 1 TB—

Sources: NVIDIA GeForce RTX 5090 · RTX Blackwell whitepaper · NVIDIA L40S. Full sheets: RTX 5090 · L40S

RTX 5090 vs L40S rental price.

At GPUCenter, the RTX 5090 rents for $329 and the L40S for $789 per GPU per month, 30% below the market median of public on-demand prices, paid in crypto with no KYC. Hourly figures are the monthly price divided by 730 hours.

RTX 5090 vs L40S rental prices
GPUCenterNVIDIA RTX 5090NVIDIA L40SL40S / RTX 5090
Price per GPU, per month$329$7892.4×
Equivalent per GPU-hour$0.45$1.08—
Per GB of GPU memory, per month$10.28$16.441.6×
Per PFLOPS of dense FP8, per month$785$1,0761.37×
Largest server4× · $1,316/mo8× · $6,312/mo—
Market median, per GPU$481$1,139—
Below the median−32%−31%—

Same price per GPU at every server size, no hourly metering. How we compare prices · Configure an RTX 5090 server · Configure a L40S server

Which models fit on each.

Smallest server that holds each model, by precision. Rule of thumb with headroom for the KV cache, 92% of GPU memory usable.

Number of GPUs needed per model on RTX 5090 vs L40S
Model (total parameters)RTX 5090 · FP8L40S · FP8RTX 5090 · 4-bitL40S · 4-bit
Qwen3.5-9B 1× 1× 1× 1×
Gemma 4 31B 2× 1× 1× 1×
Llama 3.3 70B 4× 2× 2× 2×
gpt-oss-120b — 4× 4× 2×
DeepSeek-V4-Flash — 8× — 8×
Qwen3.5-397B-A17B — — — 8×
DeepSeek-R1 (671B) — — — —
Kimi K2.6 (1T) — — — —

FP8 ≈ 1.2 bytes and 4-bit ≈ 0.65 bytes per parameter. — = larger than the biggest server of that GPU. Size another model · How much VRAM does an LLM need?

RTX 5090 vs L40S FAQ.

More on each GPU: NVIDIA RTX 5090 · NVIDIA L40S.

Is the RTX 5090 faster than the L40S?

It depends on what limits the job. The RTX 5090 has about twice the memory bandwidth, which sets the pace of token generation for a model that fits. The L40S has about 1.75× the dense FP8 tensor throughput and 16 GB more memory. We do not publish benchmarks.

Why does the L40S cost more than the RTX 5090?

It is a data-center card: 48 GB of memory with ECC, passive cooling for dense servers and servers of up to 8 GPUs. We price both 30% below their own market median.

Which one fits a 32B model?

In 4-bit (about 21 GB), both on a single card. In FP8 (about 38 GB), one L40S holds it; on RTX 5090 it takes two cards.

Rent the RTX 5090 or the L40S.

Dedicated servers with 1 to 8 GPUs, one monthly price, paid in crypto. Online in under 10 minutes, no KYC.

Customer area

Sign in to GPUCenter

Your orders, invoices and servers in one place.

New to GPUCenter?

Accounts are created at checkout: choose your server and software, then create your account in the Account step of your first order.

Deploy a server