GPU 시세 · VRAM · 온디바이스 AI

Used RTX 3090 vs 4090 for Local LLMs: Price-per-VRAM-GB Recalculated

· 읽는 시간 5분 · 데일리 딥러닝

The used market’s value question, in one metric: USD per GB of VRAM, updated with current listings.

Card Typical used (USD) $/VRAM-GB Bandwidth
RTX 3090 24GB ~$700–900 ~$33 936 GB/s
RTX 4090 24GB ~$2,200+ ~$92 1,008 GB/s
RTX 3060 12GB ~$210 ~$17.5 360 GB/s
New 5060 Ti 16GB $580 (8GB SKU) rising 448 GB/s

The 3090 remains the value king for 24GB-class work: same bandwidth class as the 4090 at a third of the price. The 4090 premium buys ~1.3–1.5x generation speed — rarely worth 2.5x the cost unless you’re serving multiple users. Watch the new-card market: Micron’s supply warning is lifting used prices, so the 3090 window is closing, not opening.

Methodology

Apple M5 Max 128GB unified memory, MLX/Ollama, tok/s = sustained generation over a 2K-token prompt, measured on this machine. Korea street prices from Danawa (multi-vendor median), converted at ~1,380 KRW/USD. Rows marked “public record” cite published benchmarks reproduced where possible; “measured” rows are from our hardware. Updated weekly — check the date in the title.

👉 Does it run on YOUR card? Check the VRAM Fit Matrix — measured estimates for every model above.

댓글 남기기