← Back to calculator / Local LLMs (13B+ models)

Best GPUs for
Local LLMs (13B+ models)

Running mid-to-large local language models for inference. We show only cards that clear Smooth local inference (min 16 GB VRAM, 20,000+ Time Spy), ranked by value among today's Amazon listings.

34 GPUs that clear the bar

ranked by value · live prices
Value # Model Brand Price VRAM Condition Check on Amazon
80 Good 1 RX 9070 XT AMD $779.99 16 GB Used ASUS Prime Radeon™ RX 9070 XT OC Edition Graphics Card, AMD (PCIe 5.0, HDMI/DP 2.1, 2.5-Slot Design, Axial-tech Fans, Ball Bearings, Dual BIOS, GPU Guard) (Renewed)
78 Good 2 RX 9070 XT AMD $799.99 16 GB Used PowerColor Reaper AMD Radeon RX 9070 XT 16GB GDDR6
75 Good 3 RX 9070 XT AMD $829.99 16 GB Used ASUS Prime Radeon RX 9070 XT 16GB GDDR6 OC Edition Gaming Graphics Card
75 Fair 4 RX 9070 XT AMD $831.93 16 GB Used GIGABYTE Radeon RX 9070 XT Gaming OC 16G Graphics Card, PCIe 5.0, 16GB GDDR6, GV-R9070XTGAMING OC-16GD Video Card
74 Fair 5 RX 9070 XT AMD $839.99 16 GB New ASRock Radeon RX 9070 XT Taichi 16GB OC, RDNA 4, 3100MHz Boost, 16GB GDDR6 256-bit, PCIe 5.0, Taichi 3X Cooling, Dual BIOS, Polychrome SYNC
73 Fair 6 RX 9070 XT AMD $847.99 16 GB New XFX Mercury AMD Radeon RX 9070XT OC Gaming Edition with RGB 16GB GDDR6, HDMI 3xDP, AMD RDNA 4 RX-97TRGBBBA
73 Fair 7 RX 9070 XT AMD $849.00 16 GB New Yeston Sakura Radeon RX 9070 XT 16G GDDR6 256bit 4nm Video Cards Desktop Computer PC Graphics Card
73 Fair 8 RX 9070 XT AMD $849.99 16 GB New PowerColor Hellhound AMD Radeon RX 9070 XT 16GB GDDR6 Reva Edition
73 Fair 9 RX 9070 XT AMD $849.99 16 GB Used ASUS Prime Radeon RX 9070 XT 16GB GDDR6 White OC Edition Graphics Card
72 Fair 10 RX 9070 XT AMD $863.99 16 GB Used Sapphire 11348-03-20G Pulse AMD Radeon™ RX 9070 XT Gaming Graphics Card with 16GB GDDR6, AMD RDNA 4
72 Fair 11 RX 9070 XT AMD $869.99 16 GB Used PowerColor Hellhound AMD Radeon RX 9070 XT 16GB GDDR6
71 Fair 12 RX 9070 XT AMD $874.72 16 GB New Sapphire Pulse AMD Radeon™ RX 9070 XT Gaming 16GB Dual HDMI/Dual DP
71 Fair 13 RX 9070 XT AMD $879.00 16 GB New ASRock Graphics Board Steel Legend RX 9070 XT 16G AMD Radeon RX9070XT RX9070XT SL 16G / AX
70 Fair 14 RX 9070 XT AMD $885.00 16 GB New ASRock Radeon RX 9070 XT Steel Legend 16GB Graphics Card, AMD RDNA 4 Architecture, 2970 MHz, GDDR6, PCIe 5.0, Triple Fans, Polychrome SYNC, Reinforced Metal Frame, DisplayPort 2.1a, HDMI 2.1b
70 Fair 15 RX 9070 XT AMD $889.99 16 GB New XFX Mercury AMD Radeon RX 9070XT OC Magnetic Air Edition with RGB 16GB GDDR6 HDMI 3xDP, AMD RDNA 4 RX-97TMARGB9
69 Fair 16 RX 9070 XT AMD $899.00 16 GB New Yeston Sakura Atlantis Radeon RX 9070 XT 16G GDDR6 Video PC Graphics Card
69 Fair 17 RX 9070 XT AMD $899.99 16 GB New PowerColor Red Devil AMD Radeon RX 9070 XT 16GB GDDR6
68 Fair 18 RX 9070 XT AMD $917.99 16 GB New Sapphire 11348-01-20G Nitro+ AMD Radeon™ RX 9070 XT Gaming OC Graphics Card with 16GB GDDR6, AMD RDNA 4
67 Fair 19 RTX 5070 Ti NVIDIA $1,042.51 16 GB New GIGABYTE GeForce RTX 5070 Ti Eagle OC ICE SFF 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TEAGLEOC ICE-16GD Video Card
67 Fair 20 RX 9070 XT AMD $929.99 16 GB Used Gigabyte Radeon RX 9070 XT Gaming OC 16G Graphics Card - 16 GB GDDR6, 256 Bit, PCI-E 5.0, 3060 MHz Core Frequency, 2 x DisplayPort, 2 x HDMI, GV-R9070XTGAMING OC-16GD
66 Fair 21 RX 9070 XT AMD $939.99 16 GB New XFX Quicksilver AMD Radeon RX 9070 XT Gaming Edition with 16GB GDDR6 HDMI 3xDP, AMD RDNA 4 RX-97TQICKB9
65 Fair 22 RTX 4070 Ti Super NVIDIA $899.95 16 GB New ASUS TUF Gaming GeForce RTX™ 4070 Ti Super BTF White OC Edition Gaming Graphics Card (PCIe 4.0, 16GB GDDR6X, Exclusive to BTF ATX Motherboards
65 Fair 23 RTX 4070 Ti Super NVIDIA $899.99 16 GB Used MSI Gaming RTX 4070 TI Super 16G Expert Graphics Card (NVIDIA RTX 4070 Ti Super, 256-Bit, Extreme Clock: 2685 MHz, 16GB GDRR6X 21 Gbps, HDMI/DP, Ada Lovelace Architecture)
65 Fair 24 RTX 4070 Ti Super NVIDIA $899.99 16 GB Used MSI Gaming RTX 4070 TI Super 16G Expert Graphics Card (NVIDIA RTX 4070 Ti Super, 256-Bit, Boost Clock: 2685 MHz, 16GB GDRR6X 21 Gbps, HDMI/DP, Ada Lovelace Architecture) (Renewed)
64 Fair 25 RTX 5070 Ti NVIDIA $1,092.49 16 GB New msi Gaming RTX 5070 TI 16G FRIEREN Edition OC Graphics Card (16GB GDDR7, 256-bit, Extreme Clock 2572 MHz, DisplayPort x 3 2.1a, HDMI 2.1b, NVIDIA Blackwell Architecture)
64 Fair 26 RTX 5070 Ti NVIDIA $1,093.70 16 GB New msi Gaming RTX 5070 Ti 16G Ventus 3X OC Black Graphics Card (16GB GDDR7, 256-bit, Extreme Performance: 2482 MHz, DisplayPort x 3 2.1a, HDMI 2.1b, NVIDIA Blackwell Architecture)
64 Fair 27 RX 7900 XT AMD $844.32 20 GB Used PowerColor Hellhound Spectral White AMD Radeon RX 7900XT Graphics Card 20GB GDDR6
64 Fair 28 RTX 5070 Ti NVIDIA $1,099.99 16 GB New GIGABYTE GeForce RTX 5070 Ti Gaming OC 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TGAMING OC-16GD Video Card (Renewed)
64 Fair 29 RX 7900 XT AMD $849.99 20 GB New Sapphire 21323-01-20G AMD Radeon RX 7900 XT Gaming Graphics Card with 20GB GDDR6, AMD RDNA 3, Black
63 Fair 30 RTX 5070 Ti NVIDIA $1,104.35 16 GB New GIGABYTE GeForce RTX 5070 Ti Gaming OC 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TGAMING OC-16GD Video Card
62 Fair 31 RX 9070 XT AMD $999.00 16 GB New Yeston Sakura Atlantis Radeon RX 9070 XT 16G GDDR6 256bit 4nm Video Cards Desktop Computer PC Graphics Card
62 Fair 32 RX 9070 XT AMD $999.99 16 GB New XFX Mercury AMD Radeon RX 9070XT OC Magnetic Air Edition with RGB 16GB GDDR6 HDMI 3xDP, RDNA 4 RX-97TMARGBA, Graphics Card, Desktop PC
60 Poor 33 RTX 5070 Ti NVIDIA $1,169.99 16 GB New GIGABYTE GeForce RTX 5070 Ti WINDFORCE OC SFF 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TWF3OC-16GD Video Card
59 Poor 34 RTX 5070 Ti NVIDIA $1,179.99 16 GB Used GIGABYTE GeForce RTX 5070 Ti Eagle OC SFF 16G Graphics Card, 16GB 256-bit GDDR7, PCIe 5.0, WINDFORCE Cooling System, GV-N507TEAGLE OC-16GD Video Card

How this list works.

methodology
Methodology
Updated daily

Requirement bar: hand-estimated

Each software has a minimum VRAM and 3DMark Time Spy score per tier, estimated from published benchmark and settings guides. GPUs below the bar aren't shown; approximate by design, not a guarantee.

Ranking among qualifiers

GPUs that clear the bar are ranked by our standard Value Score (performance relative to price), same metric used across the site.

Pricing

Scraped daily from Amazon. New and used cards are flagged separately.

Already own a GPU?

Use the search box above to see whether your specific card meets this goal, and what a worthwhile upgrade would look like.