2 Comments
User's avatar
Dave's avatar

How insanely beefy of a GPU are we talking here?

Expand full comment
Brian Heming's avatar

Laptop 4090. That said, both language models and image models these days are typically VRAM bound for running high-speed. The laptop 4090 only has 16 GB vram, so I suspect you can get the same or better performance from a 4060 Ti or a 5060 Ti desktop, which only cost 1400 for the entire computer these days: https://www.newegg.ca/p/pl?d=5060+ti+desktop

Expand full comment