8·
15 days agoIt’s all dependent on VRAM. If you can load the distilled models with your GPU without maxing out your VRAM it will run just as fast as any server farm.
RX 580x
It looks like your video card only has 8 GB of VRAM. That will be your bottleneck.
yah that’ll do it too. ive got a 6800xt which isn’t technically supported but it works well.