I self host my own llms and home assistant voice, having multiple models loaded at once is appealing. I am the exceedingly rare use case - and even I think it’s too much. For the same price I could get two 3000 series cards that would do what I would need.
I self host my own llms and home assistant voice, having multiple models loaded at once is appealing. I am the exceedingly rare use case - and even I think it’s too much. For the same price I could get two 3000 series cards that would do what I would need.