Do you think it is likely that we will start to see Large Language Models integrated in to major video games? If so, are there some examples within gaming already?
Do you think it is likely that we will start to see Large Language Models integrated in to major video games? If so, are there some examples within gaming already?
They don’t need a ton of ram if you use a tiny LLM customized for the game’s use cases, and that’s what games would be doing.
The downside is the tinier the model the stupider it will be
Tiny models only get stupid like that because you’re taking a general purpose model that knows everything in the world and compressing all that knowledge too much. If you start with a model that only knows basic english and info about a few hundred things in the game, it can be much smaller.