Deep Neural Network that turns any Image into a Playable Game ! All on consumer GPUs and Not Datacenters

r/artificial
Machine Learning Generative AI NLP AI Research

Hi everyone! I really wanted to share my research what I've been working on. I wanted to build a nn that can simulate games, or at least start doing that Most video generators are too large to run on consumer hardware realtime, so I I designed a model that does this from scratch. No fine tuning bs or anything The core de noiser network is fully trained from scratch to this goal. From image to games data. above is on a RTX 5090. The nn is a small Transformer-like model and works in a causal way, just like LLMs.