DOOMFORMER implements a Transformer through DOOM mechanics
A creator introduced DOOMFORMER, an experimental Transformer whose mathematical operations are implemented through DOOM game mechanics and voodoo dolls rather than a conventional numerical library. The creator says it can classify MNIST digits drawn on DOOM maps, make decisions, and play DOOM across many game instances. These capabilities and the scale of the experiment have not been independently reproduced or benchmarked.
DOOMFORMER is a concrete experiment in expressing Transformer computation through game mechanics, offering an unconventional implementation whose practical performance remains unverified.
Instead of trying to run DOOM on things, I have instead decided to use DOOM (many, many, many doom games actually) to create a transformer. For a lot of the math required I essentially had to use DOOM game mechanics and voodoo dolls (DOOM is turing complete btw) and exchange them with the actual operations, essentially creating an alternative to NumPy (a 65000x slower one). Thus, I am proud to present DOOMFORMER. Here are a list of things DOOMFORMER can do :
It can classify MNIST digits, even if you write these digits on the map!
It can talk(kinda)
You can use it to make decisions, so, it can play DOOM. Yes! You can play DOOM with thousands of DOOM games now! The marine's mind can be controlled by DOOM, playing on a map generated by DOOMFORMER. Truly, the possibilities are endless, and even larger-scale training of DOOMFORMER could be done on a measly T4.
If anyone would like to help me scale this up and make crazier things, I'd love to work together.