Rex-Omni is a 3B-parameter Multimodal Large Language Model (MLLM) that redefines object detection and a wide range of other visual perception tasks as a simple next-token prediction problem.

I saw this idea on Codédex's list of "50 terminal project ideas" and I wanted to try it as it seemed almost impossible at first. I managed to make the game work without using classes and with only one ...