GENREG-LAB
GENREG LAB - gradient-free evolution lab: constraint-driven training engine, Tree LM (byte/word), DiffEvo, Animation, and the autoregressive LM campaign
A research lab for training AI models purely through evolution and selection, with no gradient descent or pretrained weights.
GENREG LAB is a research project for training AI models using evolution instead of the usual gradient based training methods most machine learning uses today. Rather than adjusting a model gradually using calculus based techniques, this project starts with a population of small models, tests them, and repeatedly selects and mutates the better performing ones over many generations, similar to how natural selection works in biology. No pretrained weights or gradient descent are used anywhere in the project.
The lab is built as a single web application with several experiment pages you can open in a browser. One page evolves small neural networks to play games like Snake, 2048, and CartPole under various survival pressures such as limited energy or scarcity. Another page called Tree LM evolves a tree shaped structure of tiny models that predict text one character or word at a time. A third experiment applies the same evolutionary approach to image denoising, a technique related to how some AI image generators work. There is also a page for visually assembling models by dragging and connecting nodes, and a dashboard for browsing and comparing past training runs.
A significant part of the project is a staged effort to build a text prediction model entirely through evolution, described as progressing through separate stages such as a basic recurrent memory component, an attention mechanism for selectively recalling earlier text, and a technique for training the model on its own generated output to improve real world performance. The README reports specific numeric results from these experiments as evidence of progress.
The application also includes real interactive terminal windows built into the browser interface, backed by a separate background process so that terminals and any programs running in them keep working even if the main web server restarts. Running the project requires Windows, Python, and the listed dependencies, and it works with or without an NVIDIA GPU, though the original experiments used one. It only runs on your local computer and is not exposed to the network by default. The project is licensed under AGPL-3.0, a copyleft license that generally requires sharing source code changes, including when run as a network service.
Where it fits
- Experiment with evolving small neural networks to play games instead of training them with gradients.
- Study a tree structured evolutionary approach to predicting text one character or word at a time.
- Explore evolution based image denoising as an alternative to standard diffusion model training.
- Browse and compare past training runs through a built-in dashboard with metrics and history.