dopamine
Dopamine is a research framework for fast prototyping of reinforcement learning algorithms.
Dopamine is a small, easy-to-modify research framework from Google for experimenting with reinforcement learning algorithms like DQN and Rainbow, using Atari games or robot simulators as test environments.
Dopamine is a research framework from Google for experimenting with reinforcement learning algorithms. Reinforcement learning is a field of AI where a software agent learns to make decisions by trying things out and receiving feedback, similar to how a person learns through trial and error. Dopamine is designed to make it quick and easy to try out new ideas in this space.
The framework is intentionally small and straightforward. Rather than offering a massive collection of tools, it provides a handful of well-tested algorithms that researchers can study and modify directly. This includes algorithms with names like DQN, Rainbow, and SAC, which are approaches to training agents to play games or control simulated robots. These implementations use a library called JAX, with older TensorFlow versions also available for some agents.
Dopamine works with two main types of training environments: classic Atari video games, which are a standard benchmark for measuring how well a learning algorithm performs, and MuJoco, a physics simulator used for training virtual robots to walk or manipulate objects.
You can install it via pip or clone the source code directly. The README recommends cloning from source if you plan to modify the code, which is the primary use case. Docker containers are also available for getting started without manual setup. Google provides baseline results and Jupyter notebooks to help researchers understand what performance to expect and how to run experiments.
This is not an official Google product, though it was created by Google researchers.
Where it fits
- Run classic reinforcement learning algorithms like DQN or Rainbow on Atari games to benchmark a new idea against established baselines.
- Modify one of Dopamine's small, readable algorithm implementations to test a research hypothesis without building from scratch.
- Use the included Jupyter notebooks and baseline results to verify your experimental setup matches expected performance.
- Train a virtual robot in MuJoco using SAC and compare results against Dopamine's published benchmarks.