Knowledge Base

Answers and Guides

What to Know About Spinning Up's Code Design and Long-Term Support

Spinning Up is OpenAI's educational deep reinforcement learning resource, and its code is deliberately written for readability ra…

How to Install Spinning Up and Run Experiments

Spinning Up is OpenAI's educational deep RL package, and getting from zero to a running experiment takes three installs (Python, …

Which Reinforcement Learning Algorithms Are Covered in Spinning Up?

Spinning Up includes six deep reinforcement learning algorithms, each with its own documentation page: Vanilla Policy Gradient (V…

How do I get started learning deep RL with Spinning Up?

Start with the Introduction and Installation sections, then work through the three-part "Introduction to RL" series before touchi…

What Is the Spinning Up Documentation Website?

Spinning Up (spinningup.openai.com) is OpenAI's educational resource for deep reinforcement learning. It is documentation, not a …