pith. sign in

arxiv: 1908.03568 · v3 · pith:R24MKQRMnew · submitted 2019-08-09 · 💻 cs.LG · cs.AI· stat.ML

Behaviour Suite for Reinforcement Learning

classification 💻 cs.LG cs.AIstat.ML
keywords bsuitelearningbehaviourreinforcementagentalgorithmscoredesign
0
0 comments X
read the original abstract

This paper introduces the Behaviour Suite for Reinforcement Learning, or bsuite for short. bsuite is a collection of carefully-designed experiments that investigate core capabilities of reinforcement learning (RL) agents with two objectives. First, to collect clear, informative and scalable problems that capture key issues in the design of general and efficient learning algorithms. Second, to study agent behaviour through their performance on these shared benchmarks. To complement this effort, we open source github.com/deepmind/bsuite, which automates evaluation and analysis of any agent on bsuite. This library facilitates reproducible and accessible research on the core issues in RL, and ultimately the design of superior learning algorithms. Our code is Python, and easy to use within existing projects. We include examples with OpenAI Baselines, Dopamine as well as new reference implementations. Going forward, we hope to incorporate more excellent experiments from the research community, and commit to a periodic review of bsuite from a committee of prominent researchers.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Mastering Diverse Domains through World Models

    cs.AI 2023-01 unverdicted novelty 7.0

    DreamerV3 uses world models and robustness techniques to solve over 150 tasks across domains with a single configuration, including Minecraft diamond collection from scratch.

  2. On the Measure of Intelligence

    cs.AI 2019-11 unverdicted novelty 7.0

    Intelligence is skill-acquisition efficiency, and the ARC benchmark measures human-like general fluid intelligence by testing abstraction and reasoning with minimal, innate-like priors.

  3. Augmented Lagrangian Method for Last-Iterate Convergence for Constrained MDPs

    cs.LG 2026-05 unverdicted novelty 6.0

    An inexact augmented Lagrangian method with projected Q-ascent yields global last-iterate convergence guarantees for constrained MDP policy optimization, extending from tabular to log-linear and non-linear policies.

  4. Gymnasium: A Standard Interface for Reinforcement Learning Environments

    cs.LG 2024-07 accept novelty 5.0

    Gymnasium establishes a standardized API for RL environments to improve interoperability, reproducibility, and ease of development in reinforcement learning.

  5. Naturalistic Computational Cognitive Science: Towards generalizable models and theories that capture the full range of natural behavior

    q-bio.NC 2025-02 unverdicted novelty 4.0

    Advocates integrating naturalistic paradigms and AI progress into cognitive science to develop generalizable models of natural behavior while retaining experimental control and theoretical insight.

  6. Naturalistic Computational Cognitive Science: Towards generalizable models and theories that capture the full range of natural behavior

    q-bio.NC 2025-02 unverdicted novelty 3.0

    Position paper advocating integration of naturalistic paradigms and AI models to create generalizable theories of natural human behavior and cognition.