Deep Reinforcement Learning: An Overview
read the original abstract
We give an overview of recent exciting achievements of deep reinforcement learning (RL). We discuss six core elements, six important mechanisms, and twelve applications. We start with background of machine learning, deep learning and reinforcement learning. Next we discuss core RL elements, including value function, in particular, Deep Q-Network (DQN), policy, reward, model, planning, and exploration. After that, we discuss important mechanisms for RL, including attention and memory, unsupervised learning, transfer learning, multi-agent RL, hierarchical RL, and learning to learn. Then we discuss various applications of RL, including games, in particular, AlphaGo, robotics, natural language processing, including dialogue systems, machine translation, and text generation, computer vision, neural architecture design, business management, finance, healthcare, Industry 4.0, smart grid, intelligent transportation systems, and computer systems. We mention topics not reviewed yet, and list a collection of RL resources. After presenting a brief summary, we close with discussions. Please see Deep Reinforcement Learning, arXiv:1810.06339, for a significant update.
This paper has not been read by Pith yet.
Forward citations
Cited by 15 Pith papers
-
Solving Markov Decision Processes with Future Information via MPC
Parameterized MPC exactly represents optimal policies for MDPs with future information under identified structural conditions and parameters can be learned via RL.
-
Trustworthy Recommendation in the Era of Large Language Models: Opportunities and Challenges
A systematic review of over 200 studies concludes that LLMs in recommender systems act as a double-edged sword, creating both opportunities and new risks for trustworthiness.
-
Why Does Agentic Safety Fail to Generalize Across Tasks?
Agentic safety fails to generalize across tasks because the task-to-safe-controller mapping has a higher Lipschitz constant than the task-to-controller mapping alone, as proven in linear-quadratic control and demonstr...
-
Exploring the Secondary Risks of Large Language Models
Introduces secondary risks as a new class of LLM failures from benign prompts, defines two primitives, proposes SecLens search framework, and releases SecRiskBench showing risks are widespread across 16 models.
-
Anti-bullying Adaptive Cruise Control: A proactive right-of-way protection approach
AACC combines online IOC for driving style identification with a Stackelberg game planner to proactively protect right-of-way against cut-ins, reporting up to 79.8% safety gains in simulation.
-
Seed-TTS: A Family of High-Quality Versatile Speech Generation Models
Seed-TTS models produce speech matching human naturalness and speaker similarity, with added controllability via self-distillation and reinforcement learning.
-
A Survey on Vision-Language-Action Models for Embodied AI
This is the first survey on vision-language-action models, providing a taxonomy across three lines, plus summaries of datasets, simulators, benchmarks, challenges, and future directions in embodied AI.
-
An Inductive Synthesis Framework for Verifiable Reinforcement Learning
The paper introduces an inductive synthesis framework that generates verifiable deterministic program approximations of neural RL policies, preserving safety invariants via counterexample-guided search over state tran...
-
Counterfactually Safe Reinforcement Learning
Formalizes counterfactual individual harm in RL and introduces a two-stage policy learning method with finite-sample guarantees on sub-optimality gap and harm rate control.
-
CoAX: Cognitive-Oriented Attribution eXplanation User Model of Human Understanding of AI Explanations
Cognitive models of user reasoning strategies with XAI methods on tabular data fit human forward-simulation decisions better than ML baselines and support hypothesis testing without new user studies.
-
Erase to Improve: Erasable Reinforcement Learning for Search-Augmented LLMs
ERL trains LLMs to erase faulty reasoning steps and regenerate them in place, yielding gains of up to 8.48% EM on multi-hop QA benchmarks like HotpotQA.
-
Emission-Aware Reinforcement Learning for Sustainable Electric Vehicle Charging and Carbon Dioxide Reduction Under Varying Renewable Penetration
An emission-aware SAC RL agent for EV charging reaches 23.96 gCO2/kWh and 87% emission cuts versus baseline under 50% wind in EV2Gym simulations with EirGrid data.
-
The Rise and Potential of Large Language Model Based Agents: A Survey
The paper surveys the origins, frameworks, applications, and open challenges of AI agents built on large language models.
-
RL-ACRGNet: Reinforcement Learning-Based Chest Radiology Report Generation Network
RL-ACRGNet applies reinforcement learning to an encoder-decoder architecture for radiology report generation and reports modest metric gains on IU-Xray and MIMIC-CXR.
-
Deep Reinforcement Learning for Personalized Search Story Recommendation
A deep RL architecture using imitation learning and reinforcement learning is proposed to model immediate and future values of search story recommendations in a Markov decision process framework.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.