Home
Resource
Evaluating model free policy optimization strategies for non linear systems
PDF
PDF format is widely accepted and good for printing.
Plug-in required
PDF-1(2.57 MB)
Citation & Export
View Usage Statistics
Staff View

Citation & Export
Hide

Simple citation

Chukka, Aditya H.. Evaluating model free policy optimization strategies for non linear systems. Retrieved from https://doi.org/doi:10.7282/T3FB55SV

Export

Click here for information about Citation Management Tools at Rutgers.

Statistics
Hide

Description

TitleEvaluating model free policy optimization strategies for non linear systems
NameChukka, Aditya H. (author); Bekris, Kostas E (chair); Rutgers University; Graduate School - New Brunswick
Date Created2017
Other Date2017-05 (degree)
SubjectComputer Science, Mathematical optimization, Reinforcement learning--Mathematical models
Extent1 online resource (ix, 59 p. : ill.)
DescriptionThe Iterative Linear Quadratic Regulator (ILQR), a variant of Differential Dynamic Programming (DDP) is a tool for optimizing both open-loop trajectories and guiding feedback controllers using dynamics information that can be inferred from data. This technique assumes linear dynamics and quadratic cost functions and improves the control policy iteratively until convergence. We demonstrate the capabilities of this framework in designing controllers for regulating both natural and custom behavior on a simple pendulum, the primitive non linear system. The method's assumptions limit its validity to smaller regions of the state space. Direct Policy Search methods use Reinforcement Learning to develop controllers for such scenarios. Nevertheless, these methods require numerous samples to generate an optimal policy and often converge to poor local optima. Guided Policy Search (GPS) is a new technique that optimizes complex non-linear policies, such as those represented through deep neural networks, without computing policy gradients in high dimensional parameter space. It trains the policy in a "supervised" fashion using numerous locally valid controllers produced by ILQR. GPS provides appealing improvement and convergence guarantees in simple convex and linear settings and bounds the error in a non-linear setting. We apply Guided Policy Search to generate control policies for locomotion of a tensegrity robot, producing closed-loop motion that could not be achieved with previous methods.
NoteM.S.
NoteIncludes bibliographical references
Noteby Aditya H. Chukka
Genretheses, ETD graduate
Persistent URLhttps://doi.org/doi:10.7282/T3FB55SV
Languageeng
CollectionGraduate School - New Brunswick Electronic Theses and Dissertations
Organization NameRutgers, The State University of New Jersey
RightsThe author owns the copyright to this work.
Version 8.5.5
Rutgers University Libraries - Copyright ©2024