Learning-based Optimal Control of Time-Varying Linear Systems Over Large Time Intervals
| dc.contributor.author | Baddam, Vasanth Reddy | en |
| dc.contributor.committeechair | Eldardiry, Hoda | en |
| dc.contributor.committeecochair | Boker, Almuatazbellah (Muataz) | en |
| dc.contributor.committeemember | Watson, Layne T. | en |
| dc.contributor.department | Computer Science and Applications | en |
| dc.date.accessioned | 2023-07-28T14:41:38Z | en |
| dc.date.available | 2023-07-28T14:41:38Z | en |
| dc.date.issued | 2023 | en |
| dc.description.abstract | We solve the problem of two-point boundary optimal control of linear time-varying systems with unknown model dynamics using reinforcement learning. Leveraging singular perturbation theory techniques, we transform the time-varying optimal control problem into two time-invariant subproblems. This allows the utilization of an off-policy iteration method to learn the controller gains. We show that the performance of the learning-based controller approximates that of the model-based optimal controller and the approximation accuracy improves as the control problem’s time horizon increases. We also provide a simulation example to verify the results | en |
| dc.description.abstractgeneral | We use reinforcement learning to find two-point boundary optimum controls for linear time-varying systems with uncertain model dynamics. We divided the LTV control problem into two LTI subproblems using singular perturbation theory techniques. As a result, it is possible to identify the controller gains via a learning technique. We show that the training-based controller’s performance approaches that of the model-based optimal controller, with approximation accuracy growing with the temporal horizon of the control issue. In addition, we provide a simulated scenario to back up our findings. | en |
| dc.description.degree | M.S. | en |
| dc.format.medium | ETD | en |
| dc.format.mimetype | application/pdf | en |
| dc.identifier.uri | http://hdl.handle.net/10919/115915 | en |
| dc.language.iso | en | en |
| dc.publisher | Virginia Tech | en |
| dc.rights | Creative Commons Attribution 4.0 International | en |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | en |
| dc.subject | optimal control | en |
| dc.subject | singular perturbation | en |
| dc.subject | reinforcement learning | en |
| dc.title | Learning-based Optimal Control of Time-Varying Linear Systems Over Large Time Intervals | en |
| dc.type | Thesis | en |
| thesis.degree.discipline | Computer Science | en |
| thesis.degree.grantor | Virginia Polytechnic Institute and State University | en |
| thesis.degree.level | masters | en |
| thesis.degree.name | M.S. | en |