By Shimon Whiteson
This ebook provides new algorithms for reinforcement studying, a sort of computer studying during which an self sustaining agent seeks a keep watch over coverage for a sequential selection activity. for the reason that present tools mostly depend upon manually designed answer representations, brokers that immediately adapt their very own representations have the aptitude to dramatically enhance functionality. This e-book introduces novel techniques for instantly studying high-performing representations. the 1st method synthesizes temporal distinction tools, the conventional method of reinforcement studying, with evolutionary equipment, which could examine representations for a extensive category of optimization difficulties. This synthesis is complete via customizing evolutionary easy methods to the online nature of reinforcement studying and utilizing them to adapt representations for worth functionality approximators. the second one method immediately learns representations according to piecewise-constant approximations of price features. It starts with coarse representations and steadily refines them in the course of studying, studying the present coverage and cost functionality to infer the easiest refinements. This e-book additionally introduces a singular process for devising enter representations. this system addresses the characteristic choice challenge by way of extending an set of rules that evolves the topology and weights of neural networks such that it evolves their inputs too. as well as introducing those new equipment, this publication offers large empirical leads to a number of domain names demonstrating that those suggestions can considerably enhance functionality over equipment with guide representations.
Continue reading "Shimon Whiteson's Adaptive Representations for Reinforcement Learning PDF" →