QLearning

This page describes a module in the upcoming version 1.2 of Ikaros and may not be correct for version 1.1

Basic Q-learning.

Example XML definition

A simple example

  <module
      class = "QLearning"
      name = "QLearning"
  />

Parameters

NameDescriptionTypeDefault
classThe class name for the module; must be "QLearning".string
nameThe name of this instance of the module.string
horizonTime horizonlist0
alphaLearning ratefloat0.1
gammaDiscount factorfloat0.9
epsilonSelection parameterfloat0.0
initialInitial weightsfloat0.1

Module Connections

Inputs

NameDescription
STATESensory input
REINFORCEMENTCurrent reinforcement

Outputs

NameDescription
ACTIONSelected action
VALUEGlobal value

Limitations

It should be possible to turn off the automatic movement of the agent from goal to start locations.

Author

Christian Balkenius
christian.balkenius@lucs.lu.se
Lund University Cognitive Science

Files

QLearning.h
QLearning.cc
QLearning.ikc