Packages

trait ActionValueFn[Obs, A, T] extends AnyRef

Along with StateValueFn, this is the main trait in tabular reinforcement learning for tracking the value of an (observation, action) pair.

Obs

Observation returned by the State instances tracked by ActionValueFn.

A

Action type on the State instances tracked by ActionValueFn.

T

type of values tracked by ActionValueFn.

Self Type
ActionValueFn[Obs, A, T]
Source
ActionValueFn.scala
Linear Supertypes
AnyRef, Any
Known Subclasses
Base, Folded, Mergeable
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ActionValueFn
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def actionValue(obs: Obs, a: A): T

    Returns the stored value associated with the given obs, a pair.

  2. abstract def seen(obs: Obs): Iterable[A]

    Returns an iterable of all actions available from the supplied observation associated with any tracked value T.

  3. abstract def seenStates: Iterable[Obs]

    Returns an Iterable of all observations associated with some internally tracked value T.

  4. abstract def update(obs: Obs, action: A, value: T): ActionValueFn[Obs, A, T]

    Absorb a new value for the supplied obs, action pair.

    Absorb a new value for the supplied obs, action pair. The behavior of this function is implementation dependent; some might ignore the value, some might merge it in to an existing set of values, some might completely replace the stored state.

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. def fold[U](prepare: (U) ⇒ T, present: (T) ⇒ U): ActionValueFn[Obs, A, U]

    Transforms this ActionValueFn into a new instance that applies the supplied prepare to all incoming values before they're learned, and presents tracked T instances using the present fn before returning them via actionValue.

  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. def mergeable(implicit T: Semigroup[T]): ActionValueFn[Obs, A, T]

    Returns an ActionValueFn instance that uses the supplied semigroup T to merge values into this current ActionValueFn.

    Returns an ActionValueFn instance that uses the supplied semigroup T to merge values into this current ActionValueFn.

    T

    Semigroup instance used to merge values.

  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  18. def toEvaluator[R, S[_]]: ActionValue[Obs, A, R, T, S]

    TODO fill in.

  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped