cc.factorie.optimize

InvSqrtTLengthStepSize

trait InvSqrtTLengthStepSize extends GradientStep

Mixin trait for a step size which is normalized by the length of the gradient and looks like 1/sqrt(T)

Linear Supertypes
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. InvSqrtTLengthStepSize
  2. GradientStep
  3. GradientOptimizer
  4. AnyRef
  5. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  7. val baseRate: Double

  8. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  9. def doGradStep(weights: WeightsSet, gradient: WeightsMap, rate: Double): Unit

    Actually adds the gradient to the weights.

    Actually adds the gradient to the weights. ParameterAveraging overrides this.

    weights

    The weights

    gradient

    The gradient

    rate

    The learning rate

    Definition Classes
    GradientStep
  10. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. def finalizeWeights(weights: WeightsSet): Unit

    Once learning is done, the weights should be copied back into normal tensors.

    Once learning is done, the weights should be copied back into normal tensors.

    weights

    The weights

    Definition Classes
    GradientStepGradientOptimizer
  14. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  15. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  16. def initializeWeights(weights: WeightsSet): Unit

    Some optimizers swap out weights with special purpose tensors for e.

    Some optimizers swap out weights with special purpose tensors for e.g. efficient scoring while learning.

    weights

    The weights

    Definition Classes
    GradientStepGradientOptimizer
  17. def isConverged: Boolean

    Online optimizers generally don't converge

    Online optimizers generally don't converge

    returns

    Always false

    Definition Classes
    GradientStepGradientOptimizer
  18. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  19. var it: Int

    Definition Classes
    GradientStep
  20. def lRate(weights: WeightsSet, gradient: WeightsMap, value: Double): Double

    Override this method to change the learning rate

    Override this method to change the learning rate

    weights

    The weights

    gradient

    The gradient

    value

    The value

    returns

    The learning rate

    Definition Classes
    InvSqrtTLengthStepSizeGradientStep
  21. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  22. final def notify(): Unit

    Definition Classes
    AnyRef
  23. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  24. def processGradient(weights: WeightsSet, gradient: WeightsMap): Unit

    Override this method do to some transformation to the gradient before going on with optimization

    Override this method do to some transformation to the gradient before going on with optimization

    weights

    The weights

    gradient

    The gradient

    Definition Classes
    GradientStep
  25. def reset(): Unit

    To override if you want to reset internal state.

    To override if you want to reset internal state.

    Definition Classes
    GradientStepGradientOptimizer
  26. final def step(weights: WeightsSet, gradient: WeightsMap, value: Double): Unit

    Should not be overriden.

    Should not be overriden. The main flow of a GradientStep optimizer.

    weights

    The weights

    gradient

    The gradient

    value

    The value

    Definition Classes
    GradientStepGradientOptimizer
  27. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  28. def toString(): String

    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from GradientStep

Inherited from GradientOptimizer

Inherited from AnyRef

Inherited from Any

Ungrouped