ParameterAveraging

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

7. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

8. def doGradStep(weights: WeightsSet, gradient: WeightsMap, rate: Double): Unit

   Actually adds the gradient to the weights.

   Actually adds the gradient to the weights. ParameterAveraging overrides this.

   weights

   The weights

   gradient

   The gradient

   rate

   The learning rate

   Definition Classes

   ParameterAveraging → GradientStep

9. final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

10. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

11. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

12. def finalizeWeights(weights: WeightsSet): Unit

    Once learning is done, the weights should be copied back into normal tensors.

    Once learning is done, the weights should be copied back into normal tensors.

    weights

    The weights

    Definition Classes

    ParameterAveraging → GradientStep → GradientOptimizer

13. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    Definition Classes

    AnyRef → Any

15. def initializeWeights(weights: WeightsSet): Unit

    Some optimizers swap out weights with special purpose tensors for e.

    Some optimizers swap out weights with special purpose tensors for e.g. efficient scoring while learning.

    weights

    The weights

    Definition Classes

    ParameterAveraging → GradientStep → GradientOptimizer

16. def isConverged: Boolean

    Online optimizers generally don't converge

    Online optimizers generally don't converge

    returns

    Always false

    Definition Classes

    GradientStep → GradientOptimizer

17. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

18. var isSetToAverage: Boolean

19. var it: Int

    Definition Classes

    GradientStep

20. def lRate(weights: WeightsSet, gradient: WeightsMap, value: Double): Double

    Override this method to change the learning rate

    Override this method to change the learning rate

    weights

    The weights

    gradient

    The gradient

    value

    The value

    returns

    The learning rate

    Definition Classes

    GradientStep

21. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

22. final def notify(): Unit

    Definition Classes

    AnyRef

23. final def notifyAll(): Unit

    Definition Classes

    AnyRef

24. def processGradient(weights: WeightsSet, gradient: WeightsMap): Unit

    Override this method do to some transformation to the gradient before going on with optimization

    Override this method do to some transformation to the gradient before going on with optimization

    weights

    The weights

    gradient

    The gradient

    Definition Classes

    GradientStep

25. def reset(): Unit

    To override if you want to reset internal state.

    To override if you want to reset internal state.

    Definition Classes

    ParameterAveraging → GradientStep → GradientOptimizer

26. def setWeightsToAverage(weights: WeightsSet): Unit

27. final def step(weights: WeightsSet, gradient: WeightsMap, value: Double): Unit

    Should not be overriden.

    Should not be overriden. The main flow of a GradientStep optimizer.

    weights

    The weights

    gradient

    The gradient

    value

    The value

    Definition Classes

    GradientStep → GradientOptimizer

28. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

29. def toString(): String

    Definition Classes

    AnyRef → Any

30. def unSetWeightsToAverage(weights: WeightsSet): Unit

31. var wTmp: WeightsMap

32. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

33. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

34. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )