HiddenLayer Constraint

Lambda Key: lambda_hid

HiddenLayer constraint. The HiddenLayer sparsity loss function is defined as:

\[\mathcal{L}_{hid} = \frac{\lambda_{hid}}{N_{hid} N_{hid}} ||W_{hid}||_F^2\]
  • $N_{hid}$: is the number of hidden neurons.
  • $\textbf{W}_{hid}$: hidden layer weight matrix.

results matching ""

    No results matching ""