Skip to content
This repository has been archived by the owner on Nov 4, 2024. It is now read-only.

Commit

Permalink
format
Browse files Browse the repository at this point in the history
  • Loading branch information
MartinuzziFrancesco committed Feb 25, 2024
1 parent e9d29ef commit 214256f
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions src/initializers.jl
Original file line number Diff line number Diff line change
Expand Up @@ -147,8 +147,8 @@ Cannot construct a vector, i.e., `length(dims) == 1` is forbidden.
# References
[^Saxe14] Saxe, McClelland, Ganguli. "Exact solutions to the nonlinear dynamics of
learning in deep linear neural networks",
ICLR 2014, https://arxiv.org/abs/1312.6120
learning in deep linear neural networks",
ICLR 2014, https://arxiv.org/abs/1312.6120
"""
function orthogonal(rng::AbstractRNG, ::Type{T}, dims::Integer...;
gain::Number=T(1.0)) where {T <: Number}
Expand Down Expand Up @@ -224,8 +224,8 @@ matrix = sparse_init(rng, Float32, 5, 5; sparsity=0.3, std=0.01)
# References
[^Martens2010] Martens, J, "Deep learning via Hessian-free optimization"
_Proceedings of the 27th International Conference on International Conference
on Machine Learning_. 2010.
_Proceedings of the 27th International Conference on International Conference
on Machine Learning_. 2010.
"""
function sparse_init(rng::AbstractRNG, ::Type{T}, dims::Integer...;
sparsity::Number, std::Number=T(0.01)) where {T <: Number}
Expand Down

0 comments on commit 214256f

Please sign in to comment.