Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

L1 scales regularization #2

Open
andylai0212 opened this issue May 16, 2019 · 2 comments
Open

L1 scales regularization #2

andylai0212 opened this issue May 16, 2019 · 2 comments

Comments

@andylai0212
Copy link

你好，感谢您的分享。
請問可以說明一下關於L1 scales regularization 方法具體需要修改源碼那些地方嗎?
@ArtyZe
Copy link
Owner

ArtyZe commented Jul 9, 2019

@andylai0212
你好，就修改convolutional_layer_kernels.cu中，你可以看到我有一个l1正则化的宏定义，SCALE_L1，你可以搜这个关键字，所有有这个的都是

@ujsyehao
Copy link

@ArtyZe 请教下你这个L1正则化是针对conv weights还是针对BN的scale值做的？我正在实验一个模型剪枝方法，参考的是这篇文章

Learning efficient convolution networks through network slimming(ICCV 2017)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ujsyehao @ArtyZe @andylai0212