Search found 7 matches

by charbsj
Wed Feb 20, 2019 2:02 am
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

I have 3 cases. Case 1: no outliers Case 2: outliers on the high side Case 3: outliers on the low side What I mean by “it does not work” is that all the L2 regularization is doing (in my code) is “penalize” high weights. This results in the weight being lower than they would be without L2 regulariza...
by charbsj
Sun Feb 10, 2019 12:57 am
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

I feel a bit weak concerning the topic on probabilistic interpretation of the square error for linear regression
While I could search for it on the internet, I was wondering if you had any recommendations for some resources that could help me get a better grasp of this concept
Thank you
by charbsj
Thu Jan 31, 2019 3:52 am
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

I have posted a python class for linear regression with 15 different use cases on github (https://github.com/charbsj/Machine_Learning)

It follows your tutorial on linear regression.
I was wondering if you had some feedback on my class
by charbsj
Thu Jan 24, 2019 1:34 pm
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

Where I do see the L2 regularization being useful is when the data is overfitted by a polynomial of order higher than it should be. In your example, I try to fit the data with a 4th order polynomial. L2 regularization helps not overfit But where I do not understand how the L2 regularization works is...
by charbsj
Thu Jan 24, 2019 2:59 am
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

I still can not achieve the same results. I still fundamentally do not understand how this L2 technique is not just about flattening the slope either Pragmatically, I have a few questions: - the video on coding the L2 technique does not go through any normalization of the data. I thought this was ne...
by charbsj
Mon Jan 21, 2019 4:52 am
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Re: Linear regression, L2 regularization

Your data should be normalized to begin with so you can't doctor your data to put the outliers at zero and the true data somewhere else . Do I do that by doing, for each feature/column, an element by element operation - substract the feature mean - divide by the feature standard deviation? I assume...
by charbsj
Sun Jan 20, 2019 2:01 pm
Forum: Deep Learning Prerequisites: Linear Regression in Python
Topic: Linear regression, L2 regularization
Replies: 11
Views: 6406

Linear regression, L2 regularization

I am following the class on “deep learning prerequisite: linear regression with Python” taught by lazyprogrammer. Link: https://stackskills.com/courses/105513/lectures/2503518 I get confused by the L2 regularization theory It says to add lambda times w^2 to the cost function. This does not make much...

Go to advanced search