Linear Regression and Optimization Techniques question

@mohitlearns wrote:

Hello,

I am taking a general scenario using a Linear regression model

Once we have trained and predicted a Linear regression model the next step is to improve its performance by way of optimization for example using :

• List item Ridge Regression

• List item Lasso Regression

Now my questions are as follows :

• List item RIdge and Lasso are these also “Linear Regression” models which use L2 and L1 optimization techniques. Please clarify

• List item Can Ridge and Lasso be applied to any other algorithm besides Linear Regression

• List item Do we GridsearchCV and RandomSearchCV to automate the process hyper-parameter tuning in the algorithms…say in the above case to set the values of Alpha.

• List item When do we use GradientDescent especially Stochastic Gradient Descent…can we also use SGD classifier along with Linear Regression, RIdge and Lasso

Thanks

Mohit

Posts: 1

Participants: 1

Read full topic