Quantcast
Channel: Data Science, Analytics and Big Data discussions - Latest topics
Viewing all articles
Browse latest Browse all 4448

Determining the weights assigned to each model in Gradient Boosting

$
0
0

@pranjalk wrote:

Hi!
I have been trying to understand the gradient boosting algorithm in which I came across a fact that in GBM a new model let f2(x) is fit on the errors that resulted from the previous model f1(x) and then again a new model f3(x) is made to fit on errors of the previous model f2(x) and so on.
Then our final model f(x) is represented as weighted linear combination of all the models.
f(x) = a1*f1(x) + a2*f(2) + a3*f(x) + . . . . with a1 , a2 , a3 representing the weights of the respective models.
So how does these weights a1 , a2 , a3 , . . . are assigned to the corresponding models f1(x) , f2(x) , f3(x) , . . . ?

Posts: 1

Participants: 1

Read full topic


Viewing all articles
Browse latest Browse all 4448

Trending Articles