Dropout

Power of Hooks in Pytorch

What are hooks? Pytorch allows you to add custom function calls to its module and tensor objects called hooks. The calls can both be added to the forward method of the object as well as the backward method.