Question 1: Short answer
hardAI-checkedDeep Learning Frameworksis an invertible matrix built from parameters , and for fixed vectors . Using the adjoint (reverse-mode) method, how many linear solves with (or ) are needed to get and the whole gradient , whatever is?