ML
Automatic Differentiation
ystc1247
2023. 4. 22. 22:47
A general way of automatically constructing a procedure for computer derivatives numerically
- a mathematical tool that allows us to compute the gradients of complex functions, including those with multiple inputs and outputs.
* this is not a function or a formula, it is a mathematical procedure.
Most of the times, it makes a computation graph.
a computation graph is a graphical representation of a mathematical computation, and is often used in machine learning to represent neural networks and enable automatic differentiation.
The two types of computations
