김태오

Automatic Differentiation 본문

ML

Automatic Differentiation

ystc1247 2023. 4. 22. 22:47

A general way of automatically constructing a procedure for computer derivatives numerically

 - a mathematical tool that allows us to compute the gradients of complex functions, including those with multiple inputs and outputs.

 

* this is not a function or a formula, it is a mathematical procedure.

 

Most of the times, it makes a computation graph.

computation graph

computation graph is a graphical representation of a mathematical computation, and is often used in machine learning to represent neural networks and enable automatic differentiation.

 

The two types of computations

Simple Visualization of two modes
table of comparison between two modes

'ML' 카테고리의 다른 글

Polynomial Regression  (0) 2023.04.23
Gradient Descent vs. Normal Equation  (0) 2023.04.23
Learning Modes in ML  (0) 2023.04.22
Linear Regression  (0) 2023.04.22
Linear / Polynomial Regression Model  (0) 2023.04.05