Scalar Derivative and Partial Derivatives

Derivative

In calculus, derivative can be approached in two different ways. One is geometrical (as a slope of a curve) and the other one is physical (as a rate of change). The process of finding a derivative is called "differentiation"

'The derivative of' is commonly written as ddx\frac{d}{dx} or f(x)f'(x)

Find a Derivative

Example:

f(x)=ddxx2=2xf'(x)=\frac{d}{dx}x^2 = 2x

means the slope or "rate of change" at any point in the graph/function x2x^2 is 2x. So when x=2 the slope is 2x = 4

Scalar derivative rules

Partial Derivatives

A partial derivative of a function of several variables is its derivative with respect to one of those variables, with the others held constant.

'The partial derivative with respect to x' is written as fx\frac{\partial f}{\partial x} or fxf'_xwhere {\partial}is called 'del' or 'curly dee'.

Find Partial Derivatives

Consider a function with two variables (x and y): f(x,y)=x2+y3f(x,y) = x^2 + y^3

a) Partial derivative with respect to x (Treat y as a constant like a random number 12)

fx=fx=2x+0=2xf'_x = \frac{\partial f}{\partial x} = 2x+0=2x

b) Partial derivative with respect to y (Treat x as a constant)

fy=fy=0+3y2=3y2f'_y =\frac{\partial f}{\partial y}= 0+3y^2=3y^2

Link: - Matrix Calculus For Deep Learning - MathIsFun: Introduction to Derivatives - MathIsFun: Partial Derivatives - Khan Academy: Basic Derivative Rules

Last updated