[MACHINE LEARNING] WK4,5

I searched on the youtube to find the reasonings to the learning machines because I wanted to understand the theoretical background. I found this biological explanation which shows where the summation Σ function and Sigmoid function came from.

Equation of Sigmoid: 

Screen Shot 2016-10-27 at 17.25.42.png

Derivative of Sigmoid:

machine-learning-introduction-to-neural-networks-27-638.jpg

In Code:

def sigmoid_fn(x):
return 1.0 / ( 1.0 + np.exp( -x ) )

def sigmoid_dfn(x):
y = sigmoid_fn( x )
return y * ( 1.0 – y )

 

Derivative of the Hyperbolic Tangent Function. 

screen-shot-2016-10-27-at-18-23-14

 

Transpose

[Matrix 1 X 4 ]  * [Matrix 1 X 4]

Transpose

[Matrix 1 X 4 ]  * [Matrix 4 X 1]

 

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s