Coding a Neural Net from Scratch (Python)

SEBASTIAN MANTEY

Coding a Neural Net from Scratch (Python)

1/26/2020

2 Comments

Links:

GitHub repo
Deep Learning Algorithm explained

2 Comments

Shehryar Khan

3/9/2021 06:07:55 am

Hey sebastin. I would really like to talk to you regarding deep learning. Can you kindly reply back. I tried messaging you on twitter but you didnt replied so I hope you see this message

aditya

4/21/2022 06:15:10 am

Hi Sebastian,

Thanks for the tutorial. I am wondering how will I add bias to this network.

I have tried the following:

# weight updates
weights_2_update = np.dot(hidden_layer_outputs.T, output_layer_delta) / N
weights_1_update = np.dot(X.T, hidden_layer_delta) / N
bias_2_update = learning_rate * output_layer_delta
bias_1_update = learning_rate * hidden_layer_delta

weights_2 = weights_2 - learning_rate * weights_2_update
weights_1 = weights_1 - learning_rate * weights_1_update
bias2 = bias2 - bias_2_update
bias1 = bias1 - bias_1_update

Could you please tell me if this is correct?

Coding a Neural Net from Scratch (Python)

Leave a Reply.

Author

Archives

Categories