SEBASTIAN MANTEY
  • Home
  • Theory
  • Code
  • Blog

Coding a Neural Net from Scratch (Python)

1/26/2020

2 Comments

 

Links:
  • GitHub repo
  • ​Deep Learning Algorithm explained

2 Comments
Shehryar Khan
3/9/2021 06:07:55 am

Hey sebastin. I would really like to talk to you regarding deep learning. Can you kindly reply back. I tried messaging you on twitter but you didnt replied so I hope you see this message

Reply
aditya
4/21/2022 06:15:10 am

Hi Sebastian,

Thanks for the tutorial. I am wondering how will I add bias to this network.

I have tried the following:

# weight updates
weights_2_update = np.dot(hidden_layer_outputs.T, output_layer_delta) / N
weights_1_update = np.dot(X.T, hidden_layer_delta) / N
bias_2_update = learning_rate * output_layer_delta
bias_1_update = learning_rate * hidden_layer_delta

weights_2 = weights_2 - learning_rate * weights_2_update
weights_1 = weights_1 - learning_rate * weights_1_update
bias2 = bias2 - bias_2_update
bias1 = bias1 - bias_1_update

Could you please tell me if this is correct?

Reply



Leave a Reply.

    Author

    Just someone trying to code some projects

    Archives

    November 2020
    March 2020
    February 2020
    January 2020

    Categories

    All
    Data Analysis
    ML From Scratch

    RSS Feed

Picture
  • Home
  • Theory
  • Code
  • Blog