10.6: Neural Networks: Matrix Math Part 1 – The Nature of Code

[ad_1]
In this video, I introduce the idea of “Linear Algebra” and explore the matrix math required for a simple neural network library.

Next video:

This video is part of Chapter 10 of The Nature of Code (

This video is also part of session 4 of my Spring 2017 ITP “Intelligence and Learning” course (

Support this channel on Patreon:
To buy Coding Train merchandise:
To donate to the Processing Foundation:

Send me your questions and coding challenges!:

Contact:
Twitter:
The Coding Train website:

Links discussed in this video:
The Nature of Code:
Session 4 of Intelligence and Learning:
My Simple Artificial Neural Network JavaScript Library:
Khan Academy’s Linear Algebra class:
3Blue1Brown’s Essence of Linear Algebra:
Brendan Fortuner’s Linear algebra cheat sheet for deep learning:
Math.js:
GPU.js:

Books discussed in this video:
Tariq Rashid’s Make Your Own Neural Network:
Marvin Minsky’s Perceptrons:

Source Code for the all Video Lessons:

p5.js:
Processing:

The Nature of Code playlist:
For More Coding Challenges:
For More Intelligence and Learning:

Help us caption & translate this video!


Posted

in

by

Tags:

Comments

36 responses to “10.6: Neural Networks: Matrix Math Part 1 – The Nature of Code”

  1. Dante van Gemert Avatar

    Not only pixels live in a matrix: We all live in it

  2. lars gortemaker Avatar

    can you please try to code an p5 chess engine?

  3. Aniekan Umoren Avatar

    is there a matrix math library built in for processing? or do i have to download an external
    library

  4. Bastian Carlos Avatar

    U are such a happy bastard.

  5. Andres Salgado Avatar

    Absolutely love Daniel's style!!!! New favorite YouTube Channel!!!!

  6. Alfie Chen Avatar

    what is that console used on port 8000???

  7. ColdBlueLight Avatar

    i am doing the same thing but in python and man its been a ride. thanks for giving me some more info on how all this works!

  8. Kovacs Robert Avatar

    In my experience, linear algebra is one of the most fucked up things you can subjet your brain to

  9. code things Avatar

    ur best teacher in the world

  10. tes ter Avatar

    u very talented sir

  11. Wyrlwind Avatar

    You can't use dot product with two matrices if the number of columns of the first matrix does not match the number of rows of the second one.
    Nice video though!

  12. Alex Kritskiy Avatar

    Hey, I'm really enjoying this series. Thanks! 🙂

  13. Zack Mercury Avatar

    That hole in your laptop screen. c:

  14. Ghazanfar Ansari Avatar

    awesome u deserve a hell lot of views

  15. siux94 Avatar

    Its more like coding pain than coding train

  16. Rishabh Asthana Avatar

    I like the fact that you don't emphasize optimality initially. I recently took an algorithms course and one of the main key points my professor used to stress upon was that when you start out writing an algorithm, the primary objective is to ensure that it is 'Correct' even if it's slow in it's naive implementation. Only when we can convince ourselves (and others) that it behaves correctly for required inputs, we can move forward to optimizing it if need be. Good content as always Dan 🙂

  17. arie brons Avatar

    dear mr Shiffman,

    thank you for the years of inspiring content.
    your easy tutorials have led to quite a lot of homebrewed code.
    now if one might want to share his or hers creation with his or her friends
    how does one do that?
    in short:

    how does one make a p5.js executable?

    thanks in advance

    have a nice day

    arie brons

  18. apppples Avatar

    Linear algebra is the best math. The most fun and the most intuitive.

  19. Mick Mack Avatar

    you are the coolest guy on youtube bro!

  20. Matke Avatar

    Lol, i was actually following along and understood everything even if i started learning js a week ago. Watching your videos gives me confidence i can become a good programmer one day. But I'm too hasty. It'll take years for me to learn.

  21. Comedy Co. Avatar

    Hi I want to learn to code and was wondering if javascript and processing are the same as p5.js. Also if I wrote processing code like you do in your processing videos in p5.js would it work vice versa with javascript.

  22. emmereffing Avatar

    following along in python!

  23. Sick Kent Avatar

    I dont understand

  24. Furrane Avatar

    Hey Daniel, a quick suggestion in case you havn't recorded the rest of this matrix series : why not create a way to "print" the matrix ? This might be more convenient than having to do what you do now.
    Also, as a side note, Matrix addition as you define it (matrix + scalar) is kind of a no-no. It works but the correct way is matrix+matrix.

  25. jonjon santos Avatar

    hi,i am a struggling java programmer that forgot how to program,and seeing your video somehow give a push to start writing code again.LIKE THE PERSONALITY,Thanks.

  26. Ghost WOW Avatar

    Vector what is it I get confused

  27. paega86 Avatar

    Even if you movements and hand postures makes me picture you as a ostrich, this was by far one of the most informative and interesting videos I have come across in a long while, hat off and thanks!

  28. lol lois Avatar

    which programing language you are using

  29. OtakuSpot Avatar

    where's my boy jelito at?

  30. MrAwesomesize Avatar

    You should link to 3Blue1Brown's linear algebra playlist on youtube:
    https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2xVFitgF8hE_ab

  31. Jason McCartneey Avatar

    3:22 isn't it a 6 dimensional vector? Because your index starts at 0 and x and y is 2 dimensional

  32. MukulNegi Avatar

    Hi! are you good now?

  33. masonery123 Avatar

    In the description: In this video, I introduce the idea of "Linear Algebar"
    Me:
    Algebar! Awaken to the most ancient of magicks, and destroy the universe!
    "RUUUUUUUUUUUUUUUUUHHHHHH!!!!!!"

Leave a Reply

Your email address will not be published. Required fields are marked *