But what is a neural network? | Chapter 1, Deep learning
Video Statistics and Information
Channel: 3Blue1Brown
Views: 9,743,290
Rating: 4.9649916 out of 5
Keywords: three brown one blue, 3 brown 1 blue, neural networks, three blue one brown, 3 blue 1 brown, machines learning, 3brown1blue, 3b1b, deep learning, one, Mathematics, blue, three, brown
Id: aircAruvnKk
Channel Id: undefined
Length: 19min 13sec (1153 seconds)
Published: Thu Oct 05 2017
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.
I would like to add that deep learning is grounded in empirical performance, and not rigorous proofs, as you folks are use to. There has been one paper, that took it to the extreme in the proof direction: https://arxiv.org/pdf/1706.02515.pdf
10 pages of paper, 90 pages of proofs. I'm sure you guys can digest it just fine :)
Stupid question: so under his example way of building up this particular neural network, the results definitely will be very poor if the input image has the number distorted in space (like be squeezed to only on the bottom half), right? Because it won't match up with the weighted pixels.
Will this phenomenon also happen in an actual trained NN?
Why would you use the sigmoid function instead of, say, something simple like dividing by
EDIT: Ah, there we go, just watched the end of the video. I assume ReLU is standardised too.
I LOVE 3blue1brown.
More good follow-up reading for understanding how the learning actually works: http://colah.github.io/posts/2014-03-NN-Manifolds-Topology/
Ah, great to see a new series from 3blue1brown on a topic that's relatively nascent and a general online search on which returns rarely useful learning material.
meh, i liked the old videos more. Instead of him focusing on topics thar are widely covered. Maybe he will give some new insights. I have high expectations for 3B1B and this video didn't deliver in an of itself
Omg finally
I'm going to watch this when I come back from school!
it's like a monad, only trendy