I dive into some of the history of neuroscience inspiring artificial neural networks, in particular some of the physical abstractions and computations of the point neuron model.

A presentation going over the evolutionary design that has found its way into the field of Deep Neural Networks. We go over AlexNet's contributions, and question whether the ReLU activation function and backprop are biologically inspired.

Paper on the philosopher Ludwig Wittgenstein's lasting influence on the field of natural language processing (NLP). His ideas also reach into reinforcement learning, category theory, and dual-inheritance theories of evolution.

This is a presentation on the history of artificial neural networks and neuroscience given on 8/24/2021. The latter part of the talk is mainly inspired by Jeff Hawkin's new book, which details in layman's terms his groups research into neocortical intelligence.

2nd page 3rd page 4th page 5th page 6th page 7th page 8th page