The easiest way to build Neural Networks in C# within Unity. The open-source AI project implements a scalar-valued autograd engine so you don't have to deal with backpropagation, and a Neural Network library. You can use it outside of Unity as well.