Day #52 - Deep Learning Class #1 Notes

AI - Reverse Engineering the brain (Curated Knowledge)
ML - Machine Learning is subset of AI. Teaching Machine to Learn

Deep Learning - Rebirth of Neural Networks

• Multiple layer of neurons
• Directed Graph
• First Layer is input layer
• Last Layer is output layer
• Intermediate layer is hidden Layer
• Deep Learning is inspired by human brain
• In Deep Learning features are learnt
• Gradient Descent - Process of making updates in NN
• Neural Networks is discriminative approach
• Neurons in neural networks end up in becoming feature selectors

Discriminative Classifiers - Logistics, SVM (uses kernel for non-linear classification), Decision Trees
Generative Model - Naive Bayes

Types of Neural Networks

• Autoencoders for dimensionality reduction
• CNN Convolutional NN
• RNN Recurrent NN

Interesting Deep Learning Demo Sites Discussed
imsitu.org
cloudcv.org

Happy Learning!!!

Neural Networks - Learning Resources

• Understanding LSTM Networks
• The Unreasonable Effectiveness of Recurrent Neural Networks
• Understanding Convolutions
• Conv Nets: A Modular Perspective
• Calculus on Computational Graphs: Backpropagation
• Implementing a Neural Network from Scratch - An Introduction
• Demystifying Deep Neural Nets
• Machine Learning is Fun! Part 4: Modern Face Recognition with Deep Learning
• Linear algebra cheat sheet for deep learning
• Making neural nets uncool again

Happy Learning!!!

Interesting Data Science Projects

• Recommender System Based On Natural Language Processing
• Community detection in social networks
• Image classification with a pre-trained deep neural network
• DEEP LEARNING FOR CHATBOTS, PART 1 – INTRODUCTION
• DEEP LEARNING FOR CHATBOTS, PART 2 – IMPLEMENTING A RETRIEVAL-BASED MODEL IN TENSORFLOW
• Predicting and Reducing Customer Churn for Telecommunication Companies
• Data Science Demo - Customer Churn Analysis
• Algorithmic trading in less than 100 lines of Python code
• PREDICTING RESIGNATION IN THE MILITARY
• Kaggle Competition Past Winner Solutions
• Kaggle Competition Past Solutions
• Kaggle Competition Past Solutions
• Learning Predictive Analytics: Kaggle Competition Solutions
• Workshop on Data Science for Food, Energy and Water
• Data Science and Fashion
• Improving Sentiment Classification of Social Media Posts through Data Refinements
• Workshop on Machine Learning for Large Scale Transport
• Workshop on Interactive Data Exploration and Analytics
• Workshop on Enterprise Intelligence
• Customer Segmentation in Python - PyConSG 2016
• Customer Churn Prediction, Segmentation and Fraud Detection in Telecommunication Industry
• Classifying e-commerce products based on images and text
• Transfer Learning using Keras
• Customer Segmentation, Market Basket Analysis and Customer behaviour analysis
• Forecasting
• Exploratory Data Analysis: Visualizing Police Killings in the U.S for the year 2015.
• Dimensionality reduction technique -tsne vs. PCA
• Facial expression prediction with CNN via Keras
• Sentiment Analysis with Python and scikit-learn
• Twitter Sentiment Analysis using Python
• Sentiment Analysis, Python Machine Learning and Twitter

Happy Learning!!!

Day #51 - Neural Networks

Happy New Year 2017. This post is on Neural Networks.

Neural Networks

• ANN - inspired by biological networks, Modelling network based on neurons
• Key layers - Input Layer, Hidden Layer, Output Layer
• Neural networks that can learn - Perceptrons, backpropagation networks, Boltzaman machines,recurrent networks
• In below example for XOR implementation we use backpropagation 

Implementation overview

• Initialize the edge weights at random (we do not exact weights we chose randomly, By training we find exact values)
• Calculate the error - we have some training data and some results - Supervised learning, Calculated output not logical output, Error term present 
• Calculate the changes of edge weights and update the weights (backpropagation process), Calculate edge weight changes and update accordingly
• Algorithm terminates when error rate is small

Simple Neural Network

Happy Pongal & Happy Learning!!!