Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization | Deep Learning Specialization | Coursera

Brief information Course name: Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization Instructor: Andrew Ng Institution: deeplearning.ai Media: Coursera Specialization: Deep Learning Duration: 3 weeks About this Course This course will teach you the “magic” of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand […]

Structuring Machine Learning Projects | Deep Learning Specialization | Coursera

Brief information Course name: Structuring Machine Learning Projects Instructor: Andrew Ng Institution: deeplearning.ai Media: Coursera Specialization: Deep Learning Duration: 2 weeks About this Course You will learn how to build a successful machine learning project. If you aspire to be a technical leader in AI, and know how to set direction for your team’s work, this […]

Inception Module | Summary

References Udacity (2016. 6. 6.). Inception Module. YouTube. [LINK] Udacity (2016. 6. 6.). 1×1 Convolutions. YouTube. [LINK] Tommy Mulc (2016. 9. 25.). Inception modules: explained and implemented. [LINK] Szegedy et al. (2015). Going Deeper with Convolutions. CVPR 2015. [arXiv] Summary History The inception module was first introduced in GoogLeNet for ILSVRC’14 competition. Key concept Let a convolutional network decide […]

Batch Normalization | Summary

References Sergey Ioffe, Christian Szegedy (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. ICML 2015. [ICML][arXiv] Lecture 6: Training Neural Networks, Part 1. CS231n:Convolutional Neural Networks for Visual Recognition. 48:52~1:04:39 [YouTube] Choung young jae (2017. 7. 2.). PR-021: Batch Normalization. Youtube. [YouTube] tf.nn.batch_normalization. Tensorflow. [LINK] Rui Shu (27 DEC 2016). A GENTLE […]

Studying Tensorflow

References LearningTensorFlow.com Géron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O’Reilly Media [Amazon] Siraj Raval (2016. 8. 19.). TensorFlow in 5 Minutes. YouTube. [YouTube] TensorBoard: 그래프 시각화 [LINK] Cifar-10 CNN implementation using TensorFlow library with 24% error [GitHub] Q&A In TensorFlow, what is the difference between […]

Heroes of Deep Learning Interviews by Andrew Ng

Heroes of Deep Learning: Andrew Ng interviews Geoffrey Hinton [40:23] Heroes of Deep Learning: Andrew Ng interviews Ian Goodfellow [14:56] Heroes of Deep Learning: Andrew Ng interviews Yoshua Bengio [25:49] Heroes of Deep Learning: Andrew Ng interviews Pieter Abbeel [16:04] Heroes of Deep Learning: Andrew Ng interviews Head of Baidu Research, Yuanqing Lin [13:37] Heroes […]

Deep Learning | Udacity

Brief Information Instructor: Vincent Vanhoucke (Principal Scientist at Google Brain) Flatform: Udacity Course homepage: https://www.udacity.com/course/deep-learning–ud730 Duration 2017-08-24~25: Took Lesson 1, 3-7 without programming assignments. Course Overview Lesson 1: From Machine Learning to Deep Learning Lesson 2: Assignment: notMNIST Lesson 3: Deep Neural Networks Lesson 4: Convolutional Neural Networks Lesson 5: Deep Models for Text and Sequences Lesson 6: […]

Deep Learning by I. Goodfellow, Y. Bengio and A. Courville

Chapter 1 (h3) Section 1.1 (h4) Section 1.1.1 (h5) Theme (h6) Chapter 1 Introduction The performance of machine learning algorithms depends heavily on the representation of the data. The representation consists of features. Representation learning is machine learning to learn efficient representation of the given data. Deep learning so  

Studying ‘Deep Learning’

References Lectures Hinton, G. (2013) Neural Networks for Machine Learning. Coursera Deep Learning Nanodegree Foundations. Udacity CS231n: Convolutional Neural Networks for Visual Recognition. Stanford University CS224d: Deep Learning for Natural Language Processing. Stanford University CS 294-131: Special Topics in Deep Learning. UC Berkeley CS 294: Deep Reinforcement Learning, Spring 2017. UC Berkeley Vanhoucke, V.. Deep Learning. Udacity Books Goodfellow, […]

How to Install Caffe

Install Caffe on Linux Ubuntu 16.04 My Configurations Linux: Ubuntu 16.04 LTS Anaconda: Anaconda 2 (64-bit), Anaconda2-4.3.0-Linux-x86_64.sh CPU or GPU: CPU Install Caffe 1. Install CUDA 8 (Optional. I failed this installation.) Go to the CUDA download page(https://developer.nvidia.com/cuda-downloads). ‘ Go to the directory where the downloaded file cuda_8.0.44_linux.run is located.

I got an error. http://askubuntu.com/questions/149206/how-to-install-nvidia-run Hit CTRL+ALT+F1 […]