Sequence Modeling | Deep Learning Specialization | Coursera

Course planning Week 1: Recurrent neural networks Learn about recurrent neural networks. This type of model has been proven to perform extremely well on temporal data. It has several variants including LSTMs, GRUs and Bidirectional RNNs, which you are going to learn about in this section. Recurrent neural networks C4W1L01 Why sequence models C4W1L02 Notation […]

Convolutional Neural Networks | Deep Learning Specialization | Coursera

Course Planning Week 1: Foundations of convolutional neural networks Learn to implement the foundational layers of CNNs (pooling, convolutions) and to stack them properly in a deep network to solve multi-class image classification problems. Convolutional neural networks C4W1L01 Computer vision C4W1L02 Edge detection example C4W1L03 More edge detection C4W1L04 Padding C4W1L05 Strided convolutions C4W1L06 Convolutions over […]

Neural Networks and Deep Learning | Deep Learning Specialization | Coursera

Lecture Planning Week 1: Introduction to Deep Learning Welcome to the Deep Learning Specialization C1W1L01 Welcome Introduction to Deep Learning C1W1L02 Welcome C1W1L03 What is a neural network? C1W1L04 Supervised Learning with Neural Networks C1W1L05 Why is Deep Learning taking off? C1W1L06 About this Course C1W1R1 Frequently Asked Questions C1W1L07 Course Resources C1W1R2 How to use […]

Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization | Deep Learning Specialization | Coursera

Brief information Course name: Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization Instructor: Andrew Ng Institution: deeplearning.ai Media: Coursera Specialization: Deep Learning Duration: 3 weeks About this Course This course will teach you the “magic” of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand […]

Structuring Machine Learning Projects | Deep Learning Specialization | Coursera

Brief information Course name: Structuring Machine Learning Projects Instructor: Andrew Ng Institution: deeplearning.ai Media: Coursera Specialization: Deep Learning Duration: 2 weeks About this Course You will learn how to build a successful machine learning project. If you aspire to be a technical leader in AI, and know how to set direction for your team’s work, this […]

Inception Module | Summary

References Udacity (2016. 6. 6.). Inception Module. YouTube. [LINK] Udacity (2016. 6. 6.). 1×1 Convolutions. YouTube. [LINK] Tommy Mulc (2016. 9. 25.). Inception modules: explained and implemented. [LINK] Szegedy et al. (2015). Going Deeper with Convolutions. CVPR 2015. [arXiv] Summary History The inception module was first introduced in GoogLeNet for ILSVRC’14 competition. Key concept Let a convolutional network decide […]

Batch Normalization | Summary

References Sergey Ioffe, Christian Szegedy (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. ICML 2015. [ICML][arXiv] Lecture 6: Training Neural Networks, Part 1. CS231n:Convolutional Neural Networks for Visual Recognition. 48:52~1:04:39 [YouTube] Choung young jae (2017. 7. 2.). PR-021: Batch Normalization. Youtube. [YouTube] tf.nn.batch_normalization. Tensorflow. [LINK] Rui Shu (27 DEC 2016). A GENTLE […]

Studying Tensorflow

References LearningTensorFlow.com Géron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O’Reilly Media [Amazon] Siraj Raval (2016. 8. 19.). TensorFlow in 5 Minutes. YouTube. [YouTube] TensorBoard: 그래프 시각화 [LINK] Cifar-10 CNN implementation using TensorFlow library with 24% error [GitHub] Q&A In TensorFlow, what is the difference between […]

Heroes of Deep Learning Interviews by Andrew Ng

Heroes of Deep Learning: Andrew Ng interviews Geoffrey Hinton [40:23] Heroes of Deep Learning: Andrew Ng interviews Ian Goodfellow [14:56] Heroes of Deep Learning: Andrew Ng interviews Yoshua Bengio [25:49] Heroes of Deep Learning: Andrew Ng interviews Pieter Abbeel [16:04] Heroes of Deep Learning: Andrew Ng interviews Head of Baidu Research, Yuanqing Lin [13:37] Heroes […]

Deep Learning | Udacity

Brief Information Instructor: Vincent Vanhoucke (Principal Scientist at Google Brain) Flatform: Udacity Course homepage: https://www.udacity.com/course/deep-learning–ud730 Duration 2017-08-24~25: Took Lesson 1, 3-7 without programming assignments. Course Overview Lesson 1: From Machine Learning to Deep Learning Lesson 2: Assignment: notMNIST Lesson 3: Deep Neural Networks Lesson 4: Convolutional Neural Networks Lesson 5: Deep Models for Text and Sequences Lesson 6: […]