Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization

If you want to break into AI, this Specialization will help you do so. Deep Learning is one of the most highly sought after skills in tech. We will help you become good at Deep Learning.In five courses, you will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about Convolutional networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more. You will work on case studies from healthcare, autonomous driving, sign language reading, music generation, and natural language

Created by: Andrew Ng

icon
Quality Score

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 100 / 100

icon
Live Chat with CourseDuck's Co-Founder for Help

Need help deciding on a artificial intelligence course? Or looking for more detail on Andrew Ng's Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization? Feel free to chat below.
Join CourseDuck's Online Learning Discord Community

icon
Course Description

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow. After 3 weeks, you will: - Understand industry best-practices for building deep learning applications. - Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking, - Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence. - Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance- Be able to implement a neural network in TensorFlow. This is the second course of the Deep Learning Specialization.

icon
Instructor Details

Andrew Ng

Andrew Ng is Co-founder of Coursera, an and Adjunct Professor of Computer Science at Stanford University. His machine learning course is the MOOC that had led to the founding of Coursera! In 2011, he led the development of Stanford University's main MOOC (Massive Open Online Courses) platform and also taught an online Machine Learning class to over 100,000 students, thus helping launch the MOOC movement and also leading to the founding of Coursera.Ng also works on machine learning, with an emphasis on deep learning. He had founded and led the "Google Brain" project, which developed massive-scale deep learning algorithms. This resulted in the famous "Google cat" result, in which a massive neural network with 1 billion parameters learned from unlabeled YouTube videos to detect cats. Until recently, he led Baidu's ~1300 person AI Group, which developed technologies in deep learning, speech, computer vision, NLP, and other areas.

icon
Reviews

5.0

144 total reviews

5 star 4 star 3 star 2 star 1 star
% Complete
% Complete
% Complete
% Complete
% Complete

By Brennon B on 23-Apr-18

Walking away from this course, I do *not* feel adequately prepared to implement (end-to-end) everything that I've learned. I felt this way after the first course of this series, but even more so now. Yes, I understand the material, but the programming assignments really don't amount to more than "filling in the blanks"--that doesn't really test whether or not I've mastered the material. I understand that this is terribly hard to accomplish through a MOOC, and having taught university-level courses myself, I understand how much effort is involved in doing so in the "real world". In either case, if I'm paying for a course, I expect to have a solid grasp on the material after completing the material, and though you've clearly put effort into assembling the programming exercises, they don't really gauge this on any level. Perhaps it would be worth considering a higher cost of the course in order to justify the level of effort required to put together assessments that genuinely put the student through their paces in order to assure that a "100%" mark genuinely reflects both to you and the learner that they have truly internalized and mastered the material. It seems to me that this would pay off dividends not only for the learner, but also for the you as the entity offering such a certificate.

By oli c on 9-Dec-18

Lectures are good. Quizzes and programming exercises too easy.

By Matthew G on 18-Apr-19

Very good course. Andrew really steps it up in part two with lots of valuable information.

By Alan S on 30-Sep-17

As far as the video lectures is concerned, the videos are excellent; it is the same quality as the other courses from the same instructor. This course contains a lot of relevant and useful material, and is worth studying, and complements the first course (and the free ML course very well).The labs, however, are not particularly useful. While it's good that the focus of the labs is applying the actual formulas and algorithms taught, and not really on the mechanical aspects of putting the ideas in actual code, the labs have structured basically all of the "glue" and just leave you to basically translate formulas to the language-specific construct. This makes the lab material so mechanical as to almost take away the benefit.The TensorFlow section was disappointing. It's really difficult to learn much in a 15 minute video lecture, and a lab that basically does everything (and oddly, for some things leaves you looking up the documentation yourself). I didn't get anything out of this lab, other than to get a taste for what it looks like. What makes it even worse is TensorFlow framework uses some different jargon that is not really explained, but the relevant code is almost given to you so it doesn't matter to get the "correct" answer. I finished the lab not feeling like I knew very much about it at all. It would have been far better to either spend more time on this, or basically omit it.As with the first course, it is somewhat disappointing lecture notes are not provided. This would be handy as a reference to refer back to. Still, despite these flaws, there's still a lot of good stuff to be learned. This course could have been much better, though.

By Lien C on 31-Mar-19

The course provides very good insights of the practical aspect of implementing neural networks in general. Prof. Ng, as always, delivered very clear explanation for even the difficult concepts, and I have thoroughly enjoyed every single lecture video.Although I do appreciate very much the efforts put in by the instructors for the programming assignments, I can't help but thinking I could have learnt much more if the instruction were *LESS* detailed and comprehensive. I found myself just "filling in the blank" and following step-by-step instruction without the need to think too much. I'm also slightly disappointed with the practical assignment of Tensorflow where everything is pretty much written out for you, leaving you with less capacity to think and learn from mistakes. All in all, I think the course could have made the programming exercise much more challenging than they are now, and allow students to learn from their mistakes.

By Md. R K S on 15-Apr-19

Excellent course. When I learned about implementing ANN using keras in python, I just followed some tutorials but didn't understand the tradeoff among many parameters like the number of layers, nodes per layers, epochs, batch size, etc. This course is helping me a lot to understand them. Great work Mr. Andrew Ng. :)

By Xiao G on 31-Oct-17

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

By Abiodun O on 6-Apr-18

Fantastic course! For the first time, I now have a better intuition for optimizing and tuning hyperparameters used for deep neural networks.I got motivated to learn more after completing this course.

By Tang Y on 15-Apr-19

very practical.

By Sriram V on 9-Oct-19

Insights into best practices and directions for common problems make it an one-of-a-kind material for learners. Andrew, as always, has been commendable with his tutor team, the exercises are well cleaned up and in good shape. May be, if some optional tough exercises are given, it will add more value.

By Carlos V on 24-Dec-17

Exceptional Course, the Hyper parameters explanations are excellent every tip and advice provided help me so much to build better models, I also really liked the introduction of Tensor Flow Thanks.

By Artyom K on 9-May-19

The topics of this course, such as the setting of hyperparameters and the use of tensorflow, are critical topics for me, and in this course they are explained both in lectures and in practical tasks.