Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization に戻る

4.9

星

43,035件の評価

•

4,620件のレビュー

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.
After 3 weeks, you will:
- Understand industry best-practices for building deep learning applications.
- Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
- Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
- Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
- Be able to implement a neural network in TensorFlow.
This is the second course of the Deep Learning Specialization....

Oct 31, 2017

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

Dec 06, 2019

I enjoyed it, it is really helpful, id like to have the oportunity to implement all these deeply in a real example.\n\nthe only thing i didn't have completely clear is the barch norm, it is so confuse

フィルター：

by Jorge L

•Feb 17, 2019

All the courses in the Deep Learning Specialization are very good and met my expectations. I was guided through the nitty-gritties of neural networks, fortunately with a strong emphasis on Computer Vision (my area), deep diving in coherent coding exercises. Prof Andrew, as always, managed to connect the points between theory and practice, recollecting the concepts treated in past lectures, while showing how Tensorflow operates and how to use it. If you ask me, I'd say that the slides of the Machine Learning course used to be better than the slides for the 4 courses in this specialization, in the sense of being useful as studying guide for the future. The current slides only make sense to those who went through the course.

by Luca C

•Jan 27, 2019

Knowing this makes the difference. How do you evolve from being a monkey behind a keyboard knowing how to tensorflow a NN to homo sapiens? The concepts provided in this course will make the job.

pros: + workflow to address and optimize your supervised learning problems

+ wide and easy-to-get overview on most essential concepts

+ improves your understanding of NN; those who are already familiar with these concepts might still benefit from this clear and insightfull presentation

cons: - programming assignment will not suffices to give you a sufficient knowledge of tensorflow to make your own applications, you should integrate a bit. (However, mastering tensorflow is not the intention of the assignment).

by Baohe Z

•Oct 05, 2017

Good pace for beginner as the last one. With step by step teaching us a lot of useful skills to train our model much faster, Andrew starts to put more attention on practical field, and rather than giving us many equations, he as before likes to use some vivid examples for giving us an intuition, which I think is very helpful to understand those scientific words of computer science. But it doesn't mean, that this course is perfect, even I gave a full point to it. The subtitles have a lot of mistakes and the audio is also poorly processed. Sometimes, you will hear the same words twice.

But in a word, this is the best course for the beginners and the engineers who are willing to know something about ML and AI.

by Amilkar A H M

•Nov 24, 2018

I loved it. It showed me practical aspects of machine learning, including how to chose the hyperparameters and how to use tensor flow. My only complain is that I'm not sure how much of this information I will retain given that the practical exercises are guided. They build a lot of the functions for you. Still I'm giving it 5 stars because I have not seen this problem solved so far in any other Coursera course. They need to find a balance between teaching you a lot and making it easy enough for most people to be able to pass the exam and not get stuck in the details. Probably they could offer extra practice automatically graded exercises for those of us who want to make sure we won't forget the material.

by Victoria D

•Nov 25, 2019

I'd highly recommend this course to any of my colleagues interested in Deep Learning.

It is a great followup to Deep Learning and Neural Networks.

My one 'complaint' is that the mathematical depth is too shallow for someone like me (PhD, Mathematical, Computational and Experimental Physics)

It would be great if there was a course that was targeted to people with advanced STEM degrees, and years and years ( 4 decades in my case) of software engineering experience, where more time was spent on the mathematical framework, and the basic algorithms; that way, I'd have the satisfaction and pleasure of constructing the full algorithm implementations myself.

That being said, once again, Andrew is a great teacher.

by Matthew J C

•Feb 28, 2018

I was very impressed with the quality of Dr.Ng's teaching; simple enough to build confidence in your understanding of the inner workings of neural networks yet thorough enough to prepare you for deeper study (academic or otherwise). For $50 this course is a steal; you could go gather all the information & struggle through it yourself but be prepared to spend a lot of time & effort sifting through mis-information.

After taking the 1st coarse I was impressed; course 2 follows in a similar vain. Some of the courses offered through Coursera are more polished than others; if you're at all curious in deep learning, or even if you've already begun your studies, do NOT miss out on this opportunity.

by Francis S

•Aug 26, 2019

Previously, I have taken online classes before in Machine Learning by going the cheap route (Udemy, blogs, youtube) and you get what you pay for. Andrew Ng explains it the most thorough, easiest, and simplest way possible. Presentation material is very understandable. Great class for new machine learning learners. Highly recommend it. The only downside is that the programming exercises are little too easy in my opinion. I feel like the best way to get your hands dirty is to do actual projects (do your own projects). These lectures are good for intuition and background of different types of Neural Network architectures. Other than that, Great material. Thanks Andrew!

by Emilio J

•Mar 20, 2019

El curso está muy bien impartido por Andrew NG y te permite adquirir muy rápido conocimientos sobre los puntos clave para mejorar el aprendizaje con redes neuronales de una forma genérica. La práctica de programación con la plataforma tensorflow de python es muy valiosa, aunque se hecha de menos una mayor profundidad en el uso de las herramientas disponibles de tensorflow y otras utilidades de python para redes neuronales. El curso utiliza como ejemplos didácticos y prácticas la aplicación de redes neuronales al reconocimiento de imágnes, pero estaría bien ampliar los ejemplos con aplicaciones prácticas a otros campos como puede ser un modelado de un proceso físico.

by Adam S

•Feb 07, 2020

Andrew ng is simply the best. He is by far the number one teacher for ML. He explains the materials in such an intuitive way like no one else. I think that for my needs, he introduces just the right amounts of math and practicality.

This course really showed me how gradient descent optimization methods work. From before, I knew about these optimization methods and what they do, but never fully understood them. After taking this course I feel much more confident using them. The transition to tensorflow is done at the perfect time. After writing NNs yourself using numpy (first course in this specialization), you can truly appreciate tensorflow.

by Teguh H

•Nov 29, 2017

Great in depth explanation from ground up on how to tune parameters. Including many personal experience by Andrew Ng throughout years of experience of handling AI projects. Before going into quick shortcut by using the Tensorflow libraries, it is really useful to know the concepts and intuition on how Deep Learning works from ground up. Also teaches you how to solve with many problems in overfitting, underfit, reading the results. In short, his experience that has seen many researches spent too much time into creating projects, and end up hitting brick walls, is summarised with suggestion on how you can avoid that in your AI project.

by Gerardo M L

•Jun 18, 2019

The course is amazing, the instructor explains everything with a good level of comprehension. All the covered topics are easy to understand, and the tips given are valuable. The examples given are new including also the information seen in the previous course, so you have a review of parts of the content you have seen. Although he keeps using the cat example, he introduces new other applications that are useful.

I wish that the last assignment were a little bit harder, or that we could use our previous knowledge and complement it with this new, but I suppose that it is this way because of pedagogy and it focus on the topic.

by Jason J D

•Aug 06, 2019

This course is wonderful! Hats off to Prof. Andrew. The explanation for each topic is step wise and well organized. Every detail and reasoning is covered up. Even though there is a lot of content in this course, it is easy to remember and understand most of it, because of the way it is explained. The programming exercises are well planned and guide you through the code well. This course also has a brief introduction to TensorFlow, which is explained well through its programming exercise. Overall, this course is really good for those who are looking to master the methods to improve and optimize Neural Networks.

by Maximiliano B

•Oct 27, 2019

The second module of the deep learning specialization is excellent. You will learn best practices regarding hyper-parameter tuning, how regularization can be used in Neural Networks, optimization algorithms such as Momentum, RMSProp and Adam. In addition, you will be able to build your first machine model using tensor flow as part of the practical assignments. Professor Andre NG explains the content clearly and it is very pleasant to watch his lectures. I definitely recommend this course because it will give you confidence to build your own models and will provide several additional tools in your tool-belt.

by Carson W

•Jan 04, 2018

As with the first course in this specialization, the presentation was spot-on and the content was rich. The practical application is a wonderful tool for learning and I feel as though I have learned much more than I might have in a traditional classroom. I also feel that this course was slightly more challenging than the first, and introduced me to a few concepts I hadn't heard of before despite other research and development in AI/ML. Thank you so much for your dedication to sharing your knowledge and introducing new students to some of the brightest minds in the field with the optional interview videos.

by Nimish S

•Aug 15, 2017

Having done multiple Udacity Nano Degrees and other deep-learning/AI courses on Coursera/edX, I can say that deeplearning specialization is probably the best and most detailed to master the basics of Neural Networks and deep learning. This course is great in helping understand tuning of hyper-params, various optimization techniques and approaches. Videos do a great job in explaining complex and confusing concepts in easy to understand style. Assignments cement the understanding further.

Kudos to the Prof Andres Ng and rest of the deeplearning.ai team for putting up such a great content.

by Ali Z

•Nov 01, 2018

small description error on the last project. tensorflow tutorial project.

X, Y = create_placeholders(12288, 6)

print ("X = " + str(X))

print ("Y = " + str(Y))

X = Tensor("Placeholder:0", shape=(12288, ?), dtype=float32)

Y = Tensor("Placeholder_1:0", shape=(6, ?), dtype=float32)

Expected Output:

X Tensor("Placeholder_1:0", shape=(12288, ?), dtype=float32) (not necessarily Placeholder_1)

Correct this from Y Tensor("Placeholder_2:0", shape=(10, ?), dtype=float32) (not necessarily Placeholder_2)

to:

Tensor("Placeholder_2:0", shape=(6 ?), dtype=float32) (not necessarily Placeholder_2)

by Shahed B S

•May 31, 2018

This course goes into the various parameters and hyperparameters of deep neural networks, as well as suggestive values for ones we can use. This course is short in duration, but a lot of content is developed in here. It touches in on Tensorflow. The template based assignments provide great intuition for getting right on to the topics being taught, however, I feel there should be scope for more programming assignments where the student should be able to write more of that template as well. All in all, Andrew Ng is a great teacher and it was a pleasure to learn from him.

by Jong H S

•Oct 02, 2017

At the time of writing this review, I have completed 3 of the 5 courses. I personally think these 3 courses are not merely courses to fill up the specialization. It is a journey, an incredible one. I will write metaphorically. My journey so far is like becoming a magician with Course 1 on how to become one, then went on to Course 2 to learn from the master magicians, their secrets revealed and Course 3 on what to do to put up a good show at Las Vegas trying to fool Penn and Teller. This specialization is my treasure vault. Great job to Prof Andrew Ng and team.

by Vincent F

•Jan 23, 2018

This course provided me with an understanding of the large number of hyper parameters that have to be tuned during a deep learning project. It gave me an insight on when different techniques like regularization and (the many different forms of) optimization need to be applied. The only quibble I have is that the material on the choice of the number of layers and the number of hidden units per layer was thin. Given that these values have a great impact on the speed of progress in a deep learning project I would have liked to have seen a little more emphasis on them.

by Ernest S

•Nov 05, 2017

This course offers ground knowledge in all mayor concepts of non-recursive neural network and is excellent preparation to further exploring of this topic. Lectures cover broad choice of topics and discusses many problems you might encounter during your journey. Professor Andrew Ng explains theory in a way which builds good intuition and gives you building blocks for face the challenges of machine learning. If you are fluent with calculus or have academic background and expect to discover math behind the scenes I think you will be content too. I surely was.

by Aditya B

•Jan 12, 2019

The concepts has been explained in a fantastic way. But few suggestions:

-> After every lesson, I would love to have more pop quizes. This was the case with course 1, but I didnot get any pop quizes for this one.

-> In the quiz assignment, it would be nice to have an explanation or justification section, which will explain that why the option selected is a correct one and why the other options are incorrect. I know we can have the same discussion in the forums, but such an explanation ( one liner should be fine) can provide a good instant knowledge boost!

by Robin S

•Jun 09, 2018

Another very well done course. You do a good job describing the benefits of Batch Norm, a lot more intuitively than presented in Szegedy's paper, which is pretty math heavy. However, I did notice one little ERROR on the Tensorflow project page, albeit an insignificant one. Double check that the expected output shape for the cell that outputs the shape of the training set and testing set. One of the expected outputs said that the test set should have 10 possible classes, when the dataset is for 0-5 fingers. This would be a very strange looking hand ;)

by Mohanad Q A A

•Feb 26, 2019

I'm actually learning and comprehending the course, I do pause the videos occasionally to research some concepts, write some notes in a copybook but overall this specialty(so far course 1 & 2 ) is really filling the gaps in my mind to build a clearer picture of the topic of Machine Learning and Deep Learning. Andrew Ng explains really well, sometimes he through some good recommendations based in his practical experience and this is really valuable for me because it actually helps in improving the learning process.

Thank you Andrew and Coursera Team.

by Yashveer S Y

•Jun 02, 2018

This course is perfect bite for your hunger of Deep learning. Before taking this course I have gone through some books and and some blogs too but there was not that much of clarity to topic so finally I tried for this one and trust me this course is so organised and very informatic so go for this one, I assure you will feel more confident and knowledgeable after completing this course. I would like to thanks Coursera as well as deeplearning.ai community for providing this course and Want to specially thanks to Mr. Andrew Ng for his contribution

by David M

•Sep 01, 2017

This is a practical course on how to work with neural networks. It covers a collection of "tips" and techniques, all grounded on a solid theoretical framework, to make a classifier train faster and be more accurate. The explanations are all engaging and interesting, and the assignments are rather easy.

The knowledge gained from this course is probably what everybody working in machine learning already knows, but if you are new to the field this is a great way to get up to speed fast and start implementing neural networks for your own projects.