Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization に戻る

星

60,687件の評価

•

7,030件のレビュー

In the second course of the Deep Learning Specialization, you will open the deep learning black box to understand the processes that drive performance and generate good results systematically.
By the end, you will learn the best practices to train and develop test sets and analyze bias/variance for building deep learning applications; be able to use standard neural network techniques such as initialization, L2 and dropout regularization, hyperparameter tuning, batch normalization, and gradient checking; implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence; and implement a neural network in TensorFlow.
The Deep Learning Specialization is our foundational program that will help you understand the capabilities, challenges, and consequences of deep learning and prepare you to participate in the development of leading-edge AI technology. It provides a pathway for you to gain the knowledge and skills to apply machine learning to your work, level up your technical career, and take the definitive step in the world of AI....

XG

2017年10月30日

Thank you Andrew!! I know start to use Tensorflow, however, this tool is not well for a research goal. Maybe, pytorch could be considered in the future!! And let us know how to use pytorch in Windows.

AM

2019年10月8日

I really enjoyed this course. Many details are given here that are crucial to gain experience and tips on things that looks easy at first sight but are important for a faster ML project implementation

フィルター：

by Sachita N

•2018年6月18日

Professor Ng explains the most complicated concepts in the most intuitive fashion I have ever seen. The explanations are simple, straightforward and they encompass so many perspectives and alternatives to doing things. The exercises are immensely educational - they strike a great balance between guiding the student and letting them figure stuff out on their own. This is a great specialisation and I would whole-heartedly recommend it for anyone wanting to start with Deep Learning

by kindalin

•2019年7月31日

This is the best course I have ever seen. The previous mooc class gave me some bad impressions, which is be created by some scholars for KPI. I believe that such a well-designed course will eventually replace the traditional curriculum. This is also a good hope for our students in non-brand schools.

The only downside is that the coursework instructions are too detailed as many people reflect. I can see a lot of good and hard designs in it, but I hope it can have a better form.

by Joppe G

•2017年8月13日

This course is simply brilliant. You start with implementing the low-level functions that make up a deep learning framework. It's only in the last assignment that you explore TensorFlow. At that point, you have a full understanding of what the API encapsulates.

This really gives you confidence in your capability to get started with your own projects, knowing that you can come back at any time to brush up on some of the lower-level details.

Thank you Andrew and the whole team!

by RAJEEV B

•2017年11月17日

The assignments are very good. All the parameter update methods are explained in a very good manner. I would recommend it very strongly for anyone who is looking for an in depth understanding of why we do what we do for tuning, regularization, optimization of NN. All the implementation in the assignments is also from scratch, so, that really helps a lot. I felt this is better than Stanford CS231n course material, after all this is a whole course on this specific purpose :).

by Marcel M

•2018年6月1日

This course a practical way of fine tuning your model in order to improve on its performance. Rather than Deep Learning being a "so-called" black box. It turns out that Machine Learning models are not black boxes but rather there are proven techniques of not only finding out what happens in them but also to fine tune them in a systematic manner in order to improve on their results. It is an excellent course for the practical Deep Learning Engineer. Good Job and Keep It Up!

by Artem M

•2018年4月22日

Found a lot of interesting details about NN that I did not know. This is a much better course than the first one. IncludesTensorflow exercises, which is useful. Nevertheless, proofs are still omitted for some results like initializations. It is not hard to google, but I bet lecturers could explain them much faster than diving into science literature. Otherwise, intuitional explanations of Adam using exponential smoothing, or physics analogy of momentum are just brilliant.

by Daniel C

•2018年1月13日

True to the claimed learning objectives, the course Improving Deep Neural Networks shows some of the magic behind deep learning algorithms. The programming assignments solidify abstract concepts discussed in lecture videos. In fact, some portions like seeing cost decreases in real-time for Adam Optimization are truly eye-opening experiences.

One possible improvement is better editing of instructions and code comments of TensorFlow Tutorial Programming Assignment in Week 3.

by Alexander H S

•2021年4月7日

Great course for an introduction for the topics discussed. Not having a math background, this finally allowed me to connect the dots between the techniques discussed in articles and the math behind them, as well as helped to demystify the all of the greek symbols thrown around. It would be nice to see the course upgrade the final assignment to use Tensorflow 2.x instead of the now deprecate 1.x, since Tensorflow has rearchitected the public surface of their public API.

by Pedro B M

•2019年2月4日

As always Andrew Ng is very didactic explaining different and complex hyperparameter tuning techniques and optimizations algorithms, giving intuitive explanations and examples. I've been learning a lot in these courses! And more than that, the content is presented in such a way that motivates the student to go beyond and explore/try different implementations and problems to apply. I highly recommend the course for anyone who wants to become a serious ML practitioner!

by Johnathan T

•2017年9月1日

This class was awesome! Thank you to Andew Ng and his team for putting this Specialization together. It is amazing for someone with so much experience in this field to be willing to share their wisdom with everyone, practically for free. The course content is filled with information that would have taken me years of to acquire. I am fortunate to have the opportunity to build a strong foundation in this field at a time when A.I. is becoming society's new electricity!

by Anton V

•2018年6月13日

A very valuable course to improve your understanding and develop a better toolset in using NNs. The instructor gives great tips on how to approach problems and explains the latest techniques very well. Also features a nice introduction to TensorFlow. As an experienced programmer I found this course to be a breezy and fast hands-on tutorial to get you going quickly if you are doing these courses to apply for something you are interested in (e.g. personal project)

by AVADH P

•2020年1月7日

Excellent course!! Really glad to have taken this course as a part of the Deep Learning specialization. This course gives a breakthrough in designing neural networks and deep networks using a thorough understanding of all the major aspects to be considered. The course also helps in learning current industry-wide used opensource frameworks such as TensorFlow. The assignments are well designed to make the step by step understanding and exercise of the learning.

by Yuri C

•2021年1月22日

I must say, I found this course amazing. I have read and also had contact already with other presentations on the topic. But Andrew Ng did an amazing job preparing the material. It is both didactic and mathematically precise, when it is needed. As a mathematician, I was expecting a more "programmer-oriented" course and I was delighted to get both, the explanations precision of the mathematical formulation and the tips and tricks of DL practice. 10 out of 10.

by Matheus B

•2017年9月22日

Um dos cursos que mais gostei até o momento. Desde que comecei a estudar deep learning vejo se falar de muitas técnicas que pareciam impossíveis de compreender e implementar, mas esse curso não só ensina como implementar algumas delas, como também ajuda a entender o motivo dessas técnicas serem tão boas para os modelos de redes neurais, dando uma boa intuição de como cada método funciona. Além disso, apresenta e ajuda a desmistificar o framework tensorflow.

by Joe M

•2019年7月14日

This course was a great continuation of the first. The lecture pace is great (and ability to speed up or slow down the video speed helps a lot), the reiteration of past lessons helps with some of the denser materials, and the overall presentation is excellent. Also very nice that the problem sets aren't out to trick you! The material is new enough to many of us to begin with! The emphasis on practical application of the material is key (for me, at least).

by Nidhi V S

•2020年4月27日

This course is very well designed and the instructor does an amazing job at explaining the concepts making it easy to learn, even for a novice in the field. This course helped me to get a greater understanding of Neural Networks. I learned how to enhance the performance of Neural Network by selecting appropriate hyperparameters, using regularization, using normalization and various other techniques. It was interesting to learn about the Softmax function.

by Ricardo S

•2017年12月17日

The course covers an extremely important topic (I know I've been lost in hyperparameter maze before) , and allowed me to get a good feeling of what, when and how to use hyperparameters. I guess that to actually master the topic students will have to practice with their own models and data sets, therefore I think that getting actual practice on this topic would be out of the scope of the course, and thus I think the programming assignments were adequate.

by Holger O

•2019年5月23日

Prof. Andrew did it again! I took the "classical" Machine Learning course and I'm pleased to see that this continuation was as good or even better. A total equilibrium between the mathematical depth you need to understand the basis of the algorithms and the practical skills you need to put them in practice in the real world, in the exact amount for them to fit in a 18-hour course. As a starting point, this course is perfect! Eager to keep on learning...

by David F

•2017年9月16日

These courses are awesome. Andrew Ng is a very clear professor and the interviews with other ML practitioners are enlightening. My one criticism is that the assignments are put on a plate for you so they're pretty easy to complete but then difficult to replicate in real life (since so much of the scaffolding was taken care of for you while learning). But maybe that helps to preserve the flow of the class, rather than getting you bogged down in details.

by Sergio B S

•2018年8月1日

I began using Deep Learning Frameworks before this course, but...

I realise now, after this second course and the first one, that learning the maths behind Neural Networks helps exponentially to understand and internalize what is the real use of some of the most important hyperparameters and the what's and why's of good strategies to regularize models. As A.Ng repeat sometimes, this specialization help me "To get the intuition" to improve the models.

by Amit K

•2018年12月4日

This is good course for the student, who want to do real stuff with NN. Some of the tricks are well explained like L2,dropout, adam, momentum, minibatches etc. I think these are much needed tricks if i need to implement and tune my own NN on my own problems. I prefer to have a second level of such course which really talks about challenges in real life NN and how to solve those. Once again thanks alot for the entire Team for pulling this together.

by Eleanna S

•2018年3月4日

Very useful course. Gives great insight on the hyper parameter tuning, regularisation and optimisation. One request I have is to provide a docker image which we can use to run the exercises locally. Sometimes I found it hard to build the environment where I can run the coursework. Some of the installations are clashing and it is not clear what versions of libraries are used in the coursework environment. It sometimes requires unnecessary effort.

by Hugo v d B

•2017年9月26日

In the second course of the Deep Learning specialization Andrew gets deeper into the different subjects of Neural Networks. Again he does a great job in explaining both the math and the way you can improve the outcoming of deep neural networks. The quizzes and assignments where helpful and not difficult at all. He also shows some good frameworks to work with and gives a nice introduction to Tensorflow. I'm looking forward to start with course 3.

by Parab N S

•2019年8月25日

Excellent course demonstrating the ways to improve the accuracy of the deep neural networks. It had been the case with me that I could create an initial model easily, but getting an expected level of accuracy was difficult. This course has made it much easier for me to improve th performance of my deep learning models within a short span of time. I would like to thank Professor Andrew N.G. and his team for developing such a wonderful course.

by Xizewen H

•2017年10月5日

This course is where the specialization really distinguish itself from Udacity's deep learning nano degree program -- the model fine-tuning part is very important and there are lots of details can be talked about, but Udacity somehow avoided going into details for it. After taking the Udacity's course first, I feel this course really helped me refreshed some knowledge I learnt as well as teach me much more. Definitely recommend this course!

- Google データアナリスト
- Googleプロジェクトマネジメント
- グーグルUXデザイン
- Google ITサポート
- IBMデータサイエンス
- IBMデータアナリスト
- ExcelとRを使用したIBMデータ分析
- IBMサイバーセキュリティ・アナリスト
- IBMデータエンジニアリング
- IBMフルスタック・クラウドデベロッパー
- Facebookソーシャルメディアマーケティング
- Facebookマーケティング分析
- Salesforce営業開発担当者
- Salesforce Sales Operations
- インテュイット簿記
- Google Cloud 認定資格の取得準備：クラウドアーキテクト
- Google Cloud 認定資格の取得準備：クラウドデータエンジニア
- キャリアをスタートさせましょう
- 証明書の取得準備
- キャリアアップ

- データサイエンスチームのためのスキル
- データ駆動型意思決定
- ソフトウェアエンジニアリングのスキル
- エンジニアリングチームのためのソフトスキル
- マネジメントスキル
- マーケティングのスキル
- セールスチームのためのスキル
- プロダクトマネージャのスキル
- ファイナンススキル
- イギリスで人気のデータサイエンスコース
- Beliebte Technologiekurse in Deutschland
- 人気のサイバーセキュリティ証明書
- 人気の IT 証明書
- 人気の QL 証明書
- マーケティングマネージャーキャリアガイド
- プロジェクトマネージャーキャリアガイド
- Pythonプログラミングスキル
- Web開発者キャリアガイド
- データアナリストのスキル
- UXデザイナーのためのスキル