Chevron Left
Big Data Essentials: HDFS, MapReduce and Spark RDD に戻る

Yandex による Big Data Essentials: HDFS, MapReduce and Spark RDD の受講者のレビューおよびフィードバック



Have you ever heard about such technologies as HDFS, MapReduce, Spark? Always wanted to learn these new tools but missed concise starting material? Don’t miss this course either! In this 6-week course you will: - learn some basic technologies of the modern Big Data landscape, namely: HDFS, MapReduce and Spark; - be guided both through systems internals and their applications; - learn about distributed file systems, why they exist and what function they serve; - grasp the MapReduce framework, a workhorse for many modern Big Data applications; - apply the framework to process texts and solve sample business cases; - learn about Spark, the next-generation computational framework; - build a strong understanding of Spark basic concepts; - develop skills to apply these tools to creating solutions in finance, social networks, telecommunications and many other fields. Your learning experience will be as close to real life as possible with the chance to evaluate your practical assignments on a real cluster. No mocking, a friendly considerate atmosphere to make the process of your learning smooth and enjoyable. Get ready to work with real datasets alongside with real masters! Special thanks to: - Prof. Mikhail Roytberg, APT dept., MIPT, who was the initial reviewer of the project, the supervisor and mentor of half of the BigData team. He was the one, who helped to get this show on the road. - Oleg Sukhoroslov (PhD, Senior Researcher at IITP RAS), who has been teaching MapReduce, Hadoop and friends since 2008. Now he is leading the infrastructure team. - Oleg Ivchenko (PhD student APT dept., MIPT), Pavel Akhtyamov (MSc. student at APT dept., MIPT) and Vladimir Kuznetsov (Assistant at P.G. Demidov Yaroslavl State University), superbrains who have developed and now maintain the infrastructure used for practical assignments in this course. - Asya Roitberg, Eugene Baulin, Marina Sudarikova. These people never sleep to babysit this course day and night, to make your learning experience productive, smooth and exciting....



Everything in this course is new to me, but it provides me with many practice so I can gradually get familiar with all these new stuff. I find it a bit challenging, but overall it's quite good.


The course takes you from basic level , step level .But It is quite fast for beginners , you may need pause video in between and try to understand the concept.


Big Data Essentials: HDFS, MapReduce and Spark RDD: 76 - 100 / 148 レビュー

by Dorofei


Потратил больше времени на то, чтобы Grader правильно принял решения, чем времени на решение задачи. Потратить 3-4 часа на решение исходной задачи и потратить 10 часов (включая форум и Slack) на то чтобы ответ правильно принять. Особенно на задаче с Твиттер датасетом, ругается на количество редусеров, но оказывается, надо было логи yarn тоже выводить.

Хорошо было бы добавить еще одну проверку, которая проверяет выводятся ли логи yarn и сообщать, что его нет.

Если бы не эта проблема, поставил бы 5 звезд.

by Павел С


I think students could choose MapReduce or Spark. And about shortest path task. Provided by authors code runs out of memory while checking on cluster. After a lot of time playing with spark paramets and cache/persist i found solution without calculating all distances, but... Also there was no information about spark executors parameters on course...

Simple hint could save a lot of stupidly wasted time.

But it's not major, anyway thanks!

by Кряжевских С В


Practice work in this course is divided in two part. First, you try to solve an assignment into your home Docker environment. It's really interesting to do it in spite of the assignments is not very clear. Second, you try to put the result into the course's grader system. For me, Grader it's like a Major Payne. You will get an amazing experience to work with production cluster through not well suited environment.

by Marco G


Interesting, useful, informative, accessible (and sometimes funny!) lectures.

Stimulating assignments.

Fast responses from instructors/mentors.

Unfortunately, I often spent more time trying to get my assignments to pass the automatic grader than on solving them. This made the course a bit frustrating at times.

by Xuan Q N


Course provide me useful knowledge about Hadoop mechanism, Hadoop file, Apache Spark, Develop in Spark, and big data thinking. It's a great course. Sometime, you may be meet some trouble in exercise because of un-explicit in requirement, remember to follow the forum in you are stuck.

by Oliver P


Overall, a sound introduction of the topic. The first time, I understood these technologies. From time to time the tutorials and introduction videos have been a bit too quick, too sketchy to understand the content properly.

by Terry A


Good general overview, start to the subject. Frustrated at consistent issues with development environment and/or ability to debug. Responses to questions and mentor assistance is seriously lacking.

by Waldemar D


good course, covering a lot of foundations for Big Data and for Hadoop/Spark. Also one of the few that focus on Data Engineering perspective rather than Data Science. Learned a lot here!

by Gregory R


Great course! Please, follow up with discussion boards more. Otherwise, happy I took it.

Also, looking forward to the entire specialization ready, like course #4 about real Time Streaming.



Excelente curso, falta más realmentación por parte de los profesores, pero en general aunque el contenido es Denso y se requieren más horas de lo estipulado en el curso, es muy bueno.

by Alois T


The course is pretty ok, but beware to bend under the constraints of the automatic corrector. You can spend many hours just "fixing" your code despite having the good result

by Taras P


Materials are good, but there was a lot of problem with assignment clear understanding and infrastructure. Also would like to pass this course on Scala.

by Mahendra A


Overall course was good and informative.. Sometime it feels lil bit tough to grasp may be due to as its an entirely different domain for me

by Tomiwa k


the curriculum is fine, I learnt new things. the authors abandunded this course, no maintenance for the grading system. this shows be fixed

by Simon V L


The content of the course is really good. THe assignments should be made a lot clearer and the jupyter grading tool is full of bugs.

by Casper Y


The practises are practical and useful. However, there is an initial learning curve to get use to the grading tools.

by Abijith K


Expected more depth in Spark architecture but was kept at a high level

Course on HDFS were really good

by David Z


The content was a nice introductory course. The only thing that could be better is the grading system

by Vladimir


Good course, but the description of practical tasks is not always clear.

by Kirill L


Only four because of graduating tool. The contend is very interesting.

by Shreeharsha G


Challenging !! But need some more help on slack and active community.

by Rain



by Alexander K


Requires intermediate skills and ability to work on your own.

by Bo T


The assignment cannot submit correctly. Really disappointed!

by SAI V K


Course is good,but the grader doesnt work properly.