Wednesday, 7 December 2016

1. Introduction to Hadoop | Hadoop Tutorial


We are living in the information age, thus with the advent of the Digital revolution, we have a large number corporations to serve our needs, to make our lives easier and to take us to the next level of humanity. To achieve this task these corporations need a base on which they could achieve this task. This “base” is the data which they have generated over the course of time.

Data is ever generating. Each second piles of data are being generated. Let’s have a look at an example : Facebook has 1.79 billion active monthly users. These users are uploading images, videos, posting texts, comments, likes, etc. which is being done every second which accounts for all types of data - structured, semi-structured and unstructured. Now let’s say, if each user hits at least one like a day, it would account to 1.79 billion likes to handle in a day. But we all know that is surely not the case, the real figures are much more humongous than that. Likewise, did you ever pondered that the thousands of Apps on the Google play store having having millions of download with each user generating data, What happens to that data ?

This data is processed and analyzed by respective companies to add competitive advantage to their Corporation and come up with future solution for them to serve the customers better, learning from the scenarios of the present. For example, people comment their reviews about specific products on Amazon, these reviews are then processed by Amazon to understand the plight of the customer and provide better service in the future.

According to the prevailing Database management system, handling this amount of data generating at this pace is a challenge as it required high memory(RAM), scaling beyond a capacity often involved downtime and came with an upper limit. Also, it would not have been cost friendly. Further, RDBMS was unable to categorize unstructured data.

So the question arises, how to process these data sets ? The answer to this is HADOOP.



















Hadoop is an open source framework that allows distributed processing of large data sets across clusters of commodity hardware.

Open Source : In contrast, to the traditional RDBMS systems which required purchasing a license, Hadoop is readily available without any cost, maintained by Apache foundation.

Distributed processing : Hadoop framework splits the data into chunks and processes them in parallel. This makes it time efficient in handling big data sets. e.g. If you have to write 10,000 pages. What would you prefer, hiring the world’s fastest writer or hiring 100 writers a day ? Definitely, the latter is much faster and cheaper.

Large Data Sets: Used to process big data sets with ease. All the processing happens on the data present in HDFS (Hadoop File System). Since the data is divided into different machines and processed in parallel, it allows to process massive data.

Commodity Hardware : Hadoop uses cheap and simple hardware rather than high enterprise computers that cost too much. “China mobile”, a Telecom Company based in China, which was generating 5-8 TB data of records daily. Hadoop enabled them to use 10 times data than their older system at ⅕ cost.

Next Article : 2. Advantages of Hadoop

72 comments:

  1. Creating visualization and sharing your visualization. How it is different from MS Excel or other tools. Tableau helps anyone quickly analyse, visualize and share information
    http://bigclasses.com/tableau-online-training.html

    ReplyDelete
    Replies
    1. Big data is a term that describes the large volume of data – both structured and unstructured – that inundates a business on a day-to-day basis. IEEE Projects for CSE in Big Data But it’s not the amount of data that’s important. Project Centers in Chennai It’s what organizations do with the data that matters. Big data can be analyzed for insights that lead to better decisions and strategic business moves.

      Spring Framework has already made serious inroads as an integrated technology stack for building user-facing applications. Corporate TRaining Spring Framework the authors explore the idea of using Java in Big Data platforms.
      Specifically, Spring Framework provides various tasks are geared around preparing data for further analysis and visualization. Spring Training in Chennai

      Delete
  2. Very help full article on Hadoop for Beginner.
    Hadoop technology has a huge demand in IT Industry.
    http://eonlinetraining.co/course/big-data-hadoop-online-training/

    ReplyDelete
  3. I really appreciate information shared above. It’s of great help. If someone want to learn Online (Virtual) instructor lead live training in Talend
    MaxMunus Offer World Class Virtual Instructor led training on Talend. We have industry expert trainer. We provide Training Material and Software Support. MaxMunus has successfully conducted 100000+ trainings in India, USA, UK, Australlia, Switzerland, Qatar, Saudi Arabia, Bangladesh, Bahrain and UAE etc.
    For Demo Contact us.
    Nitesh Kumar
    MaxMunus
    E-mail: nitesh@maxmunus.com
    Skype id: nitesh_maxmunus
    Ph:(+91) 8553912023
    http://www.maxmunus.com/


    ReplyDelete
  4. It is really a great work and the way in which you are sharing the knowledge is excellent.Thanks for your informative article

    Hadoop Online Training
    Data Science Online Training

    ReplyDelete
  5. I am technology Enthusiast. Your blog is really awesome, attractive and impressive. I like the way you think. it is very useful for Java SE & Java EE Learners. Your article adds best knowledge to our Java Online Training India. or learn thru Java Online Training India Students. or learn thru JavaScript Online Training India. Appreciating the persistence you put into your blog and detailed information you provide. Kindly keep blogging.

    ReplyDelete
  6. Really useful information about hadoop, i have to know information about hadoop online training institutes.

    ReplyDelete
  7. Best Digital Marketing company Anantapur
    helpful information, thanks for writing and share this information

    ReplyDelete
  8. Best Digital Marketing company hyderabad
    It's Really A Great Post. Looking For Some More Stuff. .

    ReplyDelete
  9. Really useful information. we are providing best data science online training from industry experts.

    ReplyDelete
  10. You have provided an nice article, Thank you very much for this one. And i hope this will be useful for many people.. and i am waiting for your next post keep on updating these kinds of knowledgeable things...

    Hadoop Training in Gurgaon,



    ReplyDelete
  11. I simply wanted to write down a quick word to say thanks to you for those wonderful tips and hints you are showing on this site
    data-science-training-in-bangalore

    ReplyDelete
  12. Really useful information. we are providing best data science online training from industry experts.

    ReplyDelete
  13. It's been a long time since I settle in this activity and life has been great. One great choice in my life overcomed a ton of obstacles. data science course in pune

    ReplyDelete
  14. Well, The information which you posted here is very helpful & it is very useful for the needy like me.., Wonderful information you posted here. Thank you so much for helping me out to find the Data science course in Mumbai Organisations and introducing reputed stalwarts in the industry dealing with data analyzing & assorting it in a structured and precise manner. Keep up the good work. Looking forward to view more from you.

    ReplyDelete

  15. This knowledge.Excellently written article, if only all bloggers offered the same level of content as you, the internet would be a much better place. Please keep it up.

    data science institute

    ReplyDelete
  16. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.
    Data Science Course in Bangalore

    ReplyDelete
  17. Undertakings should be innovative and shrewd in their way to deal with this as yet developing stage. machine learning course

    ReplyDelete
  18. Actually I read it yesterday but I had some thoughts about it and today I wanted to read it again because it is very well written.

    Data science course in malaysia

    ReplyDelete
  19. Attend The Data Science Training in Bangalore From ExcelR. Practical Data Science Training in Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Science Courses in Bangalore.
    Data Science training in Bangalore

    ReplyDelete
  20. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.
    ExcelR's Data Science Course in Bangalore

    ReplyDelete
  21. Attend The Artificial Intelligence course From ExcelR. Practical Artificial Intelligence course Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Artificial Intelligence course.
    ExcelR Artificial Intelligence course

    ReplyDelete
  22. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. I would like to state about something which creates curiosity in knowing more about it. It is a part of our daily routine life which we usually don`t notice in all the things which turns the dreams in to real experiences. Back from the ages, we have been growing and world is evolving at a pace lying on the shoulder of technology. Analytics Certifications will be a great piece added to the term technology. Cheer for more ideas & innovation which are part of evolution

    ReplyDelete
  23. Nice Post...I have learn some new information.thanks for sharing.
    Data Science Course in Mumbai

    ReplyDelete
  24. Well, the most on top staying topic is Data Science. Data science is one of the most promising technique in the growing world. I would like to add Data science training to the preference list. Out of all, Data science course in mumbai
    is making a huge difference all across the country. Thank you so much for showing your work and thank you so much for this wonderful article.

    ReplyDelete

  25. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. I would like to state about something which creates curiosity in knowing more about it. It is a part of our daily routine life which we usually don`t notice in all the things which turns the dreams in to real experiences. Back from the ages, we have been growing and world is evolving at a pace lying on the shoulder of technology."institutes for data science in hyderabad" will be a great piece added to the term technology. Cheer for more ideas & innovation which are part of evolution.

    ReplyDelete
  26. Such a very useful article. Very interesting to read this article. I would like to thank you for the efforts you had made for writing this awesome article. Data Science course Hyderabad

    ReplyDelete
  27. Nice Article...Very interesting to read this article. I have learn some new information.thanks for sharing.
    Click here

    ReplyDelete

  28. I am a new user of this site so here i saw multiple articles and posts posted by this site,I curious more interest in some of them hope you will give more information on this topics in your next articles.
    excelr data science

    ReplyDelete
  29. Here at this site really the fastidious material collection so that everybody can enjoy a lot. ExcelR Data Science Courses

    ReplyDelete
  30. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!
    Click here

    ReplyDelete
  31. I have been searching to find a comfort or effective procedure to complete this process and I think this is the most suitable way to do it effectively. ExcelR Data Science Classes In Pune

    ReplyDelete
  32. Great tips and very easy to understand. This will definitely be very useful for me when I get a chance to start my blog. ExcelR Data Science Classes In Pune

    ReplyDelete
  33. I am really enjoying reading your well written articles. It looks like you spend a lot of effort and time on your blog. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work.
    ExcelR data analytics courses

    ReplyDelete
  34. Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one. Keep posting. Thanks for sharing.
    ExcelR data science course in mumbai

    ReplyDelete
    Replies
    1. Awesome..I read this post so nice and very imformative information...thanks for sharing
      Click here for data science course

      Delete
  35. Attend The Data Analytics Course in Bangalore with Placement From ExcelR. Practical Data Analytics Course in Bangalore with Placement Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Analytics Course in Bangalore with Placement.
    ExcelR Data Analytics Course in Bangalore with Placement

    ReplyDelete
  36. Just saying thanks will not just be sufficient, for the fantastic lucidity in your writing. I will instantly grab your articles to get deeper into the topic. And as the same way ExcelR also helps organisations by providing data science courses based on practical knowledge and theoretical concepts. It offers the best value in training services combined with the support of our creative staff to provide meaningful solution that suits your learning needs.
    Business Analytics Courses

    ReplyDelete
  37. Cool stuff you have and you keep overhaul every one of us

    data analytics courses in hyderabad

    ReplyDelete
  38. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    data analytics classes

    ReplyDelete
  39. I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
    data science courses

    ReplyDelete
  40. Excellent work done by you once again here. This is just the reason why I’ve always liked your work. You have amazing writing skills and you display them in every article. Keep it going!
    ExcelR Data Analytics Course

    ReplyDelete
  41. Please check ExcelR Data Science Courses
    It is extremely nice to see the greatest details presented in an easy and understanding manner.

    ReplyDelete
  42. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    data analytics courses

    ReplyDelete
  43. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    Please check ExcelR Data Science Certification

    ReplyDelete
  44. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!
    data analytics courses

    ReplyDelete
  45. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!
    data analytics course in hyderabad

    ReplyDelete
  46. Actually I read it yesterday but I had some thoughts about it and today I wanted to read it again because it is very well written.
    Please check ExcelR Data Science Certification

    ReplyDelete
  47. Search and Apply to Jobs from leading placement consultants online at Eswar Solutions.
    HR Management Company in Bangalore

    ReplyDelete
  48. This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck... data science course

    ReplyDelete
  49. It is imperative that we read blog post very carefully. I am already done it and find that this post is really amazing. ExcelR Data Analytics Courses In Pune

    ReplyDelete
  50. Regular visits listed here are the easiest method to appreciate your energy, which is why why I am going to the website everyday, searching for new, interesting info.
    Data Science courses

    ReplyDelete
  51. Its as if you had a great grasp on the subject matter, but you forgot to include your readers. Perhaps you should think about this from more than one angle.
    data analytics course mumbai

    ReplyDelete
  52. Nice information regarding the hadoop which will help the people who are learning the data science , big data and artificial intelligence.
    click here know about :
    Data science courses
    Data analytics course
    Business analytics course
    Data science interview questions

    ReplyDelete
  53. This post is very simple to read and appreciate without leaving any details out. Great work! data science course

    ReplyDelete
  54. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.
    data science course in mumbai

    data science course in mumbai

    You can reach us:
    ExcelR - Data Science, Data Analytics, Business Analytics Course Training in Mumbai

    304, 3rd Floor, Pratibha Building. Three Petrol pump, Opposite Manas Tower, LBS Rd, Pakhdi, Thane West, Thane, Maharashtra 400602

    Contact Number : 18002122120

    ReplyDelete
  55. This post is very simple to read and appreciate without leaving any details out. Great work! best institute for data science in bangalore

    ReplyDelete
  56. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!
    data science course in mumbai
    data science interview questions

    ReplyDelete
  57. Excellent Blog! I would like to thank for the efforts you have made in writing this post. I am hoping the same best work from you in the future as well. I wanted to thank you for this websites! Thanks for sharing. Great websites!
    ExcelR Data Analytics Course
    Data Science Interview Questions
    ExcelR Data Science Courses Fee in Bangalore
    ExcelR Business Analytics Course in Bangalore

    ReplyDelete
  58. I like viewing web sites which comprehend the price of delivering the excellent useful resource free of charge. I truly adored reading your posting. Thank you!! best data science course in Bangalore

    ReplyDelete
  59. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.
    data analytics courses

    data science interview questions

    business analytics course

    data science course in mumbai

    ReplyDelete

  60. I finally found great post here.I will get back here. I just added your blog to my bookmark sites. thanks.Quality posts is the crucial to invite the visitors to visit the web page, that's what this web page is providing.
    excelr data science
    data science interview questions
    data analytics courses
    business analytics course

    ReplyDelete
  61. You might comment on the order system of the blog. You should chat it's splendid. Your blog audit would swell up your visitors. I was very pleased to find this site.I wanted to thank you for this great read!!
    data analytics courses in hyderabad
    business analytics courses
    data science course

    ReplyDelete
  62. This post is very simple to read and appreciate without leaving any details out
    AWS course

    ReplyDelete
  63. Personally I think overjoyed I discovered the blogs.
    Please check this Data Analytics Courses

    ReplyDelete
  64. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.

    Pediatric dentist in Bangalore

    ReplyDelete
  65. You completed a number of nice points there. I did a search on the issue and found ExcelR Data Analytics Course Pune nearly all people will have the same opinion with your blog.

    ReplyDelete