CloudEra Hadoop VMWare Single Node Environment Setup

Filed Under: Big Data

So far we have discussed about Hadoop Architecture and How Hadoop Components works. In this post, we will setup “CloudEra Hadoop VMWare With Single Node Environment” to start Hadoop MapReduce and YARN Development.

To setup “CloudEra Environment”, we need to install VMWare software in our Windows Machines.

Post’s Brief Table of Cotents

  • Introduction
  • VMWare Workstation Installation
  • CloudEra Hadoop VMWare Single Node Environment Setup
  • CloudEra Hadoop VMWare Quick Start With VMWare Workstation
  • Post CloudEra Hadoop Installation Checks

Introduction

VMWare is a software, which provides Visualization services. For instance, we have Windows 7 OS PC and want to setup CloudEra Environment in Ubuntu Linux Platform. How to do this?

VMware solves this kind of problems. We can create a VMWare Ubuntu instance, then Install VMWare Workstation software in our Windows machine. Finally open that VMWare Ubuntu instance using VMWare Workstation to create a Virtual Ubuntu Linux server in our Windows Machines.

We are going to doing this to install CloudEra Hadoop Software in Ubuntu Linux Server.

VMWare Workstation Installation

Please follow these steps to install VMWare Workstation software in Windows Systems:

  • Please subscribe with www.vmware.com website with your details
  • Please login to www.vmware.com website with your login details
  • vmware-login

  • Click on Downloads link to reach “VMWare Workstation” downloads page
  • vmware-download

    Here select your desired “VMWare Workstation” version from “Select Version:” dropdown window. I’ve selected 11.0 version.

  • Once download is over, we will see “VMWare Workstation” software in our Filesystem as shown below
  • vmware-software

  • Double click on “VMware-workstation-full-11.1.2-2780323.exe” file to install VMWare Workstation.
  • vmware-install1

    Accept licence and click on “Next” button

    vmware-install2

    Click on “Typical” button

    vmware-install3

    vmware-install4

    Select your required Filesystem path:

    vmware-install5

    Now we have installed “VMWare Workstation 11” software successfully.

One good news is that we don’t need to create CloudEra VMWare Ubuntu Hadoop instance. CloudEra has already prepared some instances, we just need to download them from their website. Now it’s time to download those instance from CloudEra website and see how to use them in next section.

CloudEra Hadoop VMWare Single Node Environment Setup

Please follow these steps to download CloudEra VMWare Ubuntu Hadoop instance and run it using our “VMWare Workstation 11” software.

  • Access this link to download CloudEra VMWare Hadoop Quick Start instances
  • http://www.cloudera.com/content/cloudera/en/downloads.html

  • Click on “Download Now” button from “QuickStart VMs” section
  • cloudera-quickstart-hadoop1

  • Select required version from “Version:” dropdown box as shown below.
  • We have selected “QuickStart VM with CDH 5.4.x” version

    cloudera-quickstart-hadoop2

    Here click on “Download for VMware” button to download our required VMWare instance.

  • It downloads “QuickStart VM with CDH 5.4.x” instance as zip file into our Filesystem as shown below
  • cloudera-quickstart-hadoop3

  • Now extract this zip file into our Windows Filesystem
  • cloudera-quickstart-hadoop4

    Now we have done CloudEra Hadoop VMWare Quick Start setup successfully.

It’s time to use our VMWare Workstation to access this CloudEra Hadoop VMWare Quick Start instance in next section.

CloudEra Hadoop VMWare Quick Start With VMWare Workstation

  • Open VMWare Workstation 11 from Start menu
  • vmworkstation-cloudera-setup1

    If we observe VMWare Workstation home view, we can find four buttons in right-side panel. If we want to create our own VMWare instances, then we need to choose “Create a New Virtual Machine” option. However, CloudEra has already created QuickStart VMWare instance for us.

    We just need to use that instance using VMWare Workstation.

  • Click on “Open a Virtual Machine” option.
  • Select our QuickStart VMWare instance as shown below from Windows Filesystem
  • vmworkstation-cloudera-setup2

    It opens our QuickStart VMWare instance as shown below:

    vmworkstation-cloudera-setup3

  • Click on “Power on this virtual machine” button from right side panel to start Ubuntu Linux server with CloudEra Hadoop Single Instance.
  • It may take couple of minutes to start this instance. Once is started successfully, we can see this instance home as shown below:

    vmworkstation-cloudera-start

    We have started CloudEra Hadoop Quick Start VMWare successfully.

Post CloudEra Hadoop Installation Checks

We have successfully installed VMWare Workstation and accessed CloudEra Hadoop Quick Start VMWare successfully. It’s time to check some Post installations things.

  • Click on our Mouse Right Button to Open a Terminal
  • Execute the following command to check CloudEra Hadoop version
  • 
     hadoop version
    

    cloudera-hadoop-version

    We have installed Hadoop 2.6 version successfully.

That’s it all about CloudEra Hadoop VMWare Single Node Environment Setup. It’s time to start Developing some MapReduce or YARN Programs and Test them in my coming posts.

Please drop me a comment if you like my post or have any issues/suggestions.

Comments

  1. priya says:

    Hi Rambabu,

    I was tried what you said exactly, but when I am power on button on virtual machine. it shows starts symbol… and then exit. does not appear anything …
    status is- power off.

    could please help me.

    1. Suman says:

      Please enable Virtualization feature in your Windows OS. Please refer the Windows OS documentation to follow the steps.

  2. chaitanya says:

    after pressing power on this virtual machine i am getting black screen. please help me in this issue

  3. chandu says:

    Hi Rambabu,

    I was tried what you said exactly, but when I am power on button on virtual machine. it shows starts symbol… and then exit. does not appear anything …
    status is- power off.

    could please help me.

    Thanks
    Chandu

  4. Nithiya says:

    Hi Ramdoss,

    I was trying to install cloudera single instance and got struck at the last step. Im not able to start Ubuntu instance after I click the “Power on this virtual machine”. the “start up” page does not appear. Kindly help.

    BR,
    Nithiya

  5. Aditya Gupta says:

    Hi Rambabu,

    I was trying to learn Hadoop but was not able to get anything from any site. I must tell you, your steps are so easy, I think I won’t get much problem to understand everything related to Hadoop.
    Please share next sessions soon.

    Regards,
    Aditya

    1. Rambabu says:

      Thank you Aditya. We are going to deliver each and every concept of “BigData Hadoop with Cloud” concept with in-detailed explanation and real-time use-case examples.

  6. Sarita says:

    Can we install this on Mac ?

    1. Rambabu says:

      Yes, we can install on Mac too. Try to get Mac related VMWare Workstation and follow the same steps.

      1. DILIP says:

        Sir can you explain,HDFS,YARN ARCHITECTURE,MAP REDUCE,HIVE,SQOOP,FLUME,KERBEROS,READ WRITE IN hadoop,hadoop kafka,oozie,ouarom journal manager…high availability….same manner explanation ….

  7. Murali Andra says:

    Hi Rambabu,

    Nice to see you sharing your Bigdata knowledge. Basically, I am from SAP background and new to this area. I just started my knowledge journey towards, Data Science and recognized that the awareness of Bigdata, R and statistics are much more important.

    I am planning to take course – Bigdata on AWS from Amazon Web Services next month. I will certainly be in touch with you further as I need experts advice.

    I will go through rest of your posts and come back to you again.

    Have a great week end. 🙂

    Thanks,
    Murali.a
    07456001316

    1. Rambabu says:

      Thank you Murali. Sure we will definitely discuss on it. I’m also delivering BigData Hadoop with AWS, then Google Cloud Platform, Azure etc. soon.

      1. Murali Andra says:

        Thanks for your response Rambabu. Please provide those posts ASAP.

        Cheers,
        Murali.a

Leave a Reply

Your email address will not be published. Required fields are marked *

close
Generic selectors
Exact matches only
Search in title
Search in content
Search in posts
Search in pages