In this lesson on Apache Hive commands, we will go through the most common commands in Hive in HQL and perform most basic operations like creating tables, altering their schema and much more. In this guide, we will make use of Ubuntu 17.10 (GNU/Linux 4.13.0-37-generic x86_64) machine: Prerequisites for running Hive Commands Before we can […]
Installing Apache Hive on Ubuntu and Running HQL Queries
In this lesson, we will see how we can get started with Apache Hive by installing it on our Ubuntu machine and verifying the installation by running some Hive DDL Commands as well. Installing and running Apache Hive can be tricky and that’s why we’ll try to keep this lesson as simple and informative as […]
Install Hadoop on Ubuntu
In this lesson, we will see how we can get started with Apache Hadoop by installing it on our Ubuntu machine. Installing and running Apache Hadoop can be tricky and that’s why we’ll try to keep this lesson as simple and informative as possible. In this installation guide, we will make use of Ubuntu 17.10 […]
Apache Spark Example: Word Count Program in Java
Apache Spark Apache Spark is an open source data processing framework which can perform analytic operations on Big Data in a distributed environment. It was an academic project in UC Berkley and was initially started by Matei Zaharia at UC Berkeley’s AMPLab in 2009. Apache Spark was created on top of a cluster management tool […]
Apache Spark
Whenever we study about any tool which handles data, we must study how much volume of data can it process and why was the tool actually came into use. The reasons behind the development of Apache Spark are many. We will study about each of them here. Apart from this, we will also learn about […]
Differences between Hadoop 1.x and Hadoop 2.x, Hadoop 1.x Limitations and Hadoop 2.x YARN Benefits
Before reading this post, please go through my previous posts to get some Basic knowledge about BigData Hadoop 1.x and 2.x. BigData Hadoop 1.x Architecture and Components BigData Hadoop 2.x Architecture and Components In this post, we are going to discuss about Difference between Hadoop 1.x and Hadoop 2.x, Hadoop 1.x Architecture Drawbacks or Limitations […]
Hadoop 1.x and 2.x HDFS Basic Developer Commands, “hadoop” command
In this post, we are going to discuss about Hadoop 1.x and Hadoop 2.x HDFS Basic commands with simple, suitable and real-time examples. These are useful for BigData Hadoop Developers. We will discuss Hadoop HDFS Admin Commands in my coming posts. NOTE:- Both Hadoop 1.x and Hadoop 2.x uses almost same HDFS commands. We will […]
Hadoop 2.x MapReduce (MR V1) WordCounting Example
Before reading this post, please go through my previous post at “How MapReduce Algorithm Works” to get some idea about MapReduce Algorithm. My previous post has already explained about “How MapReduce performs WordCounting” in theoretically. And if you are not familiar with HDFS Basic commands, please go through my post at “Hadoop HDFS Basic Developer […]
MapReduce Algorithm Example
Welcome to MapReduce algorithm example. Before writing MapReduce programs in CloudEra Environment, first we will discuss how MapReduce algorithm works in theory with some simple MapReduce example in this post. In my next posts, we will discuss about How to develop a MapReduce Program to perform WordCounting and some more useful and simple examples. MapReduce […]
CloudEra Hadoop VMWare Single Node Environment Setup
So far we have discussed about Hadoop Architecture and How Hadoop Components works. In this post, we will setup “CloudEra Hadoop VMWare With Single Node Environment” to start Hadoop MapReduce and YARN Development. To setup “CloudEra Environment”, we need to install VMWare software in our Windows Machines. Post’s Brief Table of Cotents Introduction VMWare Workstation […]