LOADING

Type to search

How to Create HDInsight Cluster on Microsoft Azure

To Know more about the Different Corporate Training & Consulting Visit our website www.Instrovate.com Or Email : info@instrovate.com or WhatsApp / Call at +91 74289 52788

Azure Cloud Data Analytics Microsoft Azure

How to Create HDInsight Cluster on Microsoft Azure

Share

Login to portal.azure.com . You should have your account created and an active Subscription – either Free Trial or a Paid Subscription to create a Resource . If you don’t have an Azure Account and would like to create one , follow the step by step tutorial here – How to Create an Azure Account For Free .

Now in order to create a HDInsight Cluster 🡪 Go to +Create A Resource and Under Analytics Tab 🡪 You can see the HDInsight

How to Create HDInsight Cluster on Microsoft Azure 29

This will open up the Below Page in which you need to enter some Basic Information to get your HDInsight (Hortonworks Hadoop Platform (HDP) on Cloud Azure with storage on Azure ADLS rather than HDFS) up and running.

How to Create HDInsight Cluster on Microsoft Azure 30

As you can see in the screen shot it will take 20 mins time to set up this cluster on the cloud.

Fill up the Details as below. Depending on the Type of HDInsight Cluster we want to create we can chose the Cluster type.

How to Create HDInsight Cluster on Microsoft Azure 31

The different Cluster type that is available while creating HDInsight Cluster on Microsoft Azure are as below:

  1. Spark
  2. Hadoop
  3. HBase
  4. Storm
  5. ML Services (R Server)
  6. Kafka
  7. Interactive Query

Currently we are creating Hadoop Cluster, so we will select this Option i.e. Hadoop. For Hadoop On Azure we only have the Linux Operating System and below are the Features of Hadoop on Azure and Click on “Select”

How to Create HDInsight Cluster on Microsoft Azure 32

You will need a create a new Resource Group .

sshuser is the username for login from putty or any other SSH Tool.

How to Create HDInsight Cluster on Microsoft Azure 33

Click on Next and you will get the below screen.

Now you need to chose the Storage Account Settings.

How to Create HDInsight Cluster on Microsoft Azure 34

Then there is some optional setting that you can leave to default.

How to Create HDInsight Cluster on Microsoft Azure 35

Once you click “Next” you will see the below details after validation and you are ready to create an HDInsight Big Data Cluster on Azure

How to Create HDInsight Cluster on Microsoft Azure 36

You can also see the cluster details and the price that you will have to pay once your free trial or free amount of the months end .

Remember For HDInsight Cluster – Once created you will be billed until your cluster is deleted . So Make sure you Delete your Cluster once after using for testing purpose or you will exhaust all your Free Money very soon.

How to Create HDInsight Cluster on Microsoft Azure 37

So this basically says you will have 2 Primary Node (1 Main & 1 for Disaster Recovery) Cluster and 4 Data Node i.e. Worker Node. So for 6 Node Cluster Azure Charges around 205 Rs per Hour i.e. Around 5000 Rs per Day and 1,50,000 Rs per Month.

We can edit the Cluster Size to lower down the price. So if I chose only 1 Data Node with 4 Cores , the Price will go down.

How to Create HDInsight Cluster on Microsoft Azure 38

So Now you can see the Price of the HDInsight Cluster for 3 Node Cluster has come down to 74 Rs per Hour. Even this is nearly 1,800 Rs Per Day i.e around 50,000 Rs per Month – if you create the cluster for testing and leave it unattended.

How to Create HDInsight Cluster on Microsoft Azure 39

Click on Create Button and you will get the Notification that the Cluster is getting created. It takes some time around 15 mins for this to get created and the cluster to be up & running.

How to Create HDInsight Cluster on Microsoft Azure 40

Once the Deployment completes you can see in the all resources and you can see the HDInsight Cluster and Storage Account That you created

How to Create HDInsight Cluster on Microsoft Azure 41