Hadoop Single Server Setup on Ubuntu

In continuation with previous post we will install java, hadoop, configure map reduce jobs on ubuntu. The step by step details are based on details provided in link.

Many thanks to Arun and Pragalathan for helping me learn linux :)

Step 1 - Installing JDK

Step 2 - Create Hadoop Group

Step 3 - Create hduser

Step 4 - Add sshkey

Step 5 - Enable SSH

Step 6 - Install SSH (Had some issues so reinstalled it)

Step 7 - ssh to localhost

Step 8 - Disable IPV6 (Modify the entries based on steps provided in link)

Step 9 - Download Hadoop

Step 10 - Move it to Hadoop folder

Step 11 - Make permission owner hduser

Step 12 - bashrc changes

Step 13 - Check Java and Hadoop Home Path

Step 14 - Hadoop env changes

Step 15 - Modify custom xml files in below folder

Step 16 - Start Service

Step 17 - Copy files for working example

Step 18 - Hadoop file system details

Step 19 - Copy Files to Hadoop File System

Step 20 - List uploaded files

Step 21 - Run wordcount example jar

Step 22 - Check results output file

More Reads - How to Install Hadoop on Ubuntu 13.10

Happy Learning!!!

Ubuntu Installation - Part I

Guideline for setup is based on Steps provided in link

Setting it on Ubuntu desktop, step by step details with Snapshot. Download installer from link
Step 1 – Installing Ubuntu

Step 2 – Ubuntu Installation

 

Step 3 – Drive to Install

Step 4 – Provide Credentials

Step 5 – Configure Network

Follow the next steps and complete installation and logon to system.

Happy Learning!!!

Interesting Post - Learn to Code (Startup Tips)

This post is to highlight few lines from Post on Learning to Code. If you have plans to do a startup it is useful and advantageous if you know to write code, passion for technology.

Happy Learning!!!

Algorithms Course Notes - Part II

Algorithms Course Notes from Coursera

Binary Search Trees

• Binary Tree in Symmetric order (Nodes - Contain info, two links)
• Each node has left and right tree, both can be null
• Every Node Key Larger than keys in left sub tree
• Every Node key smaller than keys in right sub tree
• Inserts - Find a null link by search eligible position and insert it there

B Trees

• General Model for external storage
• Internal node key guide search
• External node has client key
• Insert at Bottom null node
• If Nodes are full it will split to allow insert
• Variants of BTree is used in DBs (B+ Tree, B* Tree)

RBT - Red Black Tree Tracks every simple path from a node to a descendant node with same number of black nodes
Red Black Trees

• Internal Left Leaning links to glue 3 nodes
• No Nodes have two red links connected
• Every path from root to null link has same number of black links
• Use a flag color to denote red or black link in implementation

Heap Sort

• Largest of all keys is the root

Reposting Important Summary Slides

Happy Learning!!!

Jenkins Installation on Windows Server

This post is about issue encountered today and resolution for the same. Below error was returned by Jenkins windows installer

There was no log file associated with it. To debug it we need the log file for this installation. Below command would provide us log file

After few google searches enable .NET 3.5 features, this did not resolve the error

By closely examining the errors you would see error

ExecFirewallExceptions: Installing firewall exception2 Jenkins (C:
\Program Files (x86)\Jenkins\jre\bin\java.exe)

Fix was it was provided in link. By enabling windows firewall installation was successful.

Posting it hoping it is useful for larger audience.

Happy Learning!!!