"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

October 28, 2012

Hadoop Single Server Setup on Ubuntu


In continuation with previous post we will install java, hadoop, configure map reduce jobs on ubuntu. The step by step details are based on details provided in link.

Many thanks to Arun and Pragalathan for helping me learn linux :)

Step 1 - Installing JDK



Step 2 - Create Hadoop Group


Step 3 - Create hduser


Step 4 - Add sshkey


Step 5 - Enable SSH


Step 6 - Install SSH (Had some issues so reinstalled it)

Step 7 - ssh to localhost



Step 8 - Disable IPV6 (Modify the entries based on steps provided in link)



Step 9 - Download Hadoop


Step 10 - Move it to Hadoop folder


Step 11 - Make permission owner hduser

Step 12 - bashrc changes


Step 13 - Check Java and Hadoop Home Path


Step 14 - Hadoop env changes


Step 15 - Modify custom xml files in below folder


Step 16 - Start Service

Step 17 - Copy files for working example


Step 18 - Hadoop file system details


Step 19 - Copy Files to Hadoop File System


Step 20 - List uploaded files


Step 21 - Run wordcount example jar


Step 22 - Check results output file


More ReadsHow to Install Hadoop on Ubuntu 13.10

Happy Learning!!!

Ubuntu Installation - Part I

Guideline for setup is based on Steps provided in link

Setting it on Ubuntu desktop, step by step details with Snapshot. Download installer from link
Step 1 – Installing Ubuntu


Step 2 – Ubuntu Installation

 
Step 3 – Drive to Install


Step 4 – Provide Credentials


Step 5 – Configure Network

Follow the next steps and complete installation and logon to system.

Happy Learning!!!

October 08, 2012

Interesting Post - Learn to Code (Startup Tips)

This post is to highlight few lines from Post on Learning to Code. If you have plans to do a startup it is useful and advantageous if you know to write code, passion for technology.



Happy Learning!!!

October 07, 2012

Algorithms Course Notes - Part II

Algorithms Course Notes from Coursera

Binary Search Trees
  • Binary Tree in Symmetric order (Nodes - Contain info, two links)
  • Each node has left and right tree, both can be null
  • Every Node Key Larger than keys in left sub tree
  • Every Node key smaller than keys in right sub tree
  • Inserts - Find a null link by search eligible position and insert it there
B Trees
  • General Model for external storage
  • Internal node key guide search
  • External node has client key
  • Insert at Bottom null node
  • If Nodes are full it will split to allow insert
  • Variants of BTree is used in DBs (B+ Tree, B* Tree)
RBT - Red Black Tree Tracks every simple path from a node to a descendant node with same number of black nodes
Red Black Trees
  • Internal Left Leaning links to glue 3 nodes
  • No Nodes have two red links connected
  • Every path from root to null link has same number of black links
  • Use a flag color to denote red or black link in implementation
Heap Sort
  • Largest of all keys is the root
Reposting Important Summary Slides

Happy Learning!!!

October 03, 2012

Jenkins Installation on Windows Server


This post is about issue encountered today and resolution for the same. Below error was returned by Jenkins windows installer


There was no log file associated with it. To debug it we need the log file for this installation. Below command would provide us log file


After few google searches enable .NET 3.5 features, this did not resolve the error

By closely examining the errors you would see error

ExecFirewallExceptions: Installing firewall exception2 Jenkins (C:
\Program Files (x86)\Jenkins\jre\bin\java.exe)

Fix was it was provided in link. By enabling windows firewall installation was successful.

Posting it hoping it is useful for larger audience.

Happy Learning!!!