"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

July 04, 2019

Day #261 - Setting up Spark on my Ubuntu - Big Data Setup - Part V


Reference Steps - https://linuxhint.com/install-apache-spark-ubuntu-17-10/
1. Download from link https://www.apache.org/dyn/closer.lua/spark/spark-2.4.3/spark-2.4.3-bin-hadoop2.7.tgz
2. tar xvzf spark-2.4.3-bin-hadoop2.7.tgz
3. Goto Folder ~/spark/spark-2.4.3-bin-hadoop2.7
4. Create softlink ln -s spark-2.4.3-bin-hadoop2.7 spark
5. pwd
6. set this path to spark home - /home/administrator/spark/spark-2.4.3-bin-hadoop2.7
7. vi ~/.bashrc
8. SPARK_HOME = /home/administrator/spark/spark-2.4.3-bin-hadoop2.7
export PATH=$SPARK_HOME/bin:$PATH
10. source ~/.bashrc
11. Start Spark ./home/administrator/spark/spark-2.4.3-bin-hadoop2.7/bin/spark-shell
Java Eclipse setup
========================
1. https://www.eclipse.org/downloads
2. cd administrator/Downloads
3. tar xfz tar_file extract_folder
4. goto extract_folder run ./eclipse-inst
https://blogs.ashrithgn.com/2018/08/01/install-scala-and-scala-build-tools-ubuntu/
https://linuxconfig.org/how-to-install-hadoop-on-ubuntu-18-04-bionic-beaver-linux
view raw sparksetup.txt hosted with ❤ by GitHub





Happy Data Thinking!!!

No comments: