0% found this document useful (0 votes)
10 views

BIG DATA LAB FILES

The document outlines the successful installation of Hadoop on a system, detailing the commands executed for setup and configuration. It also mentions running a WordCount program, a Matrix Multiplication program, and a MapReduce Min-Max Temperature code with specific input files. Additionally, there is a brief mention of MongoDB configuration, though details are sparse.

Uploaded by

Aakrit Dongol
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
10 views

BIG DATA LAB FILES

The document outlines the successful installation of Hadoop on a system, detailing the commands executed for setup and configuration. It also mentions running a WordCount program, a Matrix Multiplication program, and a MapReduce Min-Max Temperature code with specific input files. Additionally, there is a brief mention of MongoDB configuration, though details are sparse.

Uploaded by

Aakrit Dongol
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 7

BIG DATA LAB FILES

After successfully setting Up Hadoop file system running the following command and changing
the configuration file as specified in lab sheets Hadoop was installed sucessfully:
sudo apt update && sudo apt upgrade -y
sudo apt install openssh-server openssh-client -y
sudo apt install openjdk-11-jdk -y
sudo adduser hdoop
sudo usermod -aG sudo hdoop
su - hdoop
ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
chmod 700 ~/.ssh
ssh localhost
wget
https://downloads.apache.org/hadoop/common/hadoop-3.3.6/hadoop-3.3.6.
tar.gz
tar xzf hadoop-3.3.6.tar.gz
sudo mv hadoop-3.3.6 /usr/local/hadoop
sudo chown -R hdoop:hdoop /usr/local/hadoop
echo 'export JAVA_HOME=$(readlink -f /usr/bin/java | sed
"s:bin/java::")' | sudo tee -a
/usr/local/hadoop/etc/hadoop/hadoop-env.sh

Running WordCount Program:


My input.txt:
Matrix Multiplication Program:
Using the code given in labsheet I ran Matrix Multiplication program:
This specified the value For matrix A and B

Running MapReduce Min-Max Temperature code


This are the values I Put in minmax.txt each day having 2 temperature:
MONGODB Configuration

You might also like