BIG DATA LAB FILES
BIG DATA LAB FILES
After successfully setting Up Hadoop file system running the following command and changing
the configuration file as specified in lab sheets Hadoop was installed sucessfully:
sudo apt update && sudo apt upgrade -y
sudo apt install openssh-server openssh-client -y
sudo apt install openjdk-11-jdk -y
sudo adduser hdoop
sudo usermod -aG sudo hdoop
su - hdoop
ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa
cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
chmod 700 ~/.ssh
ssh localhost
wget
https://downloads.apache.org/hadoop/common/hadoop-3.3.6/hadoop-3.3.6.
tar.gz
tar xzf hadoop-3.3.6.tar.gz
sudo mv hadoop-3.3.6 /usr/local/hadoop
sudo chown -R hdoop:hdoop /usr/local/hadoop
echo 'export JAVA_HOME=$(readlink -f /usr/bin/java | sed
"s:bin/java::")' | sudo tee -a
/usr/local/hadoop/etc/hadoop/hadoop-env.sh