Oozie installation.
Please check your Hadoop and Java versions. If you have Java earlier then 8 and Hadoop 2.6.5, please uninstall and re-install Java and Hadoop with 8 and 2.6.5, respectively
1. Install Maven
sudo apt-get install maven
sudo apt-get install unzip
sudo apt-get install zip
2. Install Oozie install
wget https://archive.apache.org/dist/oozie/4.1.0/oozie-4.1.0.tar.gz
3. Tar the downloaded file
tar -xzvf oozie-4.1.0.tar.gz
4. Go into the oozie folder
cd oozie-4.1.0
5. --now we need to downgrade the Hadoop version, so open the pom file and search for the Hadoop version.--
vi pom.xml
6. search the Hadoop version
?hadoop-version
7.
--Change Hadoop version 3 snapshot to 2.3.0 ---
8. Open settings.xml file and search for mirror
sudo vi /etc/maven/settings.xml
?mirror --search for mirror and please paste the below code inside the mirrors –
9. Create a package
mvn clean package assembly:single -P hadoop-2 -DskipTests
--- If you got any error here, then you made something wrong with the above step
10. Goto target folder
cd distro/target
11.Tar the file
tar -zxvf oozie-4.1.0-distro.tar.gz
12. goto local folder
cd /usr/local
13. Come back tothe initial folder
cd –
14. Move oozie to the local folder
sudo mv oozie-4.1.0 /usr/local/oozie-4.1.0
15. Goto local folder
cd /usr/local
16. Make a directory for the Hadoop library
mkdir libext
17. goto libtext library
cd libext
18. download the required jar file
wget https://archive.cloudera.com/gplextras/misc/ext-2.2.zip
19. Copy these jar file to libtext
cp -R ~/oozie-4.1.0/hadooplibs/hadoop-2/target/hadooplibs/hadooplib-2.3.0.oozie-4.1.0/* /usr/local/oozie-4.1.0/libext/
20.Open core file
vi /home/ubuntu/hadoop-2.6.5/etc/hadoop/core-site.xml
21. Paster below code
22. open profile
vi ~/.bashrc
23.Export environment
export OOZIE_VERSION=4.1.0
export OOZIE_HOME=/usr/local/oozie-4.1.0
export PATH=$PATH:$OOZIE_HOME/bin
24. Reload profile
Source ~/.bashrc
25. Goto 2 step down
cd ..
26.Prepare war file
./bin/oozie-setup.sh prepare-war
27.Create database
./bin/ooziedb.sh create -sqlfile oozie.sql -run
28.run oozie
bin/oozied.sh start
29. If you do everything correctly, then you will get a link. Paste this link into Brower, and please don’t forget to replace your IP with a public IP.
Oozie Installation in Ec2 instance
