Apache Tez installation

download

In this article, i’ll show how to install Apache Tez.

The Installation of Apache Tez contains four simple steps:

1. Download and build the tar file

2.Copy the library files into HDFS

3.Configure the tez directory

4.Update the bashrc

Download and build the tar file:

You can download the Tez tar file from apache tez official page or simply follow this link.

After downloading and extracting the file move to directory tez by following command:

cd tez

After this, you need to build the maven package by following command:

mvn clean package -DskipTests=true -Dmaven.javadoc.skip=true

Copy To HDFS:

After maven build completed successfully… go to directory

cd tez-dist/target

then copy the tez file to hdfs by following command:

hdfs dfs -copyFromlocal tez-0.7.0-SNAPSHOT.tar.gz /apps/tez

Local configuration:

Go to tez-0.7.0-SNAPSHOT directory by

cd tez-0.7.0-SNAPSHOT

and make a directory called conf by using -mkdir command

under the conf directory create a new xml file called tez-site.xml and add below properties:

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
  <property>
   <name>tez.lib.uris</name>
   <value>${fs.defaultFS}/apps/tez/tez-0.7.0-SNAPSHOT.tar.gz</value>
  </property>
</configuration>


Update bashrc:

export TEZ_JARS=~/tez/tez-dist/target/tez-0.7.0-SNAPSHOT
export TEZ_CONF_DIR=$TEZ_JARS/conf
export HADOOP_CLASSPATH=$TEZ_CONF_DIR:$TEZ_JARS/*:$TEZ_JARS/lib/*:$HADOOP_CLASSPATH

Advertisements