#apache pig

This page combines all Apache Pig related posts into a single to make it more helpful and beneficial to learners. It is presented in a hierarchical manner, beginning with the basics and progressing to more advanced topics.

This page combines all Apache Pig related posts into a single to make it more helpful and beneficial to learners. It is presented in a hierarchical manner, beginning with the basics and progressing to more advanced topics. Apache Pig An Introduction Versions & Connectivity Get the Version Connecting Apache Pig – Pig Running Modes Relations in Apache Pig Creating Relations Loading…

Registering a Jar file of UDF in Apache Pig

Hello, everyone. Thanks for coming back again to continue with this certification series. In the last tutorial, we saw how to run any pig script with TEZ as the execution mode. In this tutorial, we are going to see how to register a JAR file to use the User Defined Function written and packages inside it.

Let us begin then.

For registering the jar file, we will first find out the desired jar file…

Running a Pig Job using Apache TEZ

Hey, everyone. Thank you for giving me company on this beautiful journey of HDPCD certification. We are almost done with the Data Transformation section of the certification and are only left with Data Analysis section using Apache Hive. The section of Data Analysis, in my opinion, is easier than this section so you can say that the difficult part of the certification is over with only hive left…

Replicated Join in Apache Pig

Hey everyone, thank you once again for keep on coming back to perform these tutorials.

In the last tutorial, we saw how to perform the simple JOIN Operation and in this tutorial, we are going to perform the REPLICATED JOIN Operation.  The process is similar and there is a difference only at one place, so we do not need to worry about it too much.

In the certification, they will specifically…

Join operation in Apache PIG

Hey, everyone. Thanks for the overwhelming response to the blog posts that I am receiving since the last week. I really appreciate it. I will keep on posting interesting and innovative contents for you.

In the lasttutorial, we saw how to use the parallel features of Apache Pig in two ways. In this tutorial, we are going to focus on the JOIN operation and will see the process of performing this…

Post 21 | HDPCD| Specify number of reduce tasks for Pig MapReduce job

Hello everyone. Thanks for coming back to one more tutorial in this HDPCD certification series. In the last tutorial, we saw how to remove the duplicate tuples from a pig relation. In this tutorial, we are going to see how to specify the number of reduce tasks for a Pig MapReduce job.

Let us get started then.

There are two ways of doing this. These two ways are mentioned in the following…