I installed all the Vertica jars for Hadoop and Pig (hadoop-vertica.jar, pig-vertica.jar and
vertica_4.1.17_jdk_5.jar) on all the nodes (masters and slaves) in my Hadoop cluster at $HADOOP_HOME/lib and at $PIG_HOME/lib, and then restarted my Hadoop cluster (both HDFS and MapReduce).
But I am not able to connect to Vertica using my Pig script, unless I include the following two register statements
register /usr/lib/pig/lib/pig-vertica.jar;
register /usr/lib/pig/lib/vertica_4.1.17_jdk_5.jar;
in my Pig script.
Without these register statements, Pig throws the following exception:
org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not resolve com.vertica.pig.VerticaLoader using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]
Is there a way to avoid inserting these register statements in the Pig scripts?
Is there anything else I need to do for installing Vertica Pig connectors correctly on the cluster?
The Vertica jars are from hadoop-vertica-1.4.4_xxxx.zip on the Vertica site.
The Hadoop cluster is running CDH3u3.
Would appreciate any help.
Thanks a lot,
Jeyendran
How to avoid using register pig-vertica.jar in Pig scripts?
Moderator: NorbertKrupa
Re: How to avoid using register pig-vertica.jar in Pig scrip
Myabe your question is too complicated, heh heh.
THANKS - BECKSTER