Databases
StackOverflow2013
Postsdbo
POWhen package dependant libraries in the "lib" folder of the hadoop job jar, ClassNotFoundException encountered
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POWhen package dependant libraries in the "lib" folder of the hadoop job jar, ClassNotFoundException encountered
    text
    copied!<p>I used to package the dependant libraries in the "lib" folder of the hadoop map-reduce job jar. That works fine. But this time it went wrong. Can some one give me some idea to fix the problem? The problem is as follows:</p> <p>When I package the job jar with Eclipse "Export" function and "Extract required libraries into generated JAR" option. The generated job jar works fine. </p> <p>But if I package the job jar with ant-script to include dependant libraries in the "lib" folder in the job jar, I encountered the ClassNotFoundException:</p> <pre><code>java.io.IOException: Split class cascading.tap.hadoop.MultiInputSplit not found at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:340) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:365) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325) at org.apache.hadoop.mapred.Child$4.run(Child.java:270) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.Child.main(Child.java:264) Caused by: java.lang.ClassNotFoundException: cascading.tap.hadoop.MultiInputSplit at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:943) at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:338) ... 7 more </code></pre> <p>Can anyone provide some idea? Thanks!</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload