Note that there are some explanatory texts on larger screens.

plurals
  1. POXML Processing Failed in Hadoop
    primarykey
    data
    text
    <p>I am really new to this field. By referring <a href="http://java.dzone.com/articles/hadoop-practice" rel="nofollow">http://java.dzone.com/articles/hadoop-practice</a> i did <a href="https://github.com/studhadoop/xmlparsing-hadoop/blob/master/XmlParser11.java" rel="nofollow">https://github.com/studhadoop/xmlparsing-hadoop/blob/master/XmlParser11.java</a></p> <p>and created jar file and then run the mapreduce pgm. my xml file is </p> <pre><code>&lt;configuration&gt; &lt;property&gt; &lt;name&gt;dfs.replication&lt;/name&gt; &lt;value&gt;1&lt;/value&gt; &lt;type&gt;tr&lt;/type&gt; &lt;/property&gt; &lt;/configuration&gt; </code></pre> <p>and </p> <pre><code>root# javac -classpath /var/root/hadoop-1.0.4/hadoop-core-1.0.4.jar -d xml11 XmlParser11.java root# jar -cvf /var/root/xmlparser11/xmlparser.jar -C xml11/ . root# bin/hadoop jar /var/root/xmlparser11/xmlparser.jar com.org.XmlParser11 /user/root/xmlfiles/conf.xml /user/root/xmlfiles-outputjava3 </code></pre> <p>UPDATE</p> <pre><code>13/03/30 09:39:58 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 13/03/30 09:39:58 INFO input.FileInputFormat: Total input paths to process : 1 13/03/30 09:39:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 13/03/30 09:39:58 WARN snappy.LoadSnappy: Snappy native library not loaded 13/03/30 09:39:58 INFO mapred.JobClient: Running job: job_201303300855_0004 13/03/30 09:39:59 INFO mapred.JobClient: map 0% reduce 0% 13/03/30 09:40:13 INFO mapred.JobClient: Task Id : attempt_201303300855_0004_m_000000_0, Status : FAILED java.io.IOException: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at com.org.XmlParser11$Map.map(XmlParser11.java:186) at com.org.XmlParser11$Map.map(XmlParser11.java:148) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1014) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:691) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at com.org.XmlParser11$Map.map(XmlParser11.java:184) ... 9 more attempt_201303300855_0004_m_000000_0: ‘&lt;property&gt; attempt_201303300855_0004_m_000000_0: &lt;name&gt;dfs.replication&lt;/name&gt; attempt_201303300855_0004_m_000000_0: &lt;value&gt;1&lt;/value&gt; attempt_201303300855_0004_m_000000_0: &lt;/property&gt;‘ 13/03/30 09:40:19 INFO mapred.JobClient: Task Id : attempt_201303300855_0004_m_000000_1, Status : FAILED java.io.IOException: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at com.org.XmlParser11$Map.map(XmlParser11.java:186) at com.org.XmlParser11$Map.map(XmlParser11.java:148) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1014) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:691) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at com.org.XmlParser11$Map.map(XmlParser11.java:184) ... 9 more attempt_201303300855_0004_m_000000_1: ‘&lt;property&gt; attempt_201303300855_0004_m_000000_1: &lt;name&gt;dfs.replication&lt;/name&gt; attempt_201303300855_0004_m_000000_1: &lt;value&gt;1&lt;/value&gt; attempt_201303300855_0004_m_000000_1: &lt;/property&gt;‘ 13/03/30 09:40:25 INFO mapred.JobClient: Task Id : attempt_201303300855_0004_m_000000_2, Status : FAILED java.io.IOException: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at com.org.XmlParser11$Map.map(XmlParser11.java:186) at com.org.XmlParser11$Map.map(XmlParser11.java:148) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: java.io.IOException: Type mismatch in key from map: expected org.apache.hadoop.io.Text, recieved java.lang.String at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1014) at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:691) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at com.org.XmlParser11$Map.map(XmlParser11.java:184) ... 9 more attempt_201303300855_0004_m_000000_2: ‘&lt;property&gt; attempt_201303300855_0004_m_000000_2: &lt;name&gt;dfs.replication&lt;/name&gt; attempt_201303300855_0004_m_000000_2: &lt;value&gt;1&lt;/value&gt; attempt_201303300855_0004_m_000000_2: &lt;/property&gt;‘ 13/03/30 09:40:37 INFO mapred.JobClient: Job complete: job_201303300855_0004 13/03/30 09:40:37 INFO mapred.JobClient: Counters: 7 13/03/30 09:40:37 INFO mapred.JobClient: Job Counters 13/03/30 09:40:37 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=27296 13/03/30 09:40:37 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0 13/03/30 09:40:37 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0 13/03/30 09:40:37 INFO mapred.JobClient: Launched map tasks=4 13/03/30 09:40:37 INFO mapred.JobClient: Data-local map tasks=4 13/03/30 09:40:37 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 13/03/30 09:40:37 INFO mapred.JobClient: Failed map tasks=1 </code></pre> <p>what is wrong in map-reduce code? How can i rectify it??</p>
    singulars
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload