Databases
StackOverflow2013
Postsdbo
POGetting error while running nutch 1.6 with hadoop 0.20.2 in eclips in windows environment
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POGetting error while running nutch 1.6 with hadoop 0.20.2 in eclips in windows environment
    text
    copied!<p>I configure my nutch code in eclips as per this site <a href="http://wiki.apache.org/nutch/RunNutchInEclipse" rel="nofollow">http://wiki.apache.org/nutch/RunNutchInEclipse</a> but getting error "java.io.IOException: Failed to set permissions of path: \tmp\hadoop " so i moved to hadoop 0.20.2 but after change hadoop jar I am stuck on this error:-</p> <pre><code>2013-05-17 00:44:17,742 WARN crawl.Crawl (Crawl.java:run(97)) - solrUrl is not set, indexing will be skipped... 2013-05-17 00:44:17,876 INFO crawl.Crawl (Crawl.java:run(108)) - crawl started in: crawl 2013-05-17 00:44:17,876 INFO crawl.Crawl (Crawl.java:run(109)) - rootUrlDir = urls 2013-05-17 00:44:17,876 INFO crawl.Crawl (Crawl.java:run(110)) - threads = 10 2013-05-17 00:44:17,876 INFO crawl.Crawl (Crawl.java:run(111)) - depth = 3 2013-05-17 00:44:17,877 INFO crawl.Crawl (Crawl.java:run(112)) - solrUrl=null 2013-05-17 00:44:17,877 INFO crawl.Crawl (Crawl.java:run(114)) - topN = 50 2013-05-17 00:44:17,888 INFO crawl.Injector (Injector.java:inject(257)) - Injector: starting at 2013-05-17 00:44:17 2013-05-17 00:44:17,888 INFO crawl.Injector (Injector.java:inject(258)) - Injector: crawlDb: crawl/crawldb 2013-05-17 00:44:17,888 INFO crawl.Injector (Injector.java:inject(259)) - Injector: urlDir: urls 2013-05-17 00:44:17,936 INFO crawl.Injector (Injector.java:inject(269)) - Injector: Converting injected urls to crawl db entries. 2013-05-17 00:44:17,961 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=JobTracker, sessionId= 2013-05-17 00:44:18,144 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(661)) - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String). 2013-05-17 00:44:18,176 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 2013-05-17 00:44:18,519 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001 2013-05-17 00:44:18,521 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(192)) - Total input paths to process : 1 2013-05-17 00:44:18,573 INFO mapred.MapTask (MapTask.java:runOldMapper(347)) - numReduceTasks: 1 2013-05-17 00:44:18,578 INFO mapred.MapTask (MapTask.java:&lt;init&gt;(776)) - io.sort.mb = 100 2013-05-17 00:44:18,601 INFO mapred.MapTask (MapTask.java:&lt;init&gt;(788)) - data buffer = 79691776/99614720 2013-05-17 00:44:18,601 INFO mapred.MapTask (MapTask.java:&lt;init&gt;(789)) - record buffer = 262144/327680 2013-05-17 00:44:18,611 WARN plugin.PluginRepository (PluginManifestParser.java:getPluginFolder(123)) - Plugins: directory not found: plugins 2013-05-17 00:44:18,612 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode: [true] 2013-05-17 00:44:18,612 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(314)) - Registered Plugins: 2013-05-17 00:44:18,612 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(317)) - NONE 2013-05-17 00:44:18,613 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(324)) - Registered Extension-Points: 2013-05-17 00:44:18,613 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(326)) - NONE 2013-05-17 00:44:18,615 WARN mapred.LocalJobRunner (LocalJobRunner.java:run(256)) - job_local_0001 java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:354) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) ... 5 more Caused by: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117) at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34) ... 10 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88) ... 13 more Caused by: java.lang.RuntimeException: x point org.apache.nutch.net.URLNormalizer not found. at org.apache.nutch.net.URLNormalizers.&lt;init&gt;(URLNormalizers.java:123) at org.apache.nutch.crawl.Injector$InjectMapper.configure(Injector.java:74) ... 18 more 2013-05-17 00:44:19,520 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1288)) - map 0% reduce 0% 2013-05-17 00:44:19,523 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1343)) - Job complete: job_local_0001 2013-05-17 00:44:19,524 INFO mapred.JobClient (Counters.java:log(514)) - Counters: 0 Exception in thread "main" java.io.IOException: Job failed! at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1252) at org.apache.nutch.crawl.Injector.inject(Injector.java:281) at org.apache.nutch.crawl.Crawl.run(Crawl.java:132) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.crawl.Crawl.main(Crawl.java:55) </code></pre> <p>I searched a lot but did not find any working solution. Please suggest.</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload