Databases
StackOverflow2013
Postsdbo
POI met an error when i using hive transform features
Body
 

Note that there are some explanatory texts on larger screens.

plurals
  1. POI met an error when i using hive transform features
    text
    copied!<p><code>java.lang.RuntimeException: Hive Runtime Error while closing operators at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:226) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) at org.apache.hadoop.mapred.Child.main(Child.java:249) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: [Error 20003]: An error occurred when trying to close the Operator running your custom script. at org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:486) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:567) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:567) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:567) at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:193) ... 8 more </code> The HQL script as follow:</p> <pre><code>SELECT TRANSFORM (userid, movieid, rating) USING 'python /home/daxingyu930/test_data_mapper2.py' AS userid, movieid, rating ; </code></pre> <p>the python script is very simple, using <code>\t</code> to split lines.</p> <p>I have tested the python script in Linux with follow shell script:</p> <pre><code>cat test_data/u_data.txt | python test_data_mapper2.py </code></pre> <p>Pleas give me some idea about the question, it drive me crazy and make me cant sleep. Thanks very much.</p>
 

Querying!

 
Guidance
An individual column

Larger individual text columns get their own page to allow for proper reading.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload