fiware - Error at defining a specific field in a Hive Query -
i have orion context broker connected cosmos cygnus.
it works ok, mean send new elements context broker , cygnus send them cosmos , save them in files.
the problem have when try searchs.
i start hive, , see there tables created related files cosmos have created, launch querys.
the simple 1 works fine:
select * table_name; hive doesn't launch mapreduce jobs.
but when want filter, join, count, or fields. happens:
total mapreduce jobs = 1 launching job 1 out of 1 number of reduce tasks determined @ compile time: 1 in order change average load reducer (in bytes): set hive.exec.reducers.bytes.per.reducer=<number> in order limit maximum number of reducers: set hive.exec.reducers.max=<number> in order set constant number of reducers: set mapred.reduce.tasks=<number> starting job = job_name, tracking url = job_details_url kill command = /usr/lib/hadoop-0.20/bin/hadoop job -kill job_name hadoop job information stage-1: number of mappers: 1; number of reducers: 1 2015-07-08 14:35:12,723 stage-1 map = 0%, reduce = 0% 2015-07-08 14:35:38,943 stage-1 map = 100%, reduce = 100% ended job = job_name errors error during job, obtaining debugging information... examining task id: task_name (and more) job job_name task failures(4): ----- task id: task_201409031055_6337_m_000000 url: task_detail_url ----- failed: execution error, return code 2 org.apache.hadoop.hive.ql.exec.mapredtask mapreduce jobs launched: job 0: map: 1 reduce: 1 hdfs read: 0 hdfs write: 0 fail i have found files created cygnus has difference between tha other files, because in case of cygnus, have deserialize jar.
so, have doubt if in cases have apply mapreduce method or if general method this.
before executing hive sentence, this:
hive> add jar /usr/local/hive-0.9.0-shark-0.8.0-bin/lib/json-serde-1.1.9.3-snapshot.jar; if using hive through jdbc, execute other sentence:
connection con = ... statement stmt = con.createstatement(); stmt.executequery("add jar /usr/local/hive-0.9.0-shark-0.8.0-bin/lib/json-serde-1.1.9.3-snapshot.jar"); stmt.close(); stmt = con.createstatement(); resultset rs = stmt.executequery("select ...");
Comments
Post a Comment