`

Error during job, obtaining debugging information or java.lang.ClassNotFoundExc

    博客分类:
  • hive
 
阅读更多
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201203251957_0006, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201203251957_0006
Kill Command = /usr/local/hadoop-0.20.203.0/bin/../bin/hadoop job  -Dmapred.job.tracker=hdfs://master:9001 -kill job_201203251957_0006
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2012-03-25 23:13:27,259 Stage-1 map = 0%,  reduce = 0%
2012-03-25 23:14:06,446 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201203251957_0006 with errors
Error during job, obtaining debugging information...
Examining task ID: task_201203251957_0006_m_000002 (and more) from job job_201203251957_0006
Exception in thread "Thread-143" java.lang.RuntimeException: Error while reading from task log url
        at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://slave2:50060/tasklog?taskid=attempt_201203251957_0006_m_000000_1&start=-8193
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
        at java.net.URL.openStream(URL.java:1010)
        at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)


如果在执行hive的查询语句时出现以上错误,并且在http://192.168.200.128:50030/jobtracker.jsp中,查看错误信息,会有以下的错误信息:


java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)
at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:253)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:406)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:90)
... 22 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:819)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:233)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:366)
... 23 more


这是因为要在执行hive语句的时候的加上lib文件中的hive_contrib.jar,因为在建表的时候加入了正则表达式。

执行的语句为:
hive> add jar ../lib/hive_contrib.jar ;
分享到:
评论

相关推荐

    uiautomatorviewer更新文件.rar

    解决uiautomatorviewer报错问题,分享给大家。 Unexpected error while obtaining UI hierarchy # 点击Details java.lang.reflect.InvocationTargetException

    UiautomatorViewer最新源码

    在这里,你可能会找到Java和C/C++代码,分别对应于Android应用层和系统服务层的实现。通过研究这部分源码,你可以学习到如何与Android系统的`uiautomator`服务交互,获取和解析UI组件的详细信息,以及如何在图形界面...

    ddmlib-26.2.0-alpha15.jar

    最新的 ddmlib.jar ddmlib-26.2.0.jar 包,解决 (1) E/Screenshot: Unsupported protocol: 2 (2) Unexpected error while obtaining UI hierarchy java.lang.reflect.InvocationTargetException 导致的 uiautomator...

    Learn.Java.for.Android.Development_Apress.2010+src

    The book also briefly presents most (if not all) of Java version 7''s language features, although not much is said about closures or modules (which were not finalized at the time of writing). Java ...

    从冰山获取淡水 obtaining fresh water from icebergs.docx

    标题中的“从冰山获取淡水”是指利用冰山上的冰雪资源来解决淡水资源短缺的问题。这一概念在过去可能被视为一种不切实际的想法,但在科学家警告人类可能会先耗尽淡水再耗尽食物的情况下,许多国家现在正认真考虑这种...

    Getting an Information Security Job For Dummies

    Getting an Information Security Job For Dummies March 9, 2015 pdf和kindle azw3版本 已去除加密 by Peter H. Gregory ISBN-13: 978-1119002819 ISBN-10: 1119002818 Get prepared for your Information ...

    Embedded Linux Primer.pdf

    Embedded or Not? Section 2.2. Anatomy of an Embedded System Section 2.3. Storage Considerations Section 2.4. Embedded Linux Distributions Section 2.5. Chapter Summary Chapter 3. Processor Basics ...

    【Linux Device Driver】(3edtion).pdf

    Obtaining Large Buffers 230 Quick Reference 231 9. Communicating with Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235 I/O Ports and I/O Memory 235 Using I/O Ports ...

    spring-framework-reference4.1.4

    3.3. Java 8 (as well as 6 and 7) ............................................................................... 17 3.4. Java EE 6 and 7 ..................................................................

    spring-framework-reference-4.1.2

    3.3. Java 8 (as well as 6 and 7) ............................................................................... 17 3.4. Java EE 6 and 7 ..................................................................

    linux网络管理员手册

    “The Linux Network Administrators' Guide” may be reproduced and distributed in whole or in par subject to the following conditions: 0. The copyright notice above and this permission notice must be...

    Redis 3.0 中文版 - v1.1.pdf

    第 1 章Redis 介绍. . . . . . . . . ....第 2 章数据类型初探....字符串 (Strings) ....列表 (Lists)....集合 (Sets) ....哈希 / 散列 (Hashes) ....有序集合 (Sorted sets) ....位图 (Bitmaps) 和超重对数 (HyperLogLogs) ....

    C/C++ GUI Programming with Qt4 (S - Jasmin Blanchette),pdf

    Part I: Basic Qt 1. Getting Started. 2. Creating Dialogs. 3. Creating Main Windows. 4. Implementing Application Functionality.... Introduction to C++ for Java and C# Programmers Index

    Google C++ International Standard.pdf

    Contents Contents ii List of Tables x List of Figures xiv 1 Scope 1 2 Normative references 2 3 Terms and definitions 3 4 General principles 7 4.1 Implementation compliance . ....4.2 Structure of this ...

    获取当前位置—Obtaining the Current Location.

    在Android平台上获取设备当前位置是一项常见的需求,可以通过LocationManager类实现。LocationManager类是Android系统提供的用于管理位置信息的API。... 首先,要使用LocationManager获取位置更新,需要注册一个监听器...

    using-liferay-portal-6.2.pdf

    9.5 Find out what others think or do using Polls . . . . . . . . . . . . . . . . 239 9.6 Sending Alerts and Announcements in Your Portal . . . . . . . . . . . . 242 9.7 Staying in touch with the Chat ...

    Redis V3.0 中文文档

    第 1 章Redis 介绍. . . . . . . . . ....第 2 章数据类型初探....字符串 (Strings) .... ....列表 (Lists)....集合 (Sets) ....哈希 / 散列 (Hashes) ....有序集合 (Sorted sets) ....位图 (Bitmaps) 和超重对数 (HyperLogLogs) ....

    简单的Java照相机源码

    简单的Java照相机源码 可以获取USB摄像头的视频 /* * jmfcam05s.java 01.01a 07.11.2006 * * Copyright (c) 2006 Andy Dyble. All Rights Reserved. * * Permission is hereby granted, free of charge, to ...

    UNIX Network Programming Volume 1, Third Edition (Unix网络编程卷1第3版英文版)

    Error Handling: Wrapper Functions Section 1.5. A Simple Daytime Server Section 1.6. Roadmap to Client/Server Examples in the Text Section 1.7. OSI Model Section 1.8. BSD Networking History ...

Global site tag (gtag.js) - Google Analytics