Getting error while Sqoop export, how can I find out the exact error?

up vote
0
down vote

favorite

While doing sqoop export:

sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt

I am getting the following error:

18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!

How can I determine what the exact error is?

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

add a comment |

up vote
0
down vote

favorite

While doing sqoop export:

sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt

I am getting the following error:

18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!

How can I determine what the exact error is?

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

add a comment |

up vote
0
down vote

favorite

While doing sqoop export:

sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt

I am getting the following error:

18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!

How can I determine what the exact error is?

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

While doing sqoop export:

sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt

I am getting the following error:

18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!

How can I determine what the exact error is?

export sqoop

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

edited Nov 10 at 21:19

halfer

14.2k757105

edited Nov 10 at 21:19

halfer

14.2k757105

edited Nov 10 at 21:19

halfer

14.2k757105

asked Nov 10 at 17:15

NewUser

asked Nov 10 at 17:15

NewUser

asked Nov 10 at 17:15

NewUser

Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

add a comment |

Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

add a comment |

active

oldest

votes

Your Answer

StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);

);

draft saved

draft discarded

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53241442%2fgetting-error-while-sqoop-export-how-can-i-find-out-the-exact-error%23new-answer', 'question_page');

);

Post as a guest

Name

Required, but never shown

active

oldest

votes

draft saved

draft discarded

draft saved

draft discarded

Post as a guest

Name

Required, but never shown

Name

Required, but never shown

Name

Required, but never shown

This page is only for reference, If you need detailed information, please check here

搜尋此網誌

Myujth