Getting error while Sqoop export, how can I find out the exact error?

Multi tool use
Multi tool use








up vote
0
down vote

favorite












While doing sqoop export:



sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt


I am getting the following error:



18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!


How can I determine what the exact error is?






export sqoop







share|improve this question























  • Need more detailed stack trace. Check for yarn container logs.
    – shriyog
    Nov 12 at 7:12














up vote
0
down vote

favorite












While doing sqoop export:



sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt


I am getting the following error:



18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!


How can I determine what the exact error is?






export sqoop







share|improve this question























  • Need more detailed stack trace. Check for yarn container logs.
    – shriyog
    Nov 12 at 7:12












up vote
0
down vote

favorite









up vote
0
down vote

favorite











While doing sqoop export:



sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt


I am getting the following error:



18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!


How can I determine what the exact error is?






export sqoop







share|improve this question















While doing sqoop export:



sqoop export --connect jdbc:mysql://ip-172-31-20-247/dbname --username uname --password pwd --table orders --export-dir /orders.txt


I am getting the following error:



18/11/10 16:18:52 INFO mapreduce.Job: map 0% reduce 0%
18/11/10 16:19:00 INFO mapreduce.Job: map 100% reduce 0%
18/11/10 16:19:01 INFO mapreduce.Job: Job job_1537636876515_6580 failed with state FAILED due to: Task failed task_1537636876515_6580_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
18/11/10 16:19:01 INFO mapreduce.Job: Counters: 12
 Job Counters 
 Failed map tasks=1
 Killed map tasks=3
 Launched map tasks=4
 Data-local map tasks=4
 Total time spent by all maps in occupied slots (ms)=61530
 Total time spent by all reduces in occupied slots (ms)=0
 Total time spent by all map tasks (ms)=20510
 Total vcore-milliseconds taken by all map tasks=20510
 Total megabyte-milliseconds taken by all map tasks=31503360
 Map-Reduce Framework
 CPU time spent (ms)=0
 Physical memory (bytes) snapshot=0
 Virtual memory (bytes) snapshot=0
18/11/10 16:19:01 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 17.1712 seconds (0 bytes/sec)
18/11/10 16:19:01 INFO mapreduce.ExportJobBase: Exported 0 records.
18/11/10 16:19:01 ERROR mapreduce.ExportJobBase: Export job failed!
18/11/10 16:19:01 ERROR tool.ExportTool: Error during export: Export job failed!


How can I determine what the exact error is?






export sqoop




export sqoop






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 10 at 21:19









halfer

14.2k757105




14.2k757105










asked Nov 10 at 17:15









NewUser

62




62











  • Need more detailed stack trace. Check for yarn container logs.
    – shriyog
    Nov 12 at 7:12
















  • Need more detailed stack trace. Check for yarn container logs.
    – shriyog
    Nov 12 at 7:12















Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12




Need more detailed stack trace. Check for yarn container logs.
– shriyog
Nov 12 at 7:12

















active

oldest

votes











Your Answer






StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













 

draft saved


draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53241442%2fgetting-error-while-sqoop-export-how-can-i-find-out-the-exact-error%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown






























active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes















 

draft saved


draft discarded















































 


draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53241442%2fgetting-error-while-sqoop-export-how-can-i-find-out-the-exact-error%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







Clf,9b5g6 kLU taZpXmsYXPzSYsqne1fHw4
-
8iv,l1jq9

Popular posts from this blog

Top Tejano songwriter Luis Silva dead of heart attack at 64

Image
Ramiro Burr's New Blog - to go back: www.ramiroburr.com From Latin rock to reggaeton, boleros to blues,Tex-Mex to Tejano, conjunto to corridos and beyond, Ramiro Burr has it covered. If you have a new CD release, a trivia question or are looking for tour info, post a message here or e-mail Ramiro directly at: musicreporter@gmail.com Top Tejano songwriter Luis Silva dead of heart attack at 64 By Ramiro Burr on October 23, 2008 8:40 AM | Permalink | Comments (12) | TrackBacks (0) UPDATE: Luis Silva Funeral Service details released Visitation 4-9 p.m. Saturday, Rosary service 6 p.m. Saturday at Porter Loring, 1101 McCullough Ave Funeral Service 10:30 a.m. Monday St. Anthony De Padua Catholic Church, Burial Service at Chapel Hills, 7735 Gibbs Sprawl Road. Porter Loring (210) 227-8221 Related New Flash: Irma Laura Lopez: long time record promoter killed in accident NewsFlash: 9:02 a.m. (New comments below) Luis Silva , one of the most well-known ...
Read more

Can't figure out why I get Error loading static resource from app.xaml

Image
1 I having trouble getting my ResourceDictionary.MergedDictionaries to load from app.xaml. My WPF app has a static class with a Main defined and startup object set to it. Within Main I created an instance of App and run it. The override OnStartup fires and the mainwindow.cs InitializeComponent gives the error "Message "Cannot find resource named 'MaterialDesignFloatingActionMiniAccentButton'. If I put the resources in the mainwindow.xaml everything is fine, but I wanted them to load at the app level so I they are not in each page. Any help appreciated. public partial class App protected override void OnStartup(StartupEventArgs e) base.OnStartup(e); var app = new MainWindow(); var context = new MainWindowViewModel(); app.DataContext = context; app.Show(); from the Main.. var app = new App(); app.Run(); app.xaml.. <Application x:Class="GS.Server.App" xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation" xmlns:...
Read more

How to fill missing numeric if any value in a subset is missing, all other columns with the same subset are missing

Image
up vote 2 down vote favorite There is a clear pattern that show for two separate subsets (set of columns); If one value is missing in a column, values of other columns in the same subset are missing for any row. Here is a visualization of missing data My tries up until now, I used ycimpute library to learn from other values, and applied Iterforest. I noted, score of Logistic regression is so weak (0.6) and thought Iterforest might not learn enough or anyway, except from outer subset which might not be enough? for example the subset with 11 columns might learn from the other columns but not from within it's members, and the same goes for the subset with four columns. This bar plot show better quantity of missings So of course, dealing with missings is better than dropping rows because It would affect my prediction which does contain the same missings quantity relatively. Any better way to deal with these ? [EDIT] The nullity pattern is confirmed: machine-learning cor...
Read more