Skip to content
[Jenkins]Jenkins
log in

Failed

projectroot.test.RAE2822_RANS_Subsonic_UniAdapt_TEST (from CTest)

Failing for the past 2 builds (Since Failed #296 )
Took 50 sec.

Stacktrace

OUT/RAE2822_RANS_Subsonic_UniAdapt_TEST
--------------------------------------------------------------------------
mpirun has exited due to process rank 0 with PID 23773 on
node reynolds exiting improperly. There are two reasons this could occur:

1. this process did not call "init" before exiting, but others in
the job did. This can cause a job to hang indefinitely while it waits
for all processes to call "init". By rule, if one process calls "init",
then ALL processes must call "init" prior to termination.

2. this process called "init", but exited without calling "finalize".
By rule, all processes that call "init" MUST call "finalize" prior to
exiting or it will be considered an "abnormal termination"

This may have caused other processes in the application to be
terminated by signals sent by mpirun (as reported here).
--------------------------------------------------------------------------
   > ERROR: ../platforms/release_gnu48/bin/ProjectX exited with error code 247 for RAE2822_RANS_Subsonic_UniAdapt_TEST.job
truth = 1.783459104286990623E+04, test = 1.597268982805801352E+04, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 1 of node 283.
truth = 8.600188517907790811E+03, test = 7.702343346655292407E+03, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 2 of node 283.
truth = 2.937094470446081323E+04, test = 2.630466763121828626E+04, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 0 of node 284.
truth = 2.646091937881102240E+03, test = 2.369844403984638120E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 284.
truth = 3.710264256523205404E+02, test = 3.322918928004696681E+02, relerror = 1.043983128256961990E-01
Metric Check mismatch on component 2 of node 284.
truth = 1.594940562605158448E+03, test = 1.428431458811913217E+03, relerror = 1.043983128256961990E-01
Metric Check mismatch on component 0 of node 285.
truth = 5.169521427411360492E+03, test = 4.629832112273329585E+03, relerror = 1.043983128256962267E-01
Metric Check mismatch on component 1 of node 285.
truth = 6.605223143011252205E+02, test = 5.915648991043634624E+02, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 2 of node 285.
truth = 1.639140419343042595E+03, test = 1.468016925079224848E+03, relerror = 1.043983128256961573E-01
Metric Check mismatch on component 0 of node 286.
truth = 1.831488343306990600E+03, test = 1.640284050305811206E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 286.
truth = -6.830113760616620766E+02, test = -6.117061407600673419E+02, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 2 of node 286.
truth = 2.489416241146910579E+03, test = 2.229525385650286353E+03, relerror = 1.043983128256963100E-01
Metric Check mismatch on component 0 of node 287.
truth = 3.586272273751247667E+03, test = 3.211871499038043567E+03, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 1 of node 287.
truth = -1.624421744696981477E+03, test = -1.454834855233242706E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 2 of node 287.
truth = 2.477804367111909414E+03, test = 2.219125771673283907E+03, relerror = 1.043983128256962822E-01
Metric Check mismatch on component 0 of node 288.
truth = 1.220711618174492742E+03, test = 1.093271384790350112E+03, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 1 of node 288.
truth = 5.094231525266043832E+02, test = 4.562402348884795629E+02, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 2 of node 288.
truth = 9.357407652209043363E+02, test = 8.380510080896159479E+02, relerror = 1.043983128256962822E-01
Metric Check mismatch on component 0 of node 289.
truth = 2.466633707318293091E+04, test = 2.209121309915271195E+04, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 289.
truth = -4.583094450974485881E+03, test = -4.104627122771938957E+03, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 2 of node 289.
truth = 1.758537093358822312E+04, test = 1.574948787770757190E+04, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 0 of node 290.
truth = 5.627028355669214943E+04, test = 5.039576089114997012E+04, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 290.
truth = -1.134852516762412233E+04, test = -1.016375828706421089E+04, relerror = 1.043983128256963655E-01
Metric Check mismatch on component 2 of node 290.
truth = 5.830478605805252300E+04, test = 5.221786476392865734E+04, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 0 of node 291.
truth = 2.234158238784517835E+03, test = 2.000915888069785296E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 291.
truth = 1.416213485750557993E+03, test = 1.268363187237201373E+03, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 2 of node 291.
truth = 1.533968793973244374E+03, test = 1.373825039955169586E+03, relerror = 1.043983128256962684E-01
Metric Check mismatch on component 0 of node 292.
truth = 1.051794356097947457E+04, test = 9.419887998817323023E+03, relerror = 1.043983128256961296E-01
Metric Check mismatch on component 1 of node 292.
truth = -4.418731195847122763E+03, test = -3.957423114170411736E+03, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 2 of node 292.
truth = 1.009771917692152783E+04, test = 9.043534331463242779E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 0 of node 293.
truth = 8.337618281843459727E+02, test = 7.467185000234321706E+02, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 1 of node 293.
truth = 4.014746287316410189E+02, test = 3.595613548497349257E+02, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 2 of node 293.
truth = 1.276267595477284203E+03, test = 1.143027411795347462E+03, relerror = 1.043983128256963100E-01
Metric Check mismatch on component 0 of node 294.
truth = 1.665828650079339013E+03, test = 1.491918949554348728E+03, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 1 of node 294.
truth = -6.005492211929176847E+02, test = -5.378528957315911612E+02, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 2 of node 294.
truth = 1.010719186026319903E+03, test = 9.052018082646111452E+02, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 0 of node 295.
truth = 1.654009787508230829E+03, test = 1.481333956295183270E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 295.
truth = 4.726153778103994796E+02, test = 4.232751297515147826E+02, relerror = 1.043983128256962267E-01
Metric Check mismatch on component 2 of node 295.
truth = 6.963737969961212002E+02, test = 6.236735474937022445E+02, relerror = 1.043983128256962545E-01
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/Grid/PXMeshMetric.c  Line : 250
 Call : PX_CODE_FLOW_ERROR
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 2907
 Call : PXCheckTruthMetricFile(pg_meshing, CheckTruthMetricFileRoot, aiter)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 3321
 Call : PXAdjustGridH(pg0,pxa->Parameter,&pgH, aiter, &EfficiencyIndex)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdaptDirect.c  Line : 8351
 Call : PXAdjustGridHP(pxa, pg1,aiter)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 3717
 Call : PXAdaptHPDirect(pxa,aiter,DoneAdapt, &pg1, adaptModeHP)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXRunSolver.c  Line : 790
 Call : PXAdaptHP(pxa, aiter, PrimalSolveConvergedFlag, DoneAdapt)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXRunSolver.c  Line : 1026
 Call : PXAdaptIteration( pxa, aiter, ConvergedFlag, &DoneAdapt )
49.371u 0.168s 0:49.53 100.0%	0+0k 0+11144io 0pf+0w
Thu Mar 24 13:57:17 EDT 2016

   > ERROR: ../platforms/release_gnu48/bin/ProjectX exited with error code 247 for RAE2822_RANS_Subsonic_UniAdapt_TEST.job

Standard Output

OUT/RAE2822_RANS_Subsonic_UniAdapt_TEST
--------------------------------------------------------------------------
mpirun has exited due to process rank 0 with PID 23773 on
node reynolds exiting improperly. There are two reasons this could occur:

1. this process did not call "init" before exiting, but others in
the job did. This can cause a job to hang indefinitely while it waits
for all processes to call "init". By rule, if one process calls "init",
then ALL processes must call "init" prior to termination.

2. this process called "init", but exited without calling "finalize".
By rule, all processes that call "init" MUST call "finalize" prior to
exiting or it will be considered an "abnormal termination"

This may have caused other processes in the application to be
terminated by signals sent by mpirun (as reported here).
--------------------------------------------------------------------------
   > ERROR: ../platforms/release_gnu48/bin/ProjectX exited with error code 247 for RAE2822_RANS_Subsonic_UniAdapt_TEST.job
truth = 1.783459104286990623E+04, test = 1.597268982805801352E+04, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 1 of node 283.
truth = 8.600188517907790811E+03, test = 7.702343346655292407E+03, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 2 of node 283.
truth = 2.937094470446081323E+04, test = 2.630466763121828626E+04, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 0 of node 284.
truth = 2.646091937881102240E+03, test = 2.369844403984638120E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 284.
truth = 3.710264256523205404E+02, test = 3.322918928004696681E+02, relerror = 1.043983128256961990E-01
Metric Check mismatch on component 2 of node 284.
truth = 1.594940562605158448E+03, test = 1.428431458811913217E+03, relerror = 1.043983128256961990E-01
Metric Check mismatch on component 0 of node 285.
truth = 5.169521427411360492E+03, test = 4.629832112273329585E+03, relerror = 1.043983128256962267E-01
Metric Check mismatch on component 1 of node 285.
truth = 6.605223143011252205E+02, test = 5.915648991043634624E+02, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 2 of node 285.
truth = 1.639140419343042595E+03, test = 1.468016925079224848E+03, relerror = 1.043983128256961573E-01
Metric Check mismatch on component 0 of node 286.
truth = 1.831488343306990600E+03, test = 1.640284050305811206E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 286.
truth = -6.830113760616620766E+02, test = -6.117061407600673419E+02, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 2 of node 286.
truth = 2.489416241146910579E+03, test = 2.229525385650286353E+03, relerror = 1.043983128256963100E-01
Metric Check mismatch on component 0 of node 287.
truth = 3.586272273751247667E+03, test = 3.211871499038043567E+03, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 1 of node 287.
truth = -1.624421744696981477E+03, test = -1.454834855233242706E+03, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 2 of node 287.
truth = 2.477804367111909414E+03, test = 2.219125771673283907E+03, relerror = 1.043983128256962822E-01
Metric Check mismatch on component 0 of node 288.
truth = 1.220711618174492742E+03, test = 1.093271384790350112E+03, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 1 of node 288.
truth = 5.094231525266043832E+02, test = 4.562402348884795629E+02, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 2 of node 288.
truth = 9.357407652209043363E+02, test = 8.380510080896159479E+02, relerror = 1.043983128256962822E-01
Metric Check mismatch on component 0 of node 289.
truth = 2.466633707318293091E+04, test = 2.209121309915271195E+04, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 289.
truth = -4.583094450974485881E+03, test = -4.104627122771938957E+03, relerror = 1.043983128256962406E-01
Metric Check mismatch on component 2 of node 289.
truth = 1.758537093358822312E+04, test = 1.574948787770757190E+04, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 0 of node 290.
truth = 5.627028355669214943E+04, test = 5.039576089114997012E+04, relerror = 1.043983128256962545E-01
Metric Check mismatch on component 1 of node 290.
truth = -1.134852516762412233E+04, test = -1.016375828706421089E+04, relerror = 1.043983128256963655E-01
Metric Check mismatch on component 2 of node 290.
truth = 5.830478605805252300E+04, test = 5.221786476392865734E+04, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 0 of node 291.
truth = 2.234158238784517835E+03, test = 2.000915888069785296E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 291.
truth = 1.416213485750557993E+03, test = 1.268363187237201373E+03, relerror = 1.043983128256963516E-01
Metric Check mismatch on component 2 of node 291.
truth = 1.533968793973244374E+03, test = 1.373825039955169586E+03, relerror = 1.043983128256962684E-01
Metric Check mismatch on component 0 of node 292.
truth = 1.051794356097947457E+04, test = 9.419887998817323023E+03, relerror = 1.043983128256961296E-01
Metric Check mismatch on component 1 of node 292.
truth = -4.418731195847122763E+03, test = -3.957423114170411736E+03, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 2 of node 292.
truth = 1.009771917692152783E+04, test = 9.043534331463242779E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 0 of node 293.
truth = 8.337618281843459727E+02, test = 7.467185000234321706E+02, relerror = 1.043983128256962961E-01
Metric Check mismatch on component 1 of node 293.
truth = 4.014746287316410189E+02, test = 3.595613548497349257E+02, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 2 of node 293.
truth = 1.276267595477284203E+03, test = 1.143027411795347462E+03, relerror = 1.043983128256963100E-01
Metric Check mismatch on component 0 of node 294.
truth = 1.665828650079339013E+03, test = 1.491918949554348728E+03, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 1 of node 294.
truth = -6.005492211929176847E+02, test = -5.378528957315911612E+02, relerror = 1.043983128256963377E-01
Metric Check mismatch on component 2 of node 294.
truth = 1.010719186026319903E+03, test = 9.052018082646111452E+02, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 0 of node 295.
truth = 1.654009787508230829E+03, test = 1.481333956295183270E+03, relerror = 1.043983128256961851E-01
Metric Check mismatch on component 1 of node 295.
truth = 4.726153778103994796E+02, test = 4.232751297515147826E+02, relerror = 1.043983128256962267E-01
Metric Check mismatch on component 2 of node 295.
truth = 6.963737969961212002E+02, test = 6.236735474937022445E+02, relerror = 1.043983128256962545E-01
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/Grid/PXMeshMetric.c  Line : 250
 Call : PX_CODE_FLOW_ERROR
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 2907
 Call : PXCheckTruthMetricFile(pg_meshing, CheckTruthMetricFileRoot, aiter)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 3321
 Call : PXAdjustGridH(pg0,pxa->Parameter,&pgH, aiter, &EfficiencyIndex)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdaptDirect.c  Line : 8351
 Call : PXAdjustGridHP(pxa, pg1,aiter)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXHPAdapt.c  Line : 3717
 Call : PXAdaptHPDirect(pxa,aiter,DoneAdapt, &pg1, adaptModeHP)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXRunSolver.c  Line : 790
 Call : PXAdaptHP(pxa, aiter, PrimalSolveConvergedFlag, DoneAdapt)
Error -9 (Code Flow) has occured.
 File : /home1/jenkins/workspace/ProjectX_Commit/PX_ARC/release_gnu48/buildnode/reynolds/src/PXRunSolver.c  Line : 1026
 Call : PXAdaptIteration( pxa, aiter, ConvergedFlag, &DoneAdapt )
49.371u 0.168s 0:49.53 100.0%	0+0k 0+11144io 0pf+0w
Thu Mar 24 13:57:17 EDT 2016

   > ERROR: ../platforms/release_gnu48/bin/ProjectX exited with error code 247 for RAE2822_RANS_Subsonic_UniAdapt_TEST.job