Started by user jkwack2 [EnvInject] - Loading node environment variables. Building on master in workspace /var/lib/jenkins/workspace/SPP-PPM-768O2 executing script: # Moving to the building folder cd SPP-PPM/PPM-768O2-18XEs ls -al # Updating modules module unload darshan module load craype-hugepages2M module list # Building the binary rm -rf PPM2F-768O2 *.o *.dat ./compile-JK-nopapi # Submitting the job script MYJOBID=`qsub run-PPM2F-768O2` echo MYJOBID=$MYJOBID # Waiting for the job completion cat -n wait_for.sh ./wait_for.sh $MYJOBID # Computing Flop/s python FLOPS-PPM-JK-v02.py $MYJOBID 18 bash: line 12: ./compile-JK-nopapi: No such file or directory total 24808 drwxr-xr-x 2 bwjenkins BW_System 4096 Mar 29 11:31 . drwxr-xr-x 4 bwjenkins BW_System 4096 Mar 29 09:46 .. -rw-r--r-- 1 bwjenkins BW_System 1255 Mar 29 09:51 cio.c -rw-r--r-- 1 bwjenkins BW_System 4088 Mar 29 09:56 cio.o -rwxr-xr-x 1 bwjenkins BW_System 381 Mar 29 09:51 compile-JK-noPapi lrwxrwxrwx 1 bwjenkins BW_System 54 Mar 29 10:08 DATA768O2.6413096.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.6413096.bw -rwxr--r-- 1 bwjenkins BW_System 444 Mar 29 09:51 flops-PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 2826 Mar 29 11:30 FLOPS-PPM-JK-v02.py -rwxr-xr-x 1 bwjenkins BW_System 541 Mar 29 09:51 generate-MPICH_RANK_ORDER_V2 -rw-r--r-- 1 bwjenkins BW_System 13 Mar 29 11:31 GFLOPS_SEC_NODE.dat -rw-r--r-- 1 bwjenkins BW_System 864 Mar 29 09:51 iq768O2.h -rw-r--r-- 1 bwjenkins BW_System 864 Mar 29 09:56 iq.h -rwxr-xr-x 1 bwjenkins BW_System 11190291 Mar 29 09:57 PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 2281686 Mar 29 09:51 PPM2F-tp3-5-1-12-ICF-short-loops.F -rw-r--r-- 1 bwjenkins BW_System 4478516 Mar 29 09:57 PPM2F-tp3-5-1-12-ICF-short-loops.lst -rw-r--r-- 1 bwjenkins BW_System 883936 Mar 29 09:57 PPM2F-tp3-5-1-12-ICF-short-loops.o -rw-r--r-- 1 bwjenkins BW_System 6395252 Mar 29 09:57 PPM2F-tp3-5-1-12-ICF-short-loops.s -rw------- 1 bwjenkins BW_System 12279 Mar 29 10:24 PPM4Fperf.ppm.6413096.bw -rw------- 1 bwjenkins BW_System 1308 Mar 29 10:25 PPM-768O2.o6413096 -rw-r--r-- 1 bwjenkins BW_System 836 Mar 29 09:51 run-PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 66 Mar 29 09:56 source_me_JK -rw------- 1 bwjenkins BW_System 70980 Mar 29 10:24 stderrout.6413096.bw -rw-r--r-- 1 bwjenkins BW_System 12 Mar 29 11:31 TFLOPS_SEC-AGG.dat -rwxr--r-- 1 bwjenkins BW_System 223 Mar 29 09:58 wait_for.sh Currently Loaded Modulefiles: 1) modules/3.2.10.4 2) eswrap/1.3.3-1.020200.1278.0 3) cce/8.4.6 4) craype-network-gemini 5) craype/2.5.8 6) cray-libsci/16.11.1 7) udreg/2.3.2-1.0502.10518.2.17.gem 8) ugni/6.0-1.0502.10863.8.28.gem 9) pmi/5.0.10-1.0000.11050.179.3.gem 10) dmapp/7.0.1-1.0502.11080.8.74.gem 11) gni-headers/4.0-1.0502.10859.7.8.gem 12) xpmem/0.1-2.0502.64982.5.3.gem 13) dvs/2.5_0.9.0-1.0502.2188.1.113.gem 14) alps/5.2.4-2.0502.9774.31.12.gem 15) rca/1.0.0-2.0502.60530.1.63.gem 16) atp/2.0.4 17) PrgEnv-cray/5.2.82 18) cray-mpich/7.5.0 19) craype-interlagos 20) torque/6.0.3 21) moab/9.0.2.TAS2-1477409647_6706986-sles11 22) java/jdk1.8.0_51 23) globus/5.2.5 24) gsissh/6.2p2 25) scripts 26) user-paths 27) xalt/0.7.6 28) craype-hugepages2M Job submitted to account: jnc MYJOBID=6413794.bw 1 #!/bin/bash 2 echo "=== RUNNING $0 ===" 3 4 while true 5 do 6 7 MYQSTAT=`qstat $1` 8 if test "$MYQSTAT" = "" 9 then 10 echo $1 finished 11 exit 12 else 13 DATE=`date` 14 echo "$DATE: waiting for $1 to finish" 15 16 fi 17 18 sleep 5m 19 20 done 21 22 === RUNNING ./wait_for.sh === Wed Mar 29 11:36:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 11:41:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 11:46:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 11:51:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 11:56:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:01:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:06:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:11:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:16:17 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:21:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:26:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:31:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:36:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:41:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:46:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:51:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 12:56:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:01:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:06:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:11:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:16:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:21:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:26:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:31:18 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:36:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:41:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:46:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:51:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 13:56:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:01:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:06:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:11:19 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:16:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:21:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:26:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:31:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:36:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:41:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:46:20 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:51:21 CDT 2017: waiting for 6413794.bw to finish Wed Mar 29 14:56:21 CDT 2017: waiting for 6413794.bw to finish qstat: Unknown Job Id Error 6413794.bw Traceback (most recent call last): File "FLOPS-PPM-JK-v02.py", line 59, in AVG_FLOPCELL = sum(FLOPCELL)/float(len(FLOPCELL)) ZeroDivisionError: float division 6413794.bw finished PPM4Fperf.ppm.6413794.bw stderrout.6413794.bw Number of Compute Node = 18.0 Number of Dumps = 0 Ndump Flop/s per Cell [SSH] exit-status: 1 Build step 'Execute shell script on remote host using ssh' marked build as failure Recording plot data No plot data file found: GFLOPS_SEC_NODE.dat No plot data file found: TFLOPS_SEC-AGG.dat Sending e-mails to: jkwack2@illinois.edu Finished: FAILURE