![[Jenkins]](/static/755cd4af/images/svgs/logo.svg){kind=logo}
Started by user arnoldg Building on master in workspace /var/lib/jenkins/workspace/SPP-PPM-768O2-18XEs-jyc executing script: # Moving to the building folder cd ~ tar xvf ~arnoldg/ppm.tar cd SPP-PPM/PPM-768O2-18XEs ls -al # Updating modules module unload darshan /u/vendor/cray/dalton/modulefiles module unload PrgEnv-cray module load PrgEnv/cray-18_06-cuda-9.1 module load craype-hugepages2M module list # Building the binary rm -rf PPM2F-768O2 *.o *.dat iq.h ./compile-JK-noPapi # Submitting the job script MYJOBID=`qsub run-PPM2F-768O2` echo MYJOBID=$MYJOBID # Waiting for the job completion cat -n wait_for.sh ./wait_for.sh $MYJOBID # Computing Flop/s python FLOPS-PPM-JK-v02.py $MYJOBID 18 bash: line 9: /u/vendor/cray/dalton/modulefiles: is a directory SPP-PPM/PPM-768O2-18XEs/ SPP-PPM/PPM-768O2-18XEs/compile-JK-noPapi SPP-PPM/PPM-768O2-18XEs/stderrout.6422331.bw SPP-PPM/PPM-768O2-18XEs/PPM-768O2.o6422331 SPP-PPM/PPM-768O2-18XEs/generate-MPICH_RANK_ORDER_V2 SPP-PPM/PPM-768O2-18XEs/PPM-768O2.o8095607 SPP-PPM/PPM-768O2-18XEs/stderrout.6413096.bw SPP-PPM/PPM-768O2-18XEs/PPM-768O2.o6413794 SPP-PPM/PPM-768O2-18XEs/DATA768O2.8095607.bw SPP-PPM/PPM-768O2-18XEs/PPM2F-tp3-5-1-12-ICF-short-loops.s SPP-PPM/PPM-768O2-18XEs/flops-PPM2F-768O2 SPP-PPM/PPM-768O2-18XEs/cio.o SPP-PPM/PPM-768O2-18XEs/PPM4Fperf.ppm.6413794.bw SPP-PPM/PPM-768O2-18XEs/PPM2F-768O2 SPP-PPM/PPM-768O2-18XEs/PPM4Fperf.ppm.8095607.bw SPP-PPM/PPM-768O2-18XEs/stderrout.6422876.bw SPP-PPM/PPM-768O2-18XEs/source_me_JK SPP-PPM/PPM-768O2-18XEs/cio.c SPP-PPM/PPM-768O2-18XEs/PPM2F-tp3-5-1-12-ICF-short-loops.F SPP-PPM/PPM-768O2-18XEs/PPM2F-tp3-5-1-12-ICF-short-loops.o SPP-PPM/PPM-768O2-18XEs/run-PPM2F-768O2 SPP-PPM/PPM-768O2-18XEs/iq.h SPP-PPM/PPM-768O2-18XEs/PPM4Fperf.ppm.6413096.bw SPP-PPM/PPM-768O2-18XEs/DATA768O2.6413794.bw SPP-PPM/PPM-768O2-18XEs/wait_for.sh SPP-PPM/PPM-768O2-18XEs/PPM-768O2.o6422876 SPP-PPM/PPM-768O2-18XEs/DATA768O2.6422331.bw SPP-PPM/PPM-768O2-18XEs/stderrout.6413794.bw SPP-PPM/PPM-768O2-18XEs/PPM-768O2.o6413096 SPP-PPM/PPM-768O2-18XEs/iq768O2.h SPP-PPM/PPM-768O2-18XEs/PPM2F-tp3-5-1-12-ICF-short-loops.lst SPP-PPM/PPM-768O2-18XEs/FLOPS-PPM-JK-v02.py SPP-PPM/PPM-768O2-18XEs/DATA768O2.6413096.bw SPP-PPM/PPM-768O2-18XEs/PPM4Fperf.ppm.6422876.bw SPP-PPM/PPM-768O2-18XEs/DATA768O2.6422876.bw SPP-PPM/PPM-768O2-18XEs/PPM4Fperf.ppm.6422331.bw SPP-PPM/PPM-768O2-18XEs/stderrout.8095607.bw total 14054 drwxr-xr-x 2 bwjenkins BW_System 12288 Feb 14 07:31 . drwxr-xr-x 3 bwjenkins BW_System 4096 Feb 14 07:43 .. -rw-r--r-- 1 bwjenkins BW_System 1255 Mar 29 2017 cio.c -rw-r--r-- 1 bwjenkins BW_System 4088 Feb 14 07:31 cio.o -rwxr-xr-x 1 bwjenkins BW_System 381 Mar 29 2017 compile-JK-noPapi lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 14 07:44 DATA768O2.229383.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229383.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 14 11:11 DATA768O2.229402.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229402.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 14 11:36 DATA768O2.229407.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229407.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 14 12:02 DATA768O2.229408.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229408.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 16 16:22 DATA768O2.229658.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229658.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 19 17:16 DATA768O2.229889.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229889.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 19 17:53 DATA768O2.229896.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229896.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 20 08:14 DATA768O2.229976.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229976.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 20 09:30 DATA768O2.229984.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229984.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 20 09:52 DATA768O2.229990.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229990.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 20 11:03 DATA768O2.229998.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.229998.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 20 13:59 DATA768O2.230013.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230013.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 21 12:56 DATA768O2.230138.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230138.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 21 14:11 DATA768O2.230155.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230155.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 21 16:26 DATA768O2.230179.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230179.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 22 08:04 DATA768O2.230229.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230229.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 23 09:17 DATA768O2.230326.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230326.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Feb 27 07:52 DATA768O2.230618.jyc -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.230618.jyc lrwxrwxrwx 1 bwjenkins BW_System 54 Mar 29 2017 DATA768O2.6413096.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.6413096.bw lrwxrwxrwx 1 bwjenkins BW_System 54 Mar 29 2017 DATA768O2.6413794.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.6413794.bw lrwxrwxrwx 1 bwjenkins BW_System 54 Mar 30 2017 DATA768O2.6422331.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.6422331.bw lrwxrwxrwx 1 bwjenkins BW_System 54 Mar 30 2017 DATA768O2.6422876.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.6422876.bw lrwxrwxrwx 1 bwjenkins BW_System 54 Jan 22 16:12 DATA768O2.8095607.bw -> /scratch/system/bwjenkins/SPP-PPM/DATA768O2.8095607.bw -rwxr--r-- 1 bwjenkins BW_System 444 Mar 29 2017 flops-PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 2826 Mar 29 2017 FLOPS-PPM-JK-v02.py -rwxr-xr-x 1 bwjenkins BW_System 541 Mar 29 2017 generate-MPICH_RANK_ORDER_V2 -rw-r--r-- 1 bwjenkins BW_System 13 Feb 27 08:16 GFLOPS_SEC_NODE.dat -rw-r--r-- 1 bwjenkins BW_System 864 Mar 29 2017 iq768O2.h -rw-r--r-- 1 bwjenkins BW_System 864 Feb 14 07:31 iq.h -rwxr-xr-x 1 bwjenkins BW_System 11190291 Feb 14 07:31 PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 2281686 Mar 29 2017 PPM2F-tp3-5-1-12-ICF-short-loops.F -rw-r--r-- 1 bwjenkins BW_System 4478516 Feb 14 07:31 PPM2F-tp3-5-1-12-ICF-short-loops.lst -rw-r--r-- 1 bwjenkins BW_System 883936 Feb 14 07:31 PPM2F-tp3-5-1-12-ICF-short-loops.o -rw-r--r-- 1 bwjenkins BW_System 6395252 Feb 14 07:31 PPM2F-tp3-5-1-12-ICF-short-loops.s -rw------- 1 bwjenkins BW_System 12279 Feb 14 07:59 PPM4Fperf.ppm.229383.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 14 11:26 PPM4Fperf.ppm.229402.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 14 11:52 PPM4Fperf.ppm.229407.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 14 12:18 PPM4Fperf.ppm.229408.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 16 16:37 PPM4Fperf.ppm.229658.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 19 17:31 PPM4Fperf.ppm.229889.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 19 18:08 PPM4Fperf.ppm.229896.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 20 08:29 PPM4Fperf.ppm.229976.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 20 09:45 PPM4Fperf.ppm.229984.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 20 10:08 PPM4Fperf.ppm.229990.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 20 11:18 PPM4Fperf.ppm.229998.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 20 14:14 PPM4Fperf.ppm.230013.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 21 13:11 PPM4Fperf.ppm.230138.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 21 14:26 PPM4Fperf.ppm.230155.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 21 16:41 PPM4Fperf.ppm.230179.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 22 08:19 PPM4Fperf.ppm.230229.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 23 09:32 PPM4Fperf.ppm.230326.jyc -rw------- 1 bwjenkins BW_System 12279 Feb 27 08:07 PPM4Fperf.ppm.230618.jyc -rw------- 1 bwjenkins BW_System 12279 Mar 29 2017 PPM4Fperf.ppm.6413096.bw -rw------- 1 bwjenkins BW_System 0 Mar 29 2017 PPM4Fperf.ppm.6413794.bw -rw------- 1 bwjenkins BW_System 12279 Mar 30 2017 PPM4Fperf.ppm.6422331.bw -rw------- 1 bwjenkins BW_System 12279 Mar 30 2017 PPM4Fperf.ppm.6422876.bw -rw------- 1 bwjenkins BW_System 12279 Jan 22 16:28 PPM4Fperf.ppm.8095607.bw -rw------- 1 bwjenkins BW_System 2116 Feb 14 07:59 PPM-768O2.o229383 -rw------- 1 bwjenkins BW_System 2116 Feb 14 11:26 PPM-768O2.o229402 -rw------- 1 bwjenkins BW_System 2116 Feb 14 11:52 PPM-768O2.o229407 -rw------- 1 bwjenkins BW_System 2116 Feb 14 12:18 PPM-768O2.o229408 -rw------- 1 bwjenkins BW_System 2116 Feb 16 16:37 PPM-768O2.o229658 -rw------- 1 bwjenkins BW_System 2116 Feb 19 17:31 PPM-768O2.o229889 -rw------- 1 bwjenkins BW_System 2116 Feb 19 18:08 PPM-768O2.o229896 -rw------- 1 bwjenkins BW_System 2116 Feb 20 08:30 PPM-768O2.o229976 -rw------- 1 bwjenkins BW_System 2116 Feb 20 09:45 PPM-768O2.o229984 -rw------- 1 bwjenkins BW_System 2116 Feb 20 10:08 PPM-768O2.o229990 -rw------- 1 bwjenkins BW_System 2116 Feb 20 11:18 PPM-768O2.o229998 -rw------- 1 bwjenkins BW_System 2116 Feb 20 14:14 PPM-768O2.o230013 -rw------- 1 bwjenkins BW_System 2118 Feb 21 13:11 PPM-768O2.o230138 -rw------- 1 bwjenkins BW_System 2118 Feb 21 14:26 PPM-768O2.o230155 -rw------- 1 bwjenkins BW_System 2118 Feb 21 16:41 PPM-768O2.o230179 -rw------- 1 bwjenkins BW_System 2118 Feb 22 08:19 PPM-768O2.o230229 -rw------- 1 bwjenkins BW_System 2118 Feb 23 09:33 PPM-768O2.o230326 -rw------- 1 bwjenkins BW_System 2118 Feb 27 08:07 PPM-768O2.o230618 -rw------- 1 bwjenkins BW_System 1308 Mar 29 2017 PPM-768O2.o6413096 -rw------- 1 bwjenkins BW_System 1308 Mar 29 2017 PPM-768O2.o6413794 -rw------- 1 bwjenkins BW_System 1308 Mar 30 2017 PPM-768O2.o6422331 -rw------- 1 bwjenkins BW_System 1308 Mar 30 2017 PPM-768O2.o6422876 -rw------- 1 bwjenkins BW_System 1314 Jan 22 16:28 PPM-768O2.o8095607 -rw-r--r-- 1 bwjenkins BW_System 836 Mar 29 2017 run-PPM2F-768O2 -rw-r--r-- 1 bwjenkins BW_System 66 Mar 29 2017 source_me_JK -rw------- 1 bwjenkins BW_System 76719 Feb 14 07:59 stderrout.229383.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 14 11:26 stderrout.229402.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 14 11:52 stderrout.229407.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 14 12:18 stderrout.229408.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 16 16:37 stderrout.229658.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 19 17:31 stderrout.229889.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 19 18:08 stderrout.229896.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 20 08:30 stderrout.229976.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 20 09:45 stderrout.229984.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 20 10:08 stderrout.229990.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 20 11:18 stderrout.229998.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 20 14:14 stderrout.230013.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 21 13:11 stderrout.230138.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 21 14:26 stderrout.230155.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 21 16:41 stderrout.230179.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 22 08:19 stderrout.230229.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 23 09:32 stderrout.230326.jyc -rw------- 1 bwjenkins BW_System 76719 Feb 27 08:07 stderrout.230618.jyc -rw------- 1 bwjenkins BW_System 70980 Mar 29 2017 stderrout.6413096.bw -rw------- 1 bwjenkins BW_System 300 Mar 29 2017 stderrout.6413794.bw -rw------- 1 bwjenkins BW_System 70979 Mar 30 2017 stderrout.6422331.bw -rw------- 1 bwjenkins BW_System 70979 Mar 30 2017 stderrout.6422876.bw -rw------- 1 bwjenkins BW_System 70979 Jan 22 16:28 stderrout.8095607.bw -rw-r--r-- 1 bwjenkins BW_System 12 Feb 27 08:16 TFLOPS_SEC-AGG.dat -rwxr--r-- 1 bwjenkins BW_System 223 Mar 29 2017 wait_for.sh ModuleCmd_Load.c(244):ERROR:105: Unable to locate a modulefile for 'PrgEnv/cray-18_06-cuda-9.1' Currently Loaded Modulefiles: 1) modules/3.2.10.5 2) nodestat/2.2-1.0502.60539.1.31.gem 3) sdb/1.1-1.0502.63652.4.27.gem 4) alps/5.2.4-2.0502.9774.31.12.gem 5) lustre-cray_gem_s/2.5_3.0.101_0.46.1_1.0502.8871.38.1-1.0502.21728.74.1 6) udreg/2.3.2-1.0502.10518.2.17.gem 7) ugni/6.0-1.0502.10863.8.28.gem 8) gni-headers/4.0-1.0502.10859.9.19.gem 9) dmapp/7.0.1-1.0502.11080.8.74.gem 10) xpmem/0.1-2.0502.64982.7.19.gem 11) hss-llm/7.2.0 12) Base-opts/1.0.2-1.0502.60680.2.4.gem 13) craype-network-gemini 14) craype/2.5.9 15) moab/9.1.2.h2-sles11 16) torque/6.1.2 17) craype-interlagos 18) cray-mpich/7.5.3 19) java/jdk1.8.0_51 20) globus/5.2.5 21) gsissh/6.2p2 22) xalt/0.7.6.local 23) scripts 24) OpenSSL/1.0.2m 25) cURL/7.59.0 26) git/2.17.0 27) wget/1.19.4 28) user-paths 29) craype-hugepages2M Error: A PrgEnv-* modulefile must be loaded. Error: A PrgEnv-* modulefile must be loaded. INFO: Job submitted to account: jnc MYJOBID=242581.jyc 1 #!/bin/bash 2 echo "=== RUNNING $0 ===" 3 4 while true 5 do 6 7 MYQSTAT=`qstat $1` 8 if test "$MYQSTAT" = "" 9 then 10 echo $1 finished 11 exit 12 else 13 DATE=`date` 14 echo "$DATE: waiting for $1 to finish" 15 16 fi 17 18 sleep 5m 19 20 done 21 22 === RUNNING ./wait_for.sh === Thu Jun 28 08:36:19 CDT 2018: waiting for 242581.jyc to finish Thu Jun 28 08:41:19 CDT 2018: waiting for 242581.jyc to finish qstat: Unknown Job Id Error 242581.nid00030 Traceback (most recent call last): File "FLOPS-PPM-JK-v02.py", line 59, in <module> AVG_FLOPCELL = sum(FLOPCELL)/float(len(FLOPCELL)) ZeroDivisionError: float division 242581.jyc finished PPM4Fperf.ppm.242581.jyc stderrout.242581.jyc Number of Compute Node = 18.0 Number of Dumps = 0 Ndump Flop/s per Cell [SSH] exit-status: 1 Build step 'Execute shell script on remote host using ssh' marked build as failure Recording plot data Saving plot series data from: /var/lib/jenkins/workspace/SPP-PPM-768O2-18XEs-jyc/TFLOPS_SEC-AGG.dat Saving plot series data from: /var/lib/jenkins/workspace/SPP-PPM-768O2-18XEs-jyc/GFLOPS_SEC_NODE.dat Sending e-mails to: [email protected] Finished: FAILURE