Started by user tbouvet
Started by user Greg Bauer
[EnvInject] - Loading node environment variables.
Building on master in workspace /var/lib/jenkins/workspace/psdns-spp
executing script:
rm -rf psdns-spp/
mkdir psdns-spp
cd psdns-spp
tar xzf /projects/bluewaters/benchmarking/PSDNS_nov2016/spp_PSDNS.tar.gz
cd spp_PSDNS/PSDNS/
module load fftw
module load cray-hdf5-parallel
module load craype-hugepages2M
make cleanest
make srcmake
make
cd ../dir_runs128
echo "cat -n eulstat > ~/psdns-spp/eulstat.txt " >> batch
cat -n batch
MYJOBID=`qsub batch`
echo MYJOBID=$MYJOBID
~arnoldg/ior/wait_for.sh $MYJOBID
/bin/rm: cannot remove `*.o': No such file or directory
/bin/rm: cannot remove `*.mod': No such file or directory
/bin/rm: cannot remove `*.lst': No such file or directory
make: [cleanest] Error 1 (ignored)
/bin/rm *.o *.mod *.lst
files cleaned
rm -rf .srcmake
removed .srcmake
deleting .srcmake
rm -rf .srcmake
constructing .srcmake
mkdir -v -p .srcmake/nullhooks/diagnostics
mkdir: created directory `.srcmake'
mkdir: created directory `.srcmake/nullhooks'
mkdir: created directory `.srcmake/nullhooks/diagnostics'
mkdir -v -p .srcmake/nullhooks/initial_conditions
mkdir: created directory `.srcmake/nullhooks/initial_conditions'
mkdir -v -p .srcmake/nullhooks/LAG
mkdir: created directory `.srcmake/nullhooks/LAG'
mkdir -v -p .srcmake/nullhooks/stratification
mkdir: created directory `.srcmake/nullhooks/stratification'
mkdir -v -p .srcmake/hooks/diagnostics
mkdir: created directory `.srcmake/hooks'
mkdir: created directory `.srcmake/hooks/diagnostics'
mkdir -v -p .srcmake/hooks/initial_conditions
mkdir: created directory `.srcmake/hooks/initial_conditions'
mkdir -v -p .srcmake/hooks/LAG
mkdir: created directory `.srcmake/hooks/LAG'
mkdir -v -p .srcmake/hooks/LAG_PIPE
mkdir: created directory `.srcmake/hooks/LAG_PIPE'
mkdir -v -p .srcmake/hooks/LAG_LOCAL
mkdir: created directory `.srcmake/hooks/LAG_LOCAL'
mkdir -v -p .srcmake/hooks/stratification
mkdir: created directory `.srcmake/hooks/stratification'
mkdir -v -p .srcmake/hooks/stratification/BOUSS
mkdir: created directory `.srcmake/hooks/stratification/BOUSS'
mkdir -v -p .srcmake/homogeneous
mkdir: created directory `.srcmake/homogeneous'
mkdir -v -p .srcmake/inhomogeneous/channel
mkdir: created directory `.srcmake/inhomogeneous'
mkdir: created directory `.srcmake/inhomogeneous/channel'
mkdir -v -p .srcmake/inhomogeneous/bl
mkdir: created directory `.srcmake/inhomogeneous/bl'
srcmake folders generated: code can now be compiled
/lib/cpp -traditional -P -DCAF -DKXCOMM2 -DCLEAN -DFRESH -P -DBOXPHY -DRKFOUR -DRANDOM_SEED -DEPFOR -DDOUBLE_PREC -DREADR -DFFTW -DHOMOGENEOUS -DBAL_PERIOD=4 -DREVERSE_DIMS -DUSE_EVEN -DOUT1D -DINPUT_PEN -DOUTPUT_PEN -DSHELL_DK -DSUBDIR -DLVSTEP -DMODEL_SPECTRUM module.f .srcmake/module.f
Error:
cray-hdf5-parallel/1.8.11 is not compatible with cce/8.4.6.
Either:
module swap cray-hdf5-parallel cray-hdf5-parallel/(1.8.13 or newer) or
module swap cce cce/(older than 8.3.0)
make: *** [module.o] Error 1
ftn -c -I. -Ofp3,scalar3,thread0 -N132 -hcaf -hnoomp -sreal64 -I/opt/cray/fftw/3.3.4.10/interlagos/include .srcmake/module.f
1 #!/bin/bash
2 #PBS -N PSDNS.128node
3 #PBS -l nodes=128:ppn=32:xe
4 #PBS -l walltime=00:20:00
5 #PBS -o stdout.$PBS_JOBID
6 #PBS -e stderr.$PBS_JOBID
7 #PBS -q normal
8 ##PBS -A ??
9 ##PBS -M <EMAIL ADDRESS HERE>
10
11 # for echoing commands
12 set -x
13
14 cd $PBS_O_WORKDIR
15
16 #module unload altd
17 #module unload CrayPat
18 module load fftw
19 module load cray-hdf5-parallel
20 module load craype-hugepages2M
21
22 # for perftools
23 #module load unload darshan
24 #module load unload xalt
25 #module load perftools-base
26 #module load perftools-lite
27
28 export XT_SYMMETRIC_HEAP_SIZE=200M
29 export APRUN_BALANCED_INJECTION=64
30 export ATP_ENABLED=1
31
32 # Execution block.
33 EXE="../PSDNS/DNS2d_mpi_p8_CAF.x"
34 aprun -N32 -n4096 -d1 ${EXE}
35 cat -n eulstat > ~/psdns-spp/eulstat.txt
Job submitted to account: jnc
MYJOBID=6412336.bw
=== RUNNING /u/staff/arnoldg/ior/wait_for.sh ===
Wed Mar 29 08:59:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:04:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:09:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:14:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:19:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:24:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:29:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:34:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:39:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:44:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:49:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:54:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 09:59:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:04:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:09:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:14:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:19:20 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:24:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:29:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:34:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:39:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:44:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:49:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:54:22 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 10:59:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:04:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:09:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:14:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:19:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:24:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:29:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:34:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:39:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:44:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:49:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:54:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 11:59:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:04:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:09:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:14:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:19:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:24:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:29:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:34:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:39:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:44:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:49:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:54:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 12:59:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:04:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:09:23 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:14:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:19:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:24:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:29:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:34:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:39:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:44:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:49:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:54:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 13:59:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:04:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:09:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:14:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:19:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:24:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:29:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:34:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:39:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:44:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:49:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:54:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 14:59:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:04:24 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:09:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:14:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:19:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:24:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:29:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:34:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:39:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:44:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:49:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:54:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 15:59:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:04:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:09:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:14:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:19:25 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:24:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:29:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:34:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:39:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:44:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:49:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:54:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 16:59:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:04:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:09:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:14:26 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:19:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:24:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:29:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:34:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:39:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:44:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:49:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:54:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 17:59:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:04:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:09:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:14:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:19:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:24:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:29:27 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:34:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:39:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:44:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:49:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:54:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 18:59:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:04:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:09:28 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:14:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:19:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:24:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:29:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:34:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:39:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:44:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:49:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:54:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 19:59:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:04:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:09:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:14:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:19:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:24:29 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:29:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:34:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:39:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:44:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:49:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:54:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 20:59:30 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 21:04:31 CDT 2017: waiting for 6412336.bw to finish
Wed Mar 29 21:09:31 CDT 2017: waiting for 6412336.bw to finish
qstat: Unknown Job Id Error 6412336.bw
6412336.bw finished
[SSH] exit-status: 0
[psdns-spp] $ /bin/sh -xe /tmp/jenkins6023637101532655935.sh
+ scp 'BW_REMOTE:~/psdns-spp/eulstat.txt' /var/lib/jenkins/workspace/psdns-spp
Access by OTP or Two Factor Certificate Authority only.
Use myproxy-logon -s tfca.ncsa.illinois.edu -p 7512 for gsissh access.
gsissh or ssh -o PreferredAuthentications=keyboard-interactive for otp access.
Blue Waters down for maintenance that started on Tuesday Mar 28th, at
12:01am (midnight), extending to Wednesday Mar 29th 04:00pm.
Blue Waters Admin Team
Finished: SUCCESS