![[Jenkins]](/static/755cd4af/images/svgs/logo.svg){kind=logo}
Started by timer Running as SYSTEM Building in workspace /var/lib/jenkins/jobs/mdtest-jyc/workspace [SSH] script: ~arnoldg/ior/myenv.sh mkdir mdtest-jenkins cd mdtest-jenkins rm -rf * git clone https://github.com/MDTEST-LANL/mdtest cd mdtest/old make CC=cc mv * .. cd .. echo "#!/bin/bash" > mdtest.pbs echo "#PBS -lnodes=4:ppn=6:xe,walltime=00:15:00 -Nmdtest" >> mdtest.pbs echo "cd ~/scratch" >> mdtest.pbs echo "rm -rf mdtest" >> mdtest.pbs echo "mkdir mdtest" >> mdtest.pbs echo "cd mdtest" >> mdtest.pbs echo "aprun -n 24 ~/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d ~/scratch/mdtest > myout" >> mdtest.pbs echo "grep ops myout | grep read | cut -d, -f2 | cut -do -f1 > mdtest.datB" >> mdtest.pbs echo "echo YVALUE= > mdtest.datA" >> mdtest.pbs echo "paste mdtest.datA mdtest.datB > mdtest.read" >> mdtest.pbs echo "grep ops myout | grep removal | grep File | cut -d, -f2 | cut -do -f1 > mdtestrm.datB" >> mdtest.pbs echo "paste mdtest.datA mdtestrm.datB > mdtest.filerm" >> mdtest.pbs echo "aprun -n 4 -N 1 hostname > mdtest-compute-nodes" >> mdtest.pbs cat -n mdtest.pbs MYJOBID=`qsub mdtest.pbs` echo MYJOBID=$MYJOBID ~arnoldg/ior/wait_for.sh $MYJOBID echo "=== JOB RAN ON ===" cat ~/scratch/mdtest/mdtest-compute-nodes if [ -f ~/scratch/mdtest/mdtest-compute-nodes ] then : # it's all good else echo "mdtest-compute-nodes not found, pbs job likely hit walltime" exit 1 fi cd ~/scratch/mdtest cat -n myout rm -f ~/scratch/mdtest/mdtest-compute-nodes [SSH] executing... mkdir: cannot create directory `mdtest-jenkins': File exists === RUNNING /u/staff/arnoldg/ior/myenv.sh === HOST=jyc1 HOME=/u/system/bwjenkins SCRATCH=/u/system/bwjenkins/scratch ls SCRATCH: mdtest setsm_benchmark SPP-PPM stripe8 sw_config sw_workdir test.log tests my id: uid=49294(bwjenkins) gid=16228(BW_System) groups=16228(BW_System),999(login_user),1000(ie_user),1001(hpss_user),1009(swtools),16237(jnd) Currently Loaded Modulefiles: 1) modules/3.2.10.5 2) nodestat/2.2-1.0502.60539.1.31.gem 3) sdb/1.1-1.0502.63652.4.27.gem 4) alps/5.2.4-2.0502.9774.31.12.gem 5) lustre-cray_gem_s/2.5_3.0.101_0.46.1_1.0502.8871.45.1-1.0502.21728.75.4 6) udreg/2.3.2-1.0502.10518.2.17.gem 7) ugni/6.0-1.0502.10863.8.28.gem 8) gni-headers/4.0-1.0502.10859.9.27.gem 9) dmapp/7.0.1-1.0502.11080.8.74.gem 10) xpmem/0.1-2.0502.64982.7.27.gem 11) hss-llm/7.2.0 12) Base-opts/1.0.2-1.0502.60680.2.4.gem 13) cce/8.7.7 14) craype-network-gemini 15) craype/2.5.16 16) cray-libsci/18.12.1 17) pmi/5.0.11 18) rca/1.0.0-2.0502.60530.1.63.gem 19) atp/2.1.0 20) PrgEnv-cray/5.2.82 21) moab/9.1.2.h6-sles11 22) torque/6.1.2 23) craype-interlagos 24) cray-mpich/7.7.4 25) openssh/7.5p1 26) xalt/0.7.6.local 27) scripts 28) OpenSSL/1.0.2m 29) cURL/7.59.0 30) git/2.17.0 31) wget/1.19.4 32) user-paths 33) gnuplot/5.0.5 34) darshan/3.1.3-longusername Cloning into 'mdtest'... cc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm INFO: Job submitted to account: jnc 1 #!/bin/bash 2 #PBS -lnodes=4:ppn=6:xe,walltime=00:15:00 -Nmdtest 3 cd ~/scratch 4 rm -rf mdtest 5 mkdir mdtest 6 cd mdtest 7 aprun -n 24 ~/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d ~/scratch/mdtest > myout 8 grep ops myout | grep read | cut -d, -f2 | cut -do -f1 > mdtest.datB 9 echo YVALUE= > mdtest.datA 10 paste mdtest.datA mdtest.datB > mdtest.read 11 grep ops myout | grep removal | grep File | cut -d, -f2 | cut -do -f1 > mdtestrm.datB 12 paste mdtest.datA mdtestrm.datB > mdtest.filerm 13 aprun -n 4 -N 1 hostname > mdtest-compute-nodes MYJOBID=596786.jyc === RUNNING /u/staff/arnoldg/ior/wait_for.sh === Wed Nov 24 23:07:10 CST 2021: waiting for 596786.jyc to finish Wed Nov 24 23:12:10 CST 2021: waiting for 596786.jyc to finish qstat: Unknown Job Id Error 596786.nid00030 596786.jyc finished === JOB RAN ON === nid00063 nid00061 nid00060 nid00062 Application 1103644 resources: utime ~0s, stime ~4s, Rss ~21112, inblocks ~76, outblocks ~112 1 -- started at 11/24/2021 23:07:28 -- 2 3 mdtest-1.9.4-rc1 was launched with 24 total task(s) on 4 node(s) 4 Command line used: /u/system/bwjenkins/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d /u/system/bwjenkins/scratch/mdtest 5 V-1: Entering parse_dirpath... 6 V-1: main: Setting create/stat/read/remove_only to True 7 V-1: Entering valid_tests... 8 barriers : True 9 collective_creates : False 10 create_only : True 11 dirpath(s): 12 /u/system/bwjenkins/scratch/mdtest 13 dirs_only : True 14 read_bytes : 0 15 read_only : True 16 first : 1 17 files_only : True 18 iterations : 1 19 items_per_dir : 0 20 last : 0 21 leaf_only : False 22 items : 2000 23 nstride : 0 24 pre_delay : 0 25 remove_only : False 26 random_seed : 0 27 stride : 1 28 shared_file : False 29 time_unique_dir_overhead: False 30 stat_only : True 31 unique_dir_per_task : False 32 write_bytes : 0 33 sync_file : False 34 depth : 0 35 V-1: Entering display_freespace... 36 V-1: Entering show_file_system_size... 37 Path: /mnt/abc/scratch/system/bwjenkins 38 FS: 112.9 TiB Used FS: 51.6% Inodes: 119.2 Mi Used Inodes: 46.8% 39 40 24 tasks, 48000 files/directories 41 42 Operation Duration Rate 43 --------- -------- ---- 44 V-1: Entering timestamp... 45 V-1: main: * iteration 1 11/24/2021 23:07:28 * 46 V-1: Entering create_remove_directory_tree, currDepth = 0... 47 V-1: Entering create_remove_directory_tree, currDepth = 1... 48 V-1: main: Tree creation : 0.001 sec, 1610.098 ops/sec 49 V-1: Entering directory_test... 50 V-1: Entering create_remove_items, currDepth = 0... 51 V-1: Entering create_remove_items_helper... 52 V-1: Entering mdtest_stat... 53 V-1: Entering create_remove_items, currDepth = 0... 54 V-1: Entering create_remove_items_helper... 55 V-1: Directory creation: 3.066 sec, 15654.785 ops/sec 56 V-1: Directory stat : 1.639 sec, 29285.457 ops/sec 57 V-1: Directory removal : 3.015 sec, 15921.649 ops/sec 58 V-1: Entering file_test... 59 V-1: Entering create_remove_items, currDepth = 0... 60 V-1: Entering create_remove_items_helper... 61 V-1: Entering mdtest_stat... 62 V-1: Entering mdtest_read... 63 V-1: mdtest_read path = /u/system/bwjenkins/scratch/mdtest/#test-dir.0/mdtest_tree.0 64 V-1: Entering create_remove_items, currDepth = 0... 65 V-1: Entering create_remove_items_helper... 66 V-1: File creation : 3.279 sec, 14636.609 ops/sec 67 V-1: File stat : 1.893 sec, 25360.354 ops/sec 68 V-1: File read : 3.045 sec, 15764.117 ops/sec 69 V-1: File removal : 3.376 sec, 14219.778 ops/sec 70 V-1: Entering create_remove_directory_tree, currDepth = 0... 71 V-1: Entering create_remove_directory_tree, currDepth = 1... 72 V-1: main Tree removal : 0.003 sec, 287.439 ops/sec 73 V-1: Entering summarize_results... 74 75 SUMMARY: (of 1 iterations) 76 Operation Max Min Mean Std Dev 77 --------- --- --- ---- ------- 78 Directory creation: 15654.827 15654.827 15654.827 0.000 79 Directory stat : 29285.525 29285.525 29285.525 0.000 80 Directory removal : 15921.798 15921.798 15921.798 0.000 81 File creation : 14636.641 14636.641 14636.641 0.000 82 File stat : 25360.421 25360.421 25360.421 0.000 83 File read : 15764.127 15764.127 15764.127 0.000 84 File removal : 14219.778 14219.778 14219.778 0.000 85 Tree creation : 1610.098 1610.098 1610.098 0.000 86 Tree removal : 287.439 287.439 287.439 0.000 87 V-1: Entering timestamp... 88 89 -- finished at 11/24/2021 23:07:47 -- 90 Application 1103643 resources: utime ~11s, stime ~45s, Rss ~21108, inblocks ~32851, outblocks ~81432 [SSH] completed [SSH] exit-status: 0 [workspace] $ /bin/sh -xe /tmp/jenkins6050396245285252339.sh + scp 'JYC_REMOTE:~/scratch/mdtest/m*' /var/lib/jenkins/jobs/mdtest-jyc/workspace Recording plot data Saving plot series data from: /var/lib/jenkins/jobs/mdtest-jyc/workspace/mdtest.read Saving plot series data from: /var/lib/jenkins/jobs/mdtest-jyc/workspace/mdtest.filerm Finished: SUCCESS