![[Jenkins]](/static/755cd4af/images/svgs/logo.svg){kind=logo}
Started by timer Running as SYSTEM Building in workspace /var/lib/jenkins/jobs/mdtest-jyc/workspace [SSH] script: ~arnoldg/ior/myenv.sh mkdir mdtest-jenkins cd mdtest-jenkins rm -rf * git clone https://github.com/MDTEST-LANL/mdtest cd mdtest/old make CC=cc mv * .. cd .. echo "#!/bin/bash" > mdtest.pbs echo "#PBS -lnodes=4:ppn=6:xe,walltime=00:15:00 -Nmdtest" >> mdtest.pbs echo "cd ~/scratch" >> mdtest.pbs echo "rm -rf mdtest" >> mdtest.pbs echo "mkdir mdtest" >> mdtest.pbs echo "cd mdtest" >> mdtest.pbs echo "aprun -n 24 ~/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d ~/scratch/mdtest > myout" >> mdtest.pbs echo "grep ops myout | grep read | cut -d, -f2 | cut -do -f1 > mdtest.datB" >> mdtest.pbs echo "echo YVALUE= > mdtest.datA" >> mdtest.pbs echo "paste mdtest.datA mdtest.datB > mdtest.read" >> mdtest.pbs echo "grep ops myout | grep removal | grep File | cut -d, -f2 | cut -do -f1 > mdtestrm.datB" >> mdtest.pbs echo "paste mdtest.datA mdtestrm.datB > mdtest.filerm" >> mdtest.pbs echo "aprun -n 4 -N 1 hostname > mdtest-compute-nodes" >> mdtest.pbs cat -n mdtest.pbs MYJOBID=`qsub mdtest.pbs` echo MYJOBID=$MYJOBID ~arnoldg/ior/wait_for.sh $MYJOBID echo "=== JOB RAN ON ===" cat ~/scratch/mdtest/mdtest-compute-nodes if [ -f ~/scratch/mdtest/mdtest-compute-nodes ] then : # it's all good else echo "mdtest-compute-nodes not found, pbs job likely hit walltime" exit 1 fi cd ~/scratch/mdtest cat -n myout rm -f ~/scratch/mdtest/mdtest-compute-nodes [SSH] executing... mkdir: cannot create directory `mdtest-jenkins': File exists === RUNNING /u/staff/arnoldg/ior/myenv.sh === HOST=jyc1 HOME=/u/system/bwjenkins SCRATCH=/u/system/bwjenkins/scratch ls SCRATCH: mdtest setsm_benchmark SPP-PPM stripe8 sw_config sw_workdir test.log tests my id: uid=49294(bwjenkins) gid=16228(BW_System) groups=16228(BW_System),999(login_user),1000(ie_user),1001(hpss_user),1009(swtools),16237(jnd) Currently Loaded Modulefiles: 1) modules/3.2.10.5 2) nodestat/2.2-1.0502.60539.1.31.gem 3) sdb/1.1-1.0502.63652.4.27.gem 4) alps/5.2.4-2.0502.9774.31.12.gem 5) lustre-cray_gem_s/2.5_3.0.101_0.46.1_1.0502.8871.45.1-1.0502.21728.75.4 6) udreg/2.3.2-1.0502.10518.2.17.gem 7) ugni/6.0-1.0502.10863.8.28.gem 8) gni-headers/4.0-1.0502.10859.9.27.gem 9) dmapp/7.0.1-1.0502.11080.8.74.gem 10) xpmem/0.1-2.0502.64982.7.27.gem 11) hss-llm/7.2.0 12) Base-opts/1.0.2-1.0502.60680.2.4.gem 13) cce/8.7.7 14) craype-network-gemini 15) craype/2.5.16 16) cray-libsci/18.12.1 17) pmi/5.0.11 18) rca/1.0.0-2.0502.60530.1.63.gem 19) atp/2.1.0 20) PrgEnv-cray/5.2.82 21) moab/9.1.2.h6-sles11 22) torque/6.1.2 23) craype-interlagos 24) cray-mpich/7.7.4 25) openssh/7.5p1 26) xalt/0.7.6.local 27) scripts 28) OpenSSL/1.0.2m 29) cURL/7.59.0 30) git/2.17.0 31) wget/1.19.4 32) user-paths 33) gnuplot/5.0.5 34) darshan/3.1.3-longusername Cloning into 'mdtest'... cc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 1 #!/bin/bash 2 #PBS -lnodes=4:ppn=6:xe,walltime=00:15:00 -Nmdtest 3 cd ~/scratch 4 rm -rf mdtest 5 mkdir mdtest 6 cd mdtest 7 aprun -n 24 ~/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d ~/scratch/mdtest > myout 8 grep ops myout | grep read | cut -d, -f2 | cut -do -f1 > mdtest.datB 9 echo YVALUE= > mdtest.datA 10 paste mdtest.datA mdtest.datB > mdtest.read 11 grep ops myout | grep removal | grep File | cut -d, -f2 | cut -do -f1 > mdtestrm.datB 12 paste mdtest.datA mdtestrm.datB > mdtest.filerm 13 aprun -n 4 -N 1 hostname > mdtest-compute-nodes INFO: Job submitted to account: jnc MYJOBID=597937.jyc === RUNNING /u/staff/arnoldg/ior/wait_for.sh === Wed Dec 8 23:07:09 CST 2021: waiting for 597937.jyc to finish Wed Dec 8 23:12:09 CST 2021: waiting for 597937.jyc to finish qstat: Unknown Job Id Error 597937.nid00030 597937.jyc finished === JOB RAN ON === nid00061 nid00063 nid00060 nid00062 Application 1108145 resources: utime ~0s, stime ~4s, Rss ~28952, inblocks ~76, outblocks ~112 1 -- started at 12/08/2021 23:07:32 -- 2 3 mdtest-1.9.4-rc1 was launched with 24 total task(s) on 4 node(s) 4 Command line used: /u/system/bwjenkins/mdtest-jenkins/mdtest/mdtest -n 2000 -v -d /u/system/bwjenkins/scratch/mdtest 5 V-1: Entering parse_dirpath... 6 V-1: main: Setting create/stat/read/remove_only to True 7 V-1: Entering valid_tests... 8 barriers : True 9 collective_creates : False 10 create_only : True 11 dirpath(s): 12 /u/system/bwjenkins/scratch/mdtest 13 dirs_only : True 14 read_bytes : 0 15 read_only : True 16 first : 1 17 files_only : True 18 iterations : 1 19 items_per_dir : 0 20 last : 0 21 leaf_only : False 22 items : 2000 23 nstride : 0 24 pre_delay : 0 25 remove_only : False 26 random_seed : 0 27 stride : 1 28 shared_file : False 29 time_unique_dir_overhead: False 30 stat_only : True 31 unique_dir_per_task : False 32 write_bytes : 0 33 sync_file : False 34 depth : 0 35 V-1: Entering display_freespace... 36 V-1: Entering show_file_system_size... 37 Path: /mnt/abc/scratch/system/bwjenkins 38 FS: 112.9 TiB Used FS: 51.6% Inodes: 119.2 Mi Used Inodes: 46.9% 39 40 24 tasks, 48000 files/directories 41 42 Operation Duration Rate 43 --------- -------- ---- 44 V-1: Entering timestamp... 45 V-1: main: * iteration 1 12/08/2021 23:07:32 * 46 V-1: Entering create_remove_directory_tree, currDepth = 0... 47 V-1: Entering create_remove_directory_tree, currDepth = 1... 48 V-1: main: Tree creation : 0.001 sec, 1548.285 ops/sec 49 V-1: Entering directory_test... 50 V-1: Entering create_remove_items, currDepth = 0... 51 V-1: Entering create_remove_items_helper... 52 V-1: Entering mdtest_stat... 53 V-1: Entering create_remove_items, currDepth = 0... 54 V-1: Entering create_remove_items_helper... 55 V-1: Directory creation: 8.008 sec, 5993.967 ops/sec 56 V-1: Directory stat : 1.674 sec, 28667.396 ops/sec 57 V-1: Directory removal : 2.883 sec, 16649.717 ops/sec 58 V-1: Entering file_test... 59 V-1: Entering create_remove_items, currDepth = 0... 60 V-1: Entering create_remove_items_helper... 61 V-1: Entering mdtest_stat... 62 V-1: Entering mdtest_read... 63 V-1: mdtest_read path = /u/system/bwjenkins/scratch/mdtest/#test-dir.0/mdtest_tree.0 64 V-1: Entering create_remove_items, currDepth = 0... 65 V-1: Entering create_remove_items_helper... 66 V-1: File creation : 3.382 sec, 14191.699 ops/sec 67 V-1: File stat : 1.918 sec, 25028.182 ops/sec 68 V-1: File read : 1.707 sec, 28121.075 ops/sec 69 V-1: File removal : 3.284 sec, 14617.817 ops/sec 70 V-1: Entering create_remove_directory_tree, currDepth = 0... 71 V-1: Entering create_remove_directory_tree, currDepth = 1... 72 V-1: main Tree removal : 0.002 sec, 419.263 ops/sec 73 V-1: Entering summarize_results... 74 75 SUMMARY: (of 1 iterations) 76 Operation Max Min Mean Std Dev 77 --------- --- --- ---- ------- 78 Directory creation: 5993.973 5993.973 5993.973 0.000 79 Directory stat : 28667.449 28667.449 28667.449 0.000 80 Directory removal : 16649.751 16649.751 16649.751 0.000 81 File creation : 14191.724 14191.724 14191.724 0.000 82 File stat : 25028.262 25028.262 25028.262 0.000 83 File read : 28121.122 28121.122 28121.122 0.000 84 File removal : 14617.817 14617.817 14617.817 0.000 85 Tree creation : 1548.285 1548.285 1548.285 0.000 86 Tree removal : 419.263 419.263 419.263 0.000 87 V-1: Entering timestamp... 88 89 -- finished at 12/08/2021 23:07:54 -- 90 Application 1108144 resources: utime ~13s, stime ~46s, Rss ~28952, inblocks ~32839, outblocks ~81426 [SSH] completed [SSH] exit-status: 0 [workspace] $ /bin/sh -xe /tmp/jenkins16123528693077353251.sh + scp 'JYC_REMOTE:~/scratch/mdtest/m*' /var/lib/jenkins/jobs/mdtest-jyc/workspace Recording plot data Saving plot series data from: /var/lib/jenkins/jobs/mdtest-jyc/workspace/mdtest.read Saving plot series data from: /var/lib/jenkins/jobs/mdtest-jyc/workspace/mdtest.filerm Finished: SUCCESS