Trace number 4082082

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NaPS 1.02? (TO) 1800.07 1800.41

General information on the benchmark

Name/DEC-SMALLINT-LIN/oliveras/j120/
normalized-j12039_7-sat.opb
MD5SUM0f318fc75cd8d877b44870fe2fa76e77
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables25410
Total number of constraints83992
Number of constraints which are clauses83576
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints416
Minimum length of a constraint1
Maximum length of a constraint120
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 49
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 732
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.
1800.06/1800.40	c 
1800.06/1800.40	c *** TERMINATED *** by signal 15
1800.06/1800.40	s UNKNOWN
1800.06/1800.40	c _____________________________________________________________________________
1800.06/1800.40	c 
1800.06/1800.40	c std/band forms        : 351,0
1800.06/1800.40	c 2cl/3cl ITE-codings   : 265649,0
1800.06/1800.40	c BDD/srt/adr Max costs : 1532,0,0
1800.06/1800.40	c BDDraw/bin/mul/srt/adr: 196,0,155,0,0
1800.06/1800.40	c BDD nodes             : 322397
1800.06/1800.40	c Es1/CC detections     : 0,0
1800.06/1800.40	c SAT/UNSAT calls       : 0,0
1800.06/1800.40	c restarts              : 0
1800.06/1800.40	c conflicts             : 0              (0 /sec)
1800.06/1800.40	c decisions             : 0              (0 /sec)
1800.06/1800.40	c propagations          : 0              (0 /sec)
1800.06/1800.40	c inspects              : 0              (0 /sec)
1800.06/1800.40	c CPU time (solving tm) : 1800 s        (0 s)
1800.06/1800.40	c Time for Opt-base     : 0.06999 s
1800.06/1800.40	c _____________________________________________________________________________

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4082082-1465257132/watcher-4082082-1465257132 -o /tmp/evaluation-result-4082082-1465257132/solver-4082082-1465257132 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node138-1465244211-28760 --watchdog 1960 naps-1.02 HOME/instance-4082082-1465257132.opb 

pid=350
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.07 2.04 2.01 3/176 353
/proc/meminfo: memFree=31074788/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=6416 CPUtime=0 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 280 0 0 0 0 0 0 0 20 0 1 0 107645809 6569984 154 33554432000 4194304 5796924 140733431291056 140734332071992 5095032 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 1604 154 128 392 0 1203 0

[startup+0.100157 s]
/proc/loadavg: 2.07 2.04 2.01 3/176 353
/proc/meminfo: memFree=31074788/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=9888 CPUtime=0.09 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 1178 0 0 0 9 0 0 0 20 0 1 0 107645809 10125312 1038 33554432000 4194304 5796924 140733431291056 140734332071992 4600717 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 2472 1038 128 392 0 2071 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9888

[startup+0.200303 s]
/proc/loadavg: 2.07 2.04 2.01 3/176 353
/proc/meminfo: memFree=31074788/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=11952 CPUtime=0.19 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 1704 0 0 0 19 0 0 0 20 0 1 0 107645809 12238848 1503 33554432000 4194304 5796924 140733431291056 140734332071992 5183584 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 2988 1503 128 392 0 2587 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 11952

[startup+0.300294 s]
/proc/loadavg: 2.07 2.04 2.01 3/176 353
/proc/meminfo: memFree=31074788/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=12496 CPUtime=0.29 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 1850 0 0 0 29 0 0 0 20 0 1 0 107645809 12795904 1637 33554432000 4194304 5796924 140733431291056 140734332071992 5183584 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 3124 1637 128 392 0 2723 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12496

[startup+0.700262 s]
/proc/loadavg: 2.07 2.04 2.01 3/176 353
/proc/meminfo: memFree=31074788/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=18776 CPUtime=0.68 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 3505 0 0 0 68 0 0 0 20 0 1 0 107645809 19226624 3173 33554432000 4194304 5796924 140733431291056 140733431290392 4404063 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 4694 3173 128 392 0 4293 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 18776

[startup+1.50029 s]
/proc/loadavg: 2.07 2.04 2.01 3/177 354
/proc/meminfo: memFree=31058668/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=25416 CPUtime=1.48 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 5648 0 0 0 148 0 0 0 20 0 1 0 107645809 26025984 4787 33554432000 4194304 5796924 140733431291056 140733431290392 5092509 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 6354 4787 144 392 0 5953 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 25416

[startup+3.10023 s]
/proc/loadavg: 2.07 2.04 2.01 3/177 354
/proc/meminfo: memFree=31051412/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=34740 CPUtime=3.09 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 7533 0 0 0 308 1 0 0 20 0 1 0 107645809 35573760 7035 33554432000 4194304 5796924 140733431291056 140733431266408 4199773 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 8685 7035 144 392 0 8284 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 34740

[startup+6.30032 s]
/proc/loadavg: 2.07 2.04 2.01 4/177 354
/proc/meminfo: memFree=30861520/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=263740 CPUtime=6.29 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 50365 0 0 0 619 10 0 0 20 0 1 0 107645809 270069760 59633 33554432000 4194304 5796924 140733431291056 140733431288024 4623838 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 65935 59633 153 392 0 65534 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 263740

[startup+12.7003 s]
/proc/loadavg: 2.06 2.04 2.01 3/177 354
/proc/meminfo: memFree=30843108/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=254576 CPUtime=12.69 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 51394 0 0 0 1258 11 0 0 20 0 1 0 107645809 260685824 57028 33554432000 4194304 5796924 140733431291056 140733431288168 4607766 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 63644 57028 159 392 0 63243 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 254576

[startup+25.5004 s]
/proc/loadavg: 2.05 2.03 2.01 3/177 354
/proc/meminfo: memFree=30834808/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=268676 CPUtime=25.48 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 52469 0 0 0 2537 11 0 0 20 0 1 0 107645809 275124224 58625 33554432000 4194304 5796924 140733431291056 140733431288168 4569014 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 67169 58625 169 392 0 66768 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 268676

[startup+51.1004 s]
/proc/loadavg: 2.03 2.03 2.01 3/177 354
/proc/meminfo: memFree=30817140/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=269924 CPUtime=51.06 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 52812 0 0 0 5095 11 0 0 20 0 1 0 107645809 276402176 60959 33554432000 4194304 5796924 140733431291056 140733431288168 4606433 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 67481 60959 170 392 0 67080 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 269924

[startup+102.3 s]
/proc/loadavg: 2.05 2.04 2.01 3/177 355
/proc/meminfo: memFree=30836956/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=272036 CPUtime=102.23 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 54168 0 0 0 10211 12 0 0 20 0 1 0 107645809 278564864 61488 33554432000 4194304 5796924 140733431291056 140733431288168 4606503 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 68009 61488 170 392 0 67608 0
Current children cumulated CPU time (s) 102.23
Current children cumulated vsize (KiB) 272036

[startup+162.3 s]
/proc/loadavg: 2.08 2.04 2.01 3/177 356
/proc/meminfo: memFree=30784744/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=304736 CPUtime=162.21 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 55965 0 0 0 16207 14 0 0 20 0 1 0 107645809 312049664 69280 33554432000 4194304 5796924 140733431291056 140733431288520 4607776 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 76184 69280 170 392 0 75783 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 304736

[startup+222.308 s]
/proc/loadavg: 2.11 2.06 2.01 3/177 362
/proc/meminfo: memFree=30764228/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=222.21 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 56719 0 0 0 22206 15 0 0 20 0 1 0 107645809 362553344 79732 33554432000 4194304 5796924 140733431291056 140733431288344 4606744 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 79732 170 392 0 88113 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 354056

[startup+282.3 s]
/proc/loadavg: 2.15 2.08 2.02 3/177 363
/proc/meminfo: memFree=30744056/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=282.2 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 56975 0 0 0 28204 16 0 0 20 0 1 0 107645809 362553344 79738 33554432000 4194304 5796924 140733431291056 140733431288344 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 79738 170 392 0 88113 0
Current children cumulated CPU time (s) 282.2
Current children cumulated vsize (KiB) 354056

[startup+342.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/177 364
/proc/meminfo: memFree=30752372/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=342.18 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 57228 0 0 0 34202 16 0 0 20 0 1 0 107645809 362553344 79228 33554432000 4194304 5796924 140733431291056 140733431288344 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 79228 170 392 0 88113 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 354056

[startup+402.3 s]
/proc/loadavg: 2.17 2.09 2.02 3/177 365
/proc/meminfo: memFree=30760876/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=304736 CPUtime=402.18 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 57234 0 0 0 40201 17 0 0 20 0 1 0 107645809 312049664 71315 33554432000 4194304 5796924 140733431291056 140733431288520 4606555 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 76184 71315 170 392 0 75783 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 304736

[startup+462.3 s]
/proc/loadavg: 2.06 2.07 2.02 3/177 366
/proc/meminfo: memFree=30702916/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=462.17 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 57487 0 0 0 46200 17 0 0 20 0 1 0 107645809 362553344 81277 33554432000 4194304 5796924 140733431291056 140733431288344 4606555 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 81277 170 392 0 88113 0
Current children cumulated CPU time (s) 462.17
Current children cumulated vsize (KiB) 354056

[startup+522.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/178 371
/proc/meminfo: memFree=30733832/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=522.16 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 57738 0 0 0 52198 18 0 0 20 0 1 0 107645809 362553344 79741 33554432000 4194304 5796924 140733431291056 140733431288344 4606531 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 79741 170 392 0 88113 0
Current children cumulated CPU time (s) 522.16
Current children cumulated vsize (KiB) 354056

[startup+582.3 s]
/proc/loadavg: 2.02 2.06 2.01 3/178 395
/proc/meminfo: memFree=30701040/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=582.15 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 57744 0 0 0 58197 18 0 0 20 0 1 0 107645809 362553344 82813 33554432000 4194304 5796924 140733431291056 140733431288344 4606555 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 82813 170 392 0 88113 0
Current children cumulated CPU time (s) 582.15
Current children cumulated vsize (KiB) 354056


################
# More data... #
################


[startup+882.307 s]
/proc/loadavg: 2.04 2.07 2.02 4/177 817
/proc/meminfo: memFree=30403548/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=882.1 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 58882 0 0 0 88189 21 0 0 20 0 1 0 107645809 362553344 80769 33554432000 4194304 5796924 140733431291056 140733431288344 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 80769 170 392 0 88113 0
Current children cumulated CPU time (s) 882.1
Current children cumulated vsize (KiB) 354056

[startup+942.3 s]
/proc/loadavg: 2.01 2.06 2.01 3/177 818
/proc/meminfo: memFree=30388632/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=942.09 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 58887 0 0 0 94187 22 0 0 20 0 1 0 107645809 362553344 83329 33554432000 4194304 5796924 140733431291056 140733431288344 4607192 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 83329 170 392 0 88113 0
Current children cumulated CPU time (s) 942.09
Current children cumulated vsize (KiB) 354056

[startup+1002.3 s]
/proc/loadavg: 2.14 2.08 2.02 3/177 819
/proc/meminfo: memFree=30429064/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=304736 CPUtime=1002.08 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 59254 0 0 0 100185 23 0 0 20 0 1 0 107645809 312049664 71319 33554432000 4194304 5796924 140733431291056 140733431288520 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 76184 71319 170 392 0 75783 0
Current children cumulated CPU time (s) 1002.08
Current children cumulated vsize (KiB) 304736

[startup+1062.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/177 820
/proc/meminfo: memFree=30383996/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1062.07 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 59509 0 0 0 106184 23 0 0 20 0 1 0 107645809 362553344 82305 33554432000 4194304 5796924 140733431291056 140733431288344 4606433 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 82305 170 392 0 88113 0
Current children cumulated CPU time (s) 1062.07
Current children cumulated vsize (KiB) 354056

[startup+1122.3 s]
/proc/loadavg: 2.02 2.05 2.00 3/178 825
/proc/meminfo: memFree=30337240/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1122.06 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 59876 0 0 0 112182 24 0 0 20 0 1 0 107645809 394113024 85224 33554432000 4194304 5796924 140733431291056 140733431288696 4593669 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 85224 170 392 0 95818 0
Current children cumulated CPU time (s) 1122.06
Current children cumulated vsize (KiB) 384876

[startup+1182.3 s]
/proc/loadavg: 2.07 2.05 2.00 3/177 826
/proc/meminfo: memFree=30357056/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1182.05 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 60128 0 0 0 118180 25 0 0 20 0 1 0 107645809 362553344 80257 33554432000 4194304 5796924 140733431291056 140733431288344 4594144 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 80257 170 392 0 88113 0
Current children cumulated CPU time (s) 1182.05
Current children cumulated vsize (KiB) 354056

[startup+1242.3 s]
/proc/loadavg: 2.16 2.08 2.01 3/178 828
/proc/meminfo: memFree=30344080/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1242.04 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 60134 0 0 0 124179 25 0 0 20 0 1 0 107645809 362553344 83329 33554432000 4194304 5796924 140733431291056 140733431288344 4606531 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 83329 170 392 0 88113 0
Current children cumulated CPU time (s) 1242.04
Current children cumulated vsize (KiB) 354056

[startup+1302.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/177 829
/proc/meminfo: memFree=30332828/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1302.04 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 60505 0 0 0 130178 26 0 0 20 0 1 0 107645809 394113024 86248 33554432000 4194304 5796924 140733431291056 140733431288696 4606721 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 86248 170 392 0 95818 0
Current children cumulated CPU time (s) 1302.04
Current children cumulated vsize (KiB) 384876

[startup+1362.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/177 830
/proc/meminfo: memFree=30384844/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1362.03 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 60759 0 0 0 136176 27 0 0 20 0 1 0 107645809 362553344 81281 33554432000 4194304 5796924 140733431291056 140733431288344 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 81281 170 392 0 88113 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 354056

[startup+1422.3 s]
/proc/loadavg: 2.09 2.07 2.01 3/177 832
/proc/meminfo: memFree=30327564/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1422.02 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 61025 0 0 0 142175 27 0 0 20 0 1 0 107645809 362553344 83589 33554432000 4194304 5796924 140733431291056 140733431288344 4607776 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 83589 170 392 0 88113 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 354056

[startup+1482.3 s]
/proc/loadavg: 2.03 2.05 2.00 3/177 833
/proc/meminfo: memFree=30322844/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1482 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 61132 0 0 0 148172 28 0 0 20 0 1 0 107645809 394113024 86248 33554432000 4194304 5796924 140733431291056 140733431288696 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 86248 170 392 0 95818 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 384876

[startup+1542.31 s]
/proc/loadavg: 2.05 2.05 2.00 3/177 834
/proc/meminfo: memFree=30355328/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1542.01 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 61386 0 0 0 154172 29 0 0 20 0 1 0 107645809 362553344 80769 33554432000 4194304 5796924 140733431291056 140733431288344 4606802 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 80769 170 392 0 88113 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 354056

[startup+1602.3 s]
/proc/loadavg: 2.09 2.06 2.00 3/177 835
/proc/meminfo: memFree=30372904/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1601.98 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 61756 0 0 0 160169 29 0 0 20 0 1 0 107645809 394113024 84200 33554432000 4194304 5796924 140733431291056 140733431288696 4569014 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 84200 170 392 0 95818 0
Current children cumulated CPU time (s) 1601.98
Current children cumulated vsize (KiB) 384876

[startup+1662.3 s]
/proc/loadavg: 2.09 2.06 2.00 3/177 836
/proc/meminfo: memFree=30314448/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1661.98 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 61762 0 0 0 166168 30 0 0 20 0 1 0 107645809 394113024 87272 33554432000 4194304 5796924 140733431291056 140733431288696 4606531 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 87272 170 392 0 95818 0
Current children cumulated CPU time (s) 1661.98
Current children cumulated vsize (KiB) 384876

[startup+1722.3 s]
/proc/loadavg: 2.07 2.06 2.00 3/178 841
/proc/meminfo: memFree=30388652/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1721.97 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 62016 0 0 0 172166 31 0 0 20 0 1 0 107645809 362553344 80257 33554432000 4194304 5796924 140733431291056 140733431288344 4606555 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 80257 170 392 0 88113 0
Current children cumulated CPU time (s) 1721.97
Current children cumulated vsize (KiB) 354056

[startup+1782.3 s]
/proc/loadavg: 2.15 2.08 2.01 3/177 842
/proc/meminfo: memFree=30328028/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=354056 CPUtime=1781.96 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 62022 0 0 0 178165 31 0 0 20 0 1 0 107645809 362553344 83329 33554432000 4194304 5796924 140733431291056 140733431288344 4606480 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 88514 83329 170 392 0 88113 0
Current children cumulated CPU time (s) 1781.96
Current children cumulated vsize (KiB) 354056



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.11 2.07 2.01 3/177 842
/proc/meminfo: memFree=30318164/32872528 swapFree=12328/568296
[pid=353] ppid=350 vsize=384876 CPUtime=1800.06 cores=1,3,5,7
/proc/353/stat : 353 (naps-1.02) R 350 353 28743 0 -1 4202496 62392 0 0 0 179974 32 0 0 20 0 1 0 107645809 394113024 84200 33554432000 4194304 5796924 140733431291056 140733431288696 4606507 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/353/statm: 96219 84200 170 392 0 95818 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 384876

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 353 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.41
CPU time (s): 1800.07
CPU user time (s): 1799.74
CPU system time (s): 0.329949
CPU usage (%): 99.9815
Max. virtual memory (cumulated for all children) (KiB): 384876

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.74
system time used= 0.329949
maximum resident set size= 355232
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 62404
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 66
involuntary context switches= 2032

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.79097 second user time and 9.56855 second system time

The end

Launcher Data 

Begin job on node138 at 2016-06-07 01:52:12
IDJOB=4082082
IDBENCH=74369
IDSOLVER=2544
FILE ID=node138/4082082-1465257132
RUNJOBID= node138-1465244211-28760
PBS_JOBID= 19843251
Free space on /tmp= 71740 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB10/normalized-PB10/DEC-SMALLINT-LIN/oliveras/j120/normalized-j12039_7-sat.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4082082-1465257132/watcher-4082082-1465257132 -o /tmp/evaluation-result-4082082-1465257132/solver-4082082-1465257132 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node138-1465244211-28760 --watchdog 1960  naps-1.02 HOME/instance-4082082-1465257132.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0f318fc75cd8d877b44870fe2fa76e77
RANDOM SEED=33727087

node138.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.807
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        31075340 kB
Buffers:           47840 kB
Cached:           147308 kB
SwapCached:        46756 kB
Active:           350932 kB
Inactive:         157120 kB
Active(anon):     267520 kB
Inactive(anon):    47636 kB
Active(file):      83412 kB
Inactive(file):   109484 kB
Unevictable:      568296 kB
Mlocked:           12328 kB
SwapTotal:      67108856 kB
SwapFree:       67053588 kB
Dirty:              6624 kB
Writeback:             0 kB
AnonPages:        956456 kB
Mapped:             8732 kB
Shmem:                 0 kB
Slab:             571428 kB
SReclaimable:      15160 kB
SUnreclaim:       556268 kB
KernelStack:        1472 kB
PageTables:         5560 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:     988544 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    909312 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71736 MiB
End job on node138 at 2016-06-07 02:22:13