Trace number 4305933

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
macht 2018.07.27? (TO) 2519.96 2520.01

General information on the benchmark

NameSubisomorphism/
Subisomorphism-g29-g50_c18.xml
MD5SUM6b43bee46cd3f7faf4796c0903a8d917
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints996
Number of domains1
Minimum domain size128
Maximum domain size128
Distribution of domain sizes[{"size":128,"count":100}]
Minimum variable degree11
Maximum variable degree33
Distribution of variable degrees[{"degree":11,"count":1},{"degree":12,"count":2},{"degree":13,"count":4},{"degree":14,"count":4},{"degree":16,"count":2},{"degree":17,"count":7},{"degree":18,"count":10},{"degree":19,"count":11},{"degree":20,"count":17},{"degree":21,"count":14},{"degree":22,"count":6},{"degree":23,"count":4},{"degree":24,"count":7},{"degree":25,"count":3},{"degree":26,"count":5},{"degree":27,"count":2},{"degree":33,"count":1}]
Minimum constraint arity1
Maximum constraint arity100
Distribution of constraint arities[{"arity":1,"count":89},{"arity":2,"count":906},{"arity":100,"count":1}]
Number of extensional constraints995
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":995},{"type":"allDifferent","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Version 18.07.27

Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10317 MiB free)
  memory of node 1: 16384 MiB (6562 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4305933-1534103650/watcher-4305933-1534103650 -o /tmp/evaluation-result-4305933-1534103650/solver-4305933-1534103650 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534099320-3289 --watchdog 2580 macht 2520 HOME/instance-4305933-1534103650.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=4998, runsolver pid=4995
Current StackSize limit: 8192 KiB


[startup+0.100171 s]*
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17260704/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=59116 memory=28756 CPUtime=0.1 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 7360 0 0 0 10 0 0 0 20 0 1 0 227928139 60534784 7189 33554432000 4194304 36388816 140734065775312 140734065775312 7657110 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 14779 7189 445 7860 0 6884 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 59116 KiB
Current children cumulated memory: 28756 KiB

[startup+0.20968 s]*
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17232060/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=87760 memory=57532 CPUtime=0.21 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 14527 0 0 0 20 1 0 0 20 0 1 0 227928139 89866240 14383 33554432000 4194304 36388816 140734065775312 140734065775312 7657110 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 21940 14383 445 7860 0 14045 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 87760 KiB
Current children cumulated memory: 57532 KiB

[startup+0.309661 s]*
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17206052/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=114028 memory=83668 CPUtime=0.31 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 21083 0 0 0 29 2 0 0 20 0 1 0 227928139 116764672 20917 33554432000 4194304 36388816 140734065775312 140734065769720 7657110 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 28507 20917 445 7860 0 20612 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 114028 KiB
Current children cumulated memory: 83668 KiB

[startup+0.700386 s]
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17153648/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=213028 memory=182668 CPUtime=0.69 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 45859 0 0 0 64 5 0 0 20 0 1 0 227928139 218140672 45667 33554432000 4194304 36388816 140734065775312 140734065769720 7657110 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 53257 45667 445 7860 0 45362 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 213028 KiB
Current children cumulated memory: 182668 KiB

[startup+1.50041 s]
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17034608/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=299056 memory=268476 CPUtime=1.49 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 67373 0 0 0 141 8 0 0 20 0 1 0 227928139 306233344 67119 33554432000 4194304 36388816 140734065775312 140734065772504 4587675 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 74764 67119 475 7860 0 66869 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 299056 KiB
Current children cumulated memory: 268476 KiB

[startup+3.1096 s]
/proc/loadavg: 1.99 2.21 2.10 3/188 4999
/proc/meminfo: memFree=17010676/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=309804 memory=276648 CPUtime=3.1 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 132908 0 0 0 299 11 0 0 20 0 1 0 227928139 317239296 69162 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 77451 69162 478 7860 0 69556 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 309804 KiB
Current children cumulated memory: 276648 KiB

[startup+6.30039 s]
/proc/loadavg: 1.91 2.19 2.10 3/188 4999
/proc/meminfo: memFree=17009660/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=310604 memory=277156 CPUtime=6.29 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 195717 0 0 0 615 14 0 0 20 0 1 0 227928139 318058496 69289 33554432000 4194304 36388816 140734065775312 140734065773512 4585103 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 77651 69289 478 7860 0 69756 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 310604 KiB
Current children cumulated memory: 277156 KiB

[startup+12.7004 s]
/proc/loadavg: 1.92 2.18 2.10 3/188 4999
/proc/meminfo: memFree=17009356/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=311884 memory=278092 CPUtime=12.69 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 261771 0 0 0 1252 17 0 0 20 0 1 0 227928139 319369216 69523 33554432000 4194304 36388816 140734065775312 140734065773512 4574962 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 77971 69523 487 7860 0 70076 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 311884 KiB
Current children cumulated memory: 278092 KiB

[startup+25.5004 s]
/proc/loadavg: 1.94 2.17 2.10 3/188 4999
/proc/meminfo: memFree=17008544/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=312044 memory=278152 CPUtime=25.49 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 325308 0 0 0 2529 20 0 0 20 0 1 0 227928139 319533056 69538 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78011 69538 487 7860 0 70116 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 312044 KiB
Current children cumulated memory: 278152 KiB

[startup+51.1096 s]
/proc/loadavg: 1.96 2.16 2.09 3/188 4999
/proc/meminfo: memFree=17008524/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=312204 memory=278376 CPUtime=51.09 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 387556 0 0 0 5083 26 0 0 20 0 1 0 227928139 319696896 69594 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78051 69594 487 7860 0 70156 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 312204 KiB
Current children cumulated memory: 278376 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.14 2.09 3/187 5001
/proc/meminfo: memFree=17008344/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=312684 memory=278736 CPUtime=102.25 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 475242 0 0 0 10191 34 0 0 20 0 1 0 227928139 320188416 69684 33554432000 4194304 36388816 140734065775312 140734065773512 8047687 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78171 69684 487 7860 0 70276 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 312684 KiB
Current children cumulated memory: 278736 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.11 2.08 3/187 5002
/proc/meminfo: memFree=17009084/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=312684 memory=278760 CPUtime=162.22 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 490500 0 0 0 16182 40 0 0 20 0 1 0 227928139 320188416 69690 33554432000 4194304 36388816 140734065775312 140734065773512 4420269 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78171 69690 487 7860 0 70276 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 312684 KiB
Current children cumulated memory: 278760 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.09 2.08 3/187 5003
/proc/meminfo: memFree=17006512/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=312844 memory=281460 CPUtime=222.21 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 493309 0 0 0 22176 45 0 0 20 0 1 0 227928139 320352256 70365 33554432000 4194304 36388816 140734065775312 140734065773512 4584978 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78211 70365 487 7860 0 70316 0
Current children cumulated CPU time: 222.21 s
Current children cumulated vsize: 312844 KiB
Current children cumulated memory: 281460 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.07 2.07 3/187 5005
/proc/meminfo: memFree=17006100/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=313324 memory=281720 CPUtime=282.22 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 494202 0 0 0 28172 50 0 0 20 0 1 0 227928139 320843776 70430 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78331 70430 487 7860 0 70436 0
Current children cumulated CPU time: 282.22 s
Current children cumulated vsize: 313324 KiB
Current children cumulated memory: 281720 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/187 5006
/proc/meminfo: memFree=17006072/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=313324 memory=281880 CPUtime=342.22 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 495086 0 0 0 34168 54 0 0 20 0 1 0 227928139 320843776 70470 33554432000 4194304 36388816 140734065775312 140734065773512 4585088 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78331 70470 487 7860 0 70436 0
Current children cumulated CPU time: 342.22 s
Current children cumulated vsize: 313324 KiB
Current children cumulated memory: 281880 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 5015
/proc/meminfo: memFree=17005052/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=314444 memory=282872 CPUtime=402.22 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 496398 0 0 0 40162 60 0 0 20 0 1 0 227928139 321990656 70718 33554432000 4194304 36388816 140734065775312 140734065773512 4587380 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78611 70718 487 7860 0 70716 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 314444 KiB
Current children cumulated memory: 282872 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/190 5040
/proc/meminfo: memFree=17002104/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=314764 memory=284316 CPUtime=462.22 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 497254 0 0 0 46157 65 0 0 20 0 1 0 227928139 322318336 71079 33554432000 4194304 36388816 140734065775312 140734065773512 4585076 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78691 71079 487 7860 0 70796 0
Current children cumulated CPU time: 462.22 s
Current children cumulated vsize: 314764 KiB
Current children cumulated memory: 284316 KiB


################
# More data... #
################

/proc/4998/statm: 78939 71391 488 7860 0 71044 0
Current children cumulated CPU time: 1722.24 s
Current children cumulated vsize: 315756 KiB
Current children cumulated memory: 285564 KiB

[startup+1782.3 s]
/proc/loadavg: 2.02 2.01 2.05 3/189 5140
/proc/meminfo: memFree=17014056/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=315756 memory=285588 CPUtime=1782.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 506008 0 0 0 178061 163 0 0 20 0 1 0 227928139 323334144 71397 33554432000 4194304 36388816 140734065775312 140734065773512 8047687 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 78939 71397 488 7860 0 71044 0
Current children cumulated CPU time: 1782.24 s
Current children cumulated vsize: 315756 KiB
Current children cumulated memory: 285588 KiB

[startup+1842.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/189 5141
/proc/meminfo: memFree=17014236/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=1842.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 506402 0 0 0 184056 168 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585076 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5143
/proc/meminfo: memFree=17014652/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=1902.23 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 506676 0 0 0 190051 172 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585088 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 1902.23 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5144
/proc/meminfo: memFree=17014596/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=1962.23 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 506950 0 0 0 196047 176 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 8047687 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5145
/proc/meminfo: memFree=17014444/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2022.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 507303 0 0 0 202044 180 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4587452 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2022.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2082.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/187 5147
/proc/meminfo: memFree=17013524/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2082.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 507590 0 0 0 208041 183 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 8047687 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/187 5148
/proc/meminfo: memFree=17013780/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2142.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 507867 0 0 0 214037 187 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4574936 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/189 5158
/proc/meminfo: memFree=17013612/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2202.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 508224 0 0 0 220033 191 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2202.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 5159
/proc/meminfo: memFree=17013800/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2262.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 508496 0 0 0 226029 195 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2262.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 5160
/proc/meminfo: memFree=17013372/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2322.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 508765 0 0 0 232025 199 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2322.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 5161
/proc/meminfo: memFree=17013888/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2382.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 509028 0 0 0 238020 204 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2382.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 5162
/proc/meminfo: memFree=17014208/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285760 CPUtime=2442.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 509376 0 0 0 244016 208 0 0 20 0 1 0 227928139 323661824 71440 33554432000 4194304 36388816 140734065775312 140734065773512 4585103 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71440 488 7860 0 71124 0
Current children cumulated CPU time: 2442.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285760 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 5163
/proc/meminfo: memFree=17014272/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285784 CPUtime=2502.24 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 509654 0 0 0 250011 213 0 0 20 0 1 0 227928139 323661824 71446 33554432000 4194304 36388816 140734065775312 140734065773512 4420521 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71446 488 7860 0 71124 0
Current children cumulated CPU time: 2502.24 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285784 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 5163
/proc/meminfo: memFree=17014276/32770624 swapFree=67108844/67108860
[pid=4998] ppid=4995 vsize=316076 memory=285784 CPUtime=2519.95 cores=1,3,5,7
/proc/4998/stat : 4998 (macht) R 4995 4998 3257 0 -1 4202496 509724 0 0 0 251780 215 0 0 20 0 1 0 227928139 323661824 71446 33554432000 4194304 36388816 140734065775312 140734065773512 4585099 0 0 4096 0 0 0 0 17 3 0 0 0 0 0 38489992 38625312 60456960 140734065779899 140734065779977 140734065779977 140734065782735 0
/proc/4998/statm: 79019 71446 488 7860 0 71124 0
Current children cumulated CPU time: 2519.95 s
Current children cumulated vsize: 316076 KiB
Current children cumulated memory: 285784 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 4998 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2517.81 s, system=2.15303 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2520.01
CPU time (s): 2519.96
CPU user time (s): 2517.81
CPU system time (s): 2.15303
CPU usage (%): 99.9981
Max. virtual memory (cumulated for all children) (KiB): 316076
Max. memory (cumulated for all children) (KiB): 285784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2517.81
system time used= 2.15303
maximum resident set size= 285784
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 509724
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 120
involuntary context switches= 824


# summary of solver processes directly reported to runsolver:
#   pid: 4998
#   total CPU time (s): 2519.96
#   total CPU user time (s): 2517.81
#   total CPU system time (s): 2.15303

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.80903 second user time and 19.2238 second system time

The end

Launcher Data 

Begin job on node136 at 2018-08-12 21:54:10
IDJOB=4305933
IDBENCH=141503
IDSOLVER=2784
FILE ID=node136/4305933-1534103650
RUNJOBID= node136-1534099320-3289
PBS_JOBID= 21037005
Free space on /tmp= 35488 MiB

SOLVER NAME= macht 2018.07.27
BENCH NAME= XCSP18/Subisomorphism/Subisomorphism-g29-g50_c18.xml
COMMAND LINE= macht TIMELIMIT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4305933-1534103650/watcher-4305933-1534103650 -o /tmp/evaluation-result-4305933-1534103650/solver-4305933-1534103650 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node136-1534099320-3289 --watchdog 2580  macht 2520 HOME/instance-4305933-1534103650.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6b43bee46cd3f7faf4796c0903a8d917
RANDOM SEED=1135841093

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        17285936 kB
MemAvailable:   31888236 kB
Buffers:          230872 kB
Cached:         14480872 kB
SwapCached:            8 kB
Active:          7277780 kB
Inactive:        7504588 kB
Active(anon):      21100 kB
Inactive(anon):   102012 kB
Active(file):    7256680 kB
Inactive(file):  7402576 kB
Unevictable:        7296 kB
Mlocked:            7296 kB
SwapTotal:      67108860 kB
SwapFree:       67108844 kB
Dirty:             52384 kB
Writeback:             0 kB
AnonPages:         84128 kB
Mapped:            54464 kB
Shmem:             49788 kB
Slab:             399668 kB
SReclaimable:     371504 kB
SUnreclaim:        28164 kB
KernelStack:        3376 kB
PageTables:         5448 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     394140 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     26624 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 35436 MiB
End job on node136 at 2018-08-12 22:36:10