Trace number 4389729

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2? (MO) 1532.2 1534.6

General information on the benchmark

NameOpd/Opd-sum-large/
Opd-16-035-010.xml
MD5SUM03e72fbe3dfec80e6807e25b52393289
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark3.72706
Satisfiable
(Un)Satisfiability was proved
Number of variables561
Number of constraints137
Number of domains2
Minimum domain size2
Maximum domain size33
Distribution of domain sizes[{"size":2,"count":560},{"size":33,"count":1}]
Minimum variable degree17
Maximum variable degree121
Distribution of variable degrees[{"degree":17,"count":560},{"degree":121,"count":1}]
Minimum constraint arity35
Maximum constraint arity560
Distribution of constraint arities[{"arity":35,"count":16},{"arity":71,"count":120},{"arity":560,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":136}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15110 MiB free)
  memory of node 1: 16384 MiB (15387 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389729-1568321816/watcher-4389729-1568321816 -o /tmp/evaluation-result-4389729-1568321816/solver-4389729-1568321816 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568311987-15586 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389729-1568321816.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=17422, runsolver pid=17419

[startup+0.100107 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31228648/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=28692 memory=5216 CPUtime=0.1 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 1471 0 0 0 10 0 0 0 20 0 1 0 408420334 29380608 1304 33554432000 4194304 6210612 140723060926656 140723060923192 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 7173 1304 845 493 0 478 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28692 KiB
Current children cumulated memory: 5216 KiB

[startup+0.209379 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31227532/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=29800 memory=6272 CPUtime=0.21 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 1750 0 0 0 21 0 0 0 20 0 1 0 408420334 30515200 1568 33554432000 4194304 6210612 140723060926656 140723060923192 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 7450 1568 845 493 0 755 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29800 KiB
Current children cumulated memory: 6272 KiB

[startup+0.308802 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31226416/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=30896 memory=7328 CPUtime=0.31 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2004 0 0 0 31 0 0 0 20 0 1 0 408420334 31637504 1832 33554432000 4194304 6210612 140723060926656 140723060923192 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 7724 1832 845 493 0 1029 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30896 KiB
Current children cumulated memory: 7328 KiB

[startup+0.70023 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31224328/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=34800 memory=11100 CPUtime=0.69 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2986 0 0 0 69 0 0 0 20 0 1 0 408420334 35635200 2775 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 8700 2775 845 493 0 2005 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 34800 KiB
Current children cumulated memory: 11100 KiB

[startup+1.50024 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31219352/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=43196 memory=19428 CPUtime=1.49 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 5038 0 0 0 149 0 0 0 20 0 1 0 408420334 44232704 4857 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 10799 4857 845 493 0 4104 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 43196 KiB
Current children cumulated memory: 19428 KiB

[startup+3.10934 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31198396/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=59972 memory=35828 CPUtime=3.1 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 9216 0 0 0 310 0 0 0 20 0 1 0 408420334 61411328 8957 33554432000 4194304 6210612 140723060926656 140723060906904 5451985 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 14993 8957 845 493 0 8298 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 59972 KiB
Current children cumulated memory: 35828 KiB

[startup+6.30023 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31167128/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=93656 memory=68712 CPUtime=6.29 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 17446 0 0 0 627 2 0 0 20 0 1 0 408420334 95903744 17178 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 23414 17178 845 493 0 16719 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 93656 KiB
Current children cumulated memory: 68712 KiB

[startup+12.7002 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=31105168/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=158516 memory=134768 CPUtime=12.69 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 33508 0 0 0 1265 4 0 0 20 0 1 0 408420334 162320384 33692 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 39629 33692 845 493 0 32934 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 158516 KiB
Current children cumulated memory: 134768 KiB

[startup+25.5002 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17423
/proc/meminfo: memFree=30971420/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=292020 memory=265832 CPUtime=25.48 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 65852 0 0 0 2540 8 0 0 20 0 1 0 408420334 299028480 66458 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 73005 66458 845 493 0 66310 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 292020 KiB
Current children cumulated memory: 265832 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17426
/proc/meminfo: memFree=30702308/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=561180 memory=530368 CPUtime=51.08 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 129486 0 0 0 5090 18 0 0 20 0 1 0 408420334 574648320 132592 33554432000 4194304 6210612 140723060926656 140723060906904 140239510571854 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 140295 132592 845 493 0 133600 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 561180 KiB
Current children cumulated memory: 530368 KiB

[startup+102.3 s]
/proc/loadavg: 1.92 2.00 2.04 3/199 17430
/proc/meminfo: memFree=30178800/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=1079212 memory=1054536 CPUtime=102.25 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 255472 0 0 0 10194 31 0 0 20 0 1 0 408420334 1105113088 263634 33554432000 4194304 6210612 140723060926656 140723060906904 5452063 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 269803 263634 845 493 0 263108 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 1079212 KiB
Current children cumulated memory: 1054536 KiB

[startup+162.3 s]
/proc/loadavg: 2.09 2.03 2.05 3/199 17435
/proc/meminfo: memFree=29560540/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=1728648 memory=1671352 CPUtime=162.22 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 403518 0 0 0 16174 48 0 0 20 0 1 0 408420334 1770135552 417838 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 432162 417838 845 493 0 425467 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 1728648 KiB
Current children cumulated memory: 1671352 KiB

[startup+222.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/199 17441
/proc/meminfo: memFree=28944088/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=2316636 memory=2285864 CPUtime=222.2 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 550518 0 0 0 22154 66 0 0 20 0 1 0 408420334 2372235264 571466 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 579159 571466 845 493 0 572464 0
Current children cumulated CPU time: 222.2 s
Current children cumulated vsize: 2316636 KiB
Current children cumulated memory: 2285864 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.03 2.05 3/199 17452
/proc/meminfo: memFree=28326240/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=2960080 memory=2902740 CPUtime=282.17 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 698078 0 0 0 28135 82 0 0 20 0 1 0 408420334 3031121920 725685 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 740020 725685 845 493 0 733325 0
Current children cumulated CPU time: 282.17 s
Current children cumulated vsize: 2960080 KiB
Current children cumulated memory: 2902740 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/200 17479
/proc/meminfo: memFree=27710076/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=3548304 memory=3517148 CPUtime=342.15 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 845117 0 0 0 34114 101 0 0 20 0 1 0 408420334 3633463296 879287 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 887076 879287 845 493 0 880381 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 3548304 KiB
Current children cumulated memory: 3517148 KiB

[startup+402.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/200 17485
/proc/meminfo: memFree=27093376/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=4218880 memory=4132892 CPUtime=402.13 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 992455 0 0 0 40095 118 0 0 20 0 1 0 408420334 4320133120 1033223 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 1054720 1033223 845 493 0 1048025 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 4218880 KiB
Current children cumulated memory: 4132892 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/200 17489
/proc/meminfo: memFree=26476236/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=4806544 memory=4749432 CPUtime=462.1 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 1139483 0 0 0 46072 138 0 0 20 0 1 0 408420334 4921901056 1187358 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 1201636 1187358 845 493 0 1194941 0
Current children cumulated CPU time: 462.1 s
Current children cumulated vsize: 4806544 KiB
Current children cumulated memory: 4749432 KiB


################
# More data... #
################

Current children cumulated vsize: 9820472 KiB
Current children cumulated memory: 9671640 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17600
/proc/meminfo: memFree=18139716/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=10407740 memory=10287708 CPUtime=1001.89 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2463734 0 0 0 99871 318 0 0 20 0 1 0 408420334 10657525760 2571927 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 2601935 2571927 845 493 0 2595240 0
Current children cumulated CPU time: 1001.89 s
Current children cumulated vsize: 10407740 KiB
Current children cumulated memory: 10287708 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17604
/proc/meminfo: memFree=16704280/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=10994876 memory=10901856 CPUtime=1061.86 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2610802 0 0 0 105845 341 0 0 20 0 1 0 408420334 11258753024 2725464 33554432000 4194304 6210612 140723060926656 140723060906904 140239501547441 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 2748719 2725464 845 493 0 2742024 0
Current children cumulated CPU time: 1061.86 s
Current children cumulated vsize: 10994876 KiB
Current children cumulated memory: 10901856 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17610
/proc/meminfo: memFree=15262304/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=11584172 memory=11520080 CPUtime=1121.84 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2757861 0 0 0 111820 364 0 0 20 0 1 0 408420334 11862192128 2880020 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 2896043 2880020 845 493 0 2889348 0
Current children cumulated CPU time: 1121.84 s
Current children cumulated vsize: 11584172 KiB
Current children cumulated memory: 11520080 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17614
/proc/meminfo: memFree=13827372/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=12171176 memory=12133640 CPUtime=1181.82 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 2904790 0 0 0 117792 390 0 0 20 0 1 0 408420334 12463284224 3033410 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3042794 3033410 845 493 0 3036099 0
Current children cumulated CPU time: 1181.82 s
Current children cumulated vsize: 12171176 KiB
Current children cumulated memory: 12133640 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17618
/proc/meminfo: memFree=12389320/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=13038592 memory=12749520 CPUtime=1241.8 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3052273 0 0 0 123763 417 0 0 20 0 1 0 408420334 13351518208 3187380 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3259648 3187380 845 493 0 3252953 0
Current children cumulated CPU time: 1241.8 s
Current children cumulated vsize: 13038592 KiB
Current children cumulated memory: 12749520 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17624
/proc/meminfo: memFree=10954036/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=13625728 memory=13363132 CPUtime=1301.78 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3199218 0 0 0 129737 441 0 0 20 0 1 0 408420334 13952745472 3340783 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3406432 3340783 845 493 0 3399737 0
Current children cumulated CPU time: 1301.78 s
Current children cumulated vsize: 13625728 KiB
Current children cumulated memory: 13363132 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17628
/proc/meminfo: memFree=9517116/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=14212600 memory=13978788 CPUtime=1361.75 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3346130 0 0 0 135708 467 0 0 20 0 1 0 408420334 14553702400 3494697 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3553150 3494697 845 493 0 3546455 0
Current children cumulated CPU time: 1361.75 s
Current children cumulated vsize: 14212600 KiB
Current children cumulated memory: 13978788 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 17632
/proc/meminfo: memFree=8081748/32770624 swapFree=66940144/67108860
[pid=17422] ppid=17419 vsize=14799736 memory=14592664 CPUtime=1421.71 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3493069 0 0 0 141678 493 0 0 20 0 1 0 408420334 15154929664 3648166 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3699934 3648166 845 493 0 3693239 0
Current children cumulated CPU time: 1421.71 s
Current children cumulated vsize: 14799736 KiB
Current children cumulated memory: 14592664 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 17646
/proc/meminfo: memFree=6643936/32770624 swapFree=66940148/67108860
[pid=17422] ppid=17419 vsize=15387004 memory=15208428 CPUtime=1481.68 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3640094 0 0 0 147649 519 0 0 20 0 1 0 408420334 15756292096 3802107 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3846751 3802107 845 493 0 3840056 0
Current children cumulated CPU time: 1481.68 s
Current children cumulated vsize: 15387004 KiB
Current children cumulated memory: 15208428 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1531.9 s]
/proc/loadavg: 1.96 2.00 2.04 3/200 17649
/proc/meminfo: memFree=5473352/32770624 swapFree=66940148/67108860
[pid=17422] ppid=17419 vsize=15872236 memory=15716312 CPUtime=1531.27 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) R 17419 17422 15554 0 -1 4202496 3761568 0 0 0 152585 542 0 0 20 0 1 0 408420334 16253169664 3929078 33554432000 4194304 6210612 140723060926656 140723060906904 140239500626917 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3968059 3929078 845 493 0 3961364 0
Current children cumulated CPU time: 1531.27 s
Current children cumulated vsize: 15872236 KiB
Current children cumulated memory: 15716312 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1534.6 s]
# the end of solver process 17422 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1526.06 s, system=6.14341 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1532.8 s]
/proc/loadavg: 1.96 2.00 2.04 2/201 17650
/proc/meminfo: memFree=5449760/32770624 swapFree=66940148/67108860
[pid=17422] ppid=17419 vsize=15872236 memory=15716312 CPUtime=1531.33 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) S 17419 17422 15554 0 -1 512 3761573 0 0 0 152591 542 0 0 20 0 1 0 408420334 16253169664 3929078 33554432000 4194304 6210612 140723060926656 140723060906904 5188952 0 16384 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3968059 3929078 845 493 0 3961364 0
Current children cumulated CPU time: 1531.33 s
Current children cumulated vsize: 15872236 KiB
Current children cumulated memory: 15716312 KiB

[startup+1533.6 s]
/proc/loadavg: 1.96 2.00 2.04 4/201 17650
/proc/meminfo: memFree=5057896/32770624 swapFree=66940156/67108860
[pid=17422] ppid=17419 vsize=15872236 memory=15716312 CPUtime=1531.45 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) S 17419 17422 15554 0 -1 512 3761573 0 0 0 152602 543 0 0 20 0 1 0 408420334 16253169664 3929078 33554432000 4194304 6210612 140723060926656 140723060906904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3968059 3929078 845 493 0 3961364 0
Current children cumulated CPU time: 1531.45 s
Current children cumulated vsize: 15872236 KiB
Current children cumulated memory: 15716312 KiB

[startup+1533.8 s]
/proc/loadavg: 1.96 2.00 2.04 4/201 17650
/proc/meminfo: memFree=5057896/32770624 swapFree=66940156/67108860
[pid=17422] ppid=17419 vsize=15872236 memory=15716312 CPUtime=1531.48 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) S 17419 17422 15554 0 -1 512 3761573 0 0 0 152604 544 0 0 20 0 1 0 408420334 16253169664 3929078 33554432000 4194304 6210612 140723060926656 140723060906904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3968059 3929078 845 493 0 3961364 0
Current children cumulated CPU time: 1531.48 s
Current children cumulated vsize: 15872236 KiB
Current children cumulated memory: 15716312 KiB

[startup+1533.9 s]
/proc/loadavg: 1.96 2.00 2.04 4/201 17650
/proc/meminfo: memFree=5057896/32770624 swapFree=66940156/67108860
[pid=17422] ppid=17419 vsize=15872236 memory=15716312 CPUtime=1531.49 cores=1,3,5,7
/proc/17422/stat : 17422 (cosoco) S 17419 17422 15554 0 -1 512 3761573 0 0 0 152605 544 0 0 20 0 1 0 408420334 16253169664 3929078 33554432000 4194304 6210612 140723060926656 140723060906904 5188952 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8308220 8313664 37310464 140723060933643 140723060933745 140723060933745 140723060936654 0
/proc/17422/statm: 3968059 3929078 845 493 0 3961364 0
Current children cumulated CPU time: 1531.49 s
Current children cumulated vsize: 15872236 KiB
Current children cumulated memory: 15716312 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1534.6
CPU time (s): 1532.2
CPU user time (s): 1526.06
CPU system time (s): 6.14341
CPU usage (%): 99.8436
Max. virtual memory (cumulated for all children) (KiB): 15872236
Max. memory (cumulated for all children) (KiB): 15716312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1526.06
system time used= 6.14342
maximum resident set size= 15716432
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3761573
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 101597
involuntary context switches= 2812


# summary of solver processes directly reported to runsolver:
#   pid: 17422
#   total CPU time (s): 1532.2
#   total CPU user time (s): 1526.06
#   total CPU system time (s): 6.14341

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.55084 second user time and 11.1906 second system time

The end

Launcher Data 

Begin job on node149 at 2019-09-12 22:56:19
IDJOB=4389729
IDBENCH=122947
IDSOLVER=2829
FILE ID=node149/4389729-1568321816
RUNJOBID= node149-1568311987-15586
PBS_JOBID= 21701127
Free space on /tmp= 57068 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Opd/Opd-sum-large/Opd-16-035-010.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389729-1568321816/watcher-4389729-1568321816 -o /tmp/evaluation-result-4389729-1568321816/solver-4389729-1568321816 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node149-1568311987-15586 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389729-1568321816.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 03e72fbe3dfec80e6807e25b52393289
RANDOM SEED=279902897

node149.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31230420 kB
MemAvailable:   31853268 kB
Buffers:          119272 kB
Cached:           802984 kB
SwapCached:        61236 kB
Active:           383752 kB
Inactive:         607496 kB
Active(anon):      37208 kB
Inactive(anon):    71652 kB
Active(file):     346544 kB
Inactive(file):   535844 kB
Unevictable:      111364 kB
Mlocked:          111364 kB
SwapTotal:      67108860 kB
SwapFree:       66940144 kB
Dirty:              2764 kB
Writeback:             0 kB
AnonPages:        121056 kB
Mapped:            44396 kB
Shmem:             31076 kB
Slab:             141380 kB
SReclaimable:     112592 kB
SUnreclaim:        28788 kB
KernelStack:        3472 kB
PageTables:         5560 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     535744 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     73728 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      144768 kB
DirectMap2M:    33400832 kB

Free space on /tmp at the end= 56672 MiB
End job on node149 at 2019-09-12 23:21:53