Trace number 4408922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1369.72 1371.44

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-032-009.xml
MD5SUM60cee350f909e875fed1272f4ca3f397
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark7.23234
Satisfiable
(Un)Satisfiability was proved
Number of variables321
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size31
Distribution of domain sizes[{"size":2,"count":320},{"size":31,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":320},{"degree":46,"count":1}]
Minimum constraint arity32
Maximum constraint arity320
Distribution of constraint arities[{"arity":32,"count":10},{"arity":65,"count":45},{"arity":320,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (12916 MiB free)
  memory of node 1: 16384 MiB (15479 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408922-1569794600/watcher-4408922-1569794600 -o /tmp/evaluation-result-4408922-1569794600/solver-4408922-1569794600 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1569787352-8874 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408922-1569794600.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=10146, runsolver pid=10143
Current StackSize limit: 8192 KiB


[startup+0.100153 s]*
/proc/loadavg: 2.07 2.09 2.00 3/206 10147
/proc/meminfo: memFree=29074340/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=28740 memory=5008 CPUtime=0.1 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 1455 0 0 0 10 0 0 0 20 0 1 0 555699423 29429760 1252 33554432000 4194304 6211132 140722365579904 140722365576440 139914773740517 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 7185 1252 845 493 0 490 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28740 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209665 s]*
/proc/loadavg: 2.07 2.09 2.00 3/206 10147
/proc/meminfo: memFree=29071736/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=29856 memory=6328 CPUtime=0.21 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 1770 0 0 0 21 0 0 0 20 0 1 0 555699423 30572544 1582 33554432000 4194304 6211132 140722365579904 140722365576440 139914773740517 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 7464 1582 846 493 0 769 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29856 KiB
Current children cumulated memory: 6328 KiB

[startup+0.309264 s]*
/proc/loadavg: 2.07 2.09 2.00 3/206 10147
/proc/meminfo: memFree=29069700/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=31084 memory=7384 CPUtime=0.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2055 0 0 0 31 0 0 0 20 0 1 0 555699423 31830016 1846 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 7771 1846 846 493 0 1076 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31084 KiB
Current children cumulated memory: 7384 KiB

[startup+0.70028 s]
/proc/loadavg: 2.07 2.09 2.00 3/206 10147
/proc/meminfo: memFree=29065236/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=35516 memory=11956 CPUtime=0.69 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3156 0 0 0 69 0 0 0 20 0 1 0 555699423 36368384 2989 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 8879 2989 846 493 0 2184 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35516 KiB
Current children cumulated memory: 11956 KiB

[startup+1.50028 s]
/proc/loadavg: 2.07 2.09 2.00 4/206 10147
/proc/meminfo: memFree=29051284/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=44704 memory=21088 CPUtime=1.49 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 5456 0 0 0 149 0 0 0 20 0 1 0 555699423 45776896 5272 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 11176 5272 846 493 0 4481 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 44704 KiB
Current children cumulated memory: 21088 KiB

[startup+3.10957 s]
/proc/loadavg: 2.07 2.09 2.00 4/205 10147
/proc/meminfo: memFree=29005528/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=63332 memory=39396 CPUtime=3.09 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 10115 0 0 0 309 0 0 0 20 0 1 0 555699423 64851968 9849 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 15833 9849 846 493 0 9138 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 63332 KiB
Current children cumulated memory: 39396 KiB

[startup+6.30028 s]
/proc/loadavg: 2.07 2.09 2.00 4/205 10147
/proc/meminfo: memFree=28933992/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=100724 memory=76196 CPUtime=6.28 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 19323 0 0 0 626 2 0 0 20 0 1 0 555699423 103141376 19049 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 25181 19049 846 493 0 18486 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 100724 KiB
Current children cumulated memory: 76196 KiB

[startup+12.7003 s]
/proc/loadavg: 1.98 2.07 2.00 4/205 10147
/proc/meminfo: memFree=28793608/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=176348 memory=149520 CPUtime=12.68 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 37744 0 0 0 1264 4 0 0 20 0 1 0 555699423 180580352 37380 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 44087 37380 846 493 0 37392 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 176348 KiB
Current children cumulated memory: 149520 KiB

[startup+25.5003 s]
/proc/loadavg: 1.98 2.06 2.00 4/204 10148
/proc/meminfo: memFree=28483952/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=321404 memory=296912 CPUtime=25.48 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 73720 0 0 0 2539 9 0 0 20 0 1 0 555699423 329117696 74228 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 80351 74228 846 493 0 73656 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 321404 KiB
Current children cumulated memory: 296912 KiB

[startup+51.1095 s]
/proc/loadavg: 1.99 2.06 2.00 4/204 10150
/proc/meminfo: memFree=27866420/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=620604 memory=591424 CPUtime=51.09 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 144866 0 0 0 5091 18 0 0 20 0 1 0 555699423 635498496 147856 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 155151 147856 846 493 0 148456 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 620604 KiB
Current children cumulated memory: 591424 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.05 2.00 4/204 10154
/proc/meminfo: memFree=26658372/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=1223220 memory=1179640 CPUtime=102.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 286301 0 0 0 10191 38 0 0 20 0 1 0 555699423 1252577280 294910 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 305805 294910 846 493 0 299110 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1223220 KiB
Current children cumulated memory: 1179640 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.00 4/203 10159
/proc/meminfo: memFree=25236896/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=1918580 memory=1869156 CPUtime=162.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 451553 0 0 0 16170 59 0 0 20 0 1 0 555699423 1964625920 467289 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 479645 467289 846 493 0 472950 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1918580 KiB
Current children cumulated memory: 1869156 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.03 2.00 4/204 10165
/proc/meminfo: memFree=23814472/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=2633300 memory=2558436 CPUtime=222.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 616780 0 0 0 22151 78 0 0 20 0 1 0 555699423 2696499200 639609 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 658325 639609 846 493 0 651630 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 2633300 KiB
Current children cumulated memory: 2558436 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.00 4/203 10169
/proc/meminfo: memFree=22393228/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=3291188 memory=3247848 CPUtime=282.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 781564 0 0 0 28129 100 0 0 20 0 1 0 555699423 3370176512 811962 33554432000 4194304 6211132 140722365579904 140722365561304 5446638 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 822797 811962 846 493 0 816102 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 3291188 KiB
Current children cumulated memory: 3247848 KiB

[startup+342.3 s]
/proc/loadavg: 2.93 2.26 2.08 4/203 10174
/proc/meminfo: memFree=20972480/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=4033164 memory=3935700 CPUtime=342.3 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 946521 0 0 0 34105 125 0 0 20 0 1 0 555699423 4129959936 983925 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 1008291 983925 846 493 0 1001596 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 4033164 KiB
Current children cumulated memory: 3935700 KiB

[startup+402.3 s]
/proc/loadavg: 2.44 2.25 2.09 4/204 10180
/proc/meminfo: memFree=19551108/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=4690656 memory=4624352 CPUtime=402.3 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 1111197 0 0 0 40082 148 0 0 20 0 1 0 555699423 4803231744 1156088 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 1172664 1156088 846 493 0 1165969 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 4690656 KiB
Current children cumulated memory: 4624352 KiB

[startup+462.3 s]
/proc/loadavg: 2.16 2.21 2.08 4/204 10194
/proc/meminfo: memFree=18128564/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=5350176 memory=5313216 CPUtime=462.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 1275928 0 0 0 46057 172 0 0 20 0 1 0 555699423 5478580224 1328304 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 1337544 1328304 846 493 0 1330849 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 5350176 KiB
Current children cumulated memory: 5313216 KiB


################
# More data... #
################

Current children cumulated vsize: 8950188 KiB
Current children cumulated memory: 8756736 KiB

[startup+822.3 s]
/proc/loadavg: 2.00 2.06 2.05 4/203 10223
/proc/meminfo: memFree=9609208/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=9606624 memory=9443844 CPUtime=822.3 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2264533 0 0 0 81894 336 0 0 20 0 1 0 555699423 9837182976 2360961 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 2401656 2360961 846 493 0 2394961 0
Current children cumulated CPU time: 822.3 s
Current children cumulated vsize: 9606624 KiB
Current children cumulated memory: 9443844 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.05 2.05 4/203 10227
/proc/meminfo: memFree=8192660/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=10268052 memory=10129996 CPUtime=882.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2429169 0 0 0 87863 368 0 0 20 0 1 0 555699423 10514485248 2532499 33554432000 4194304 6211132 140722365579904 140722365561304 5451604 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 2567013 2532499 846 493 0 2560318 0
Current children cumulated CPU time: 882.31 s
Current children cumulated vsize: 10268052 KiB
Current children cumulated memory: 10129996 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.04 2.05 4/204 10233
/proc/meminfo: memFree=6769296/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=10925016 memory=10820996 CPUtime=942.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2593972 0 0 0 93832 399 0 0 20 0 1 0 555699423 11187216384 2705249 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 2731254 2705249 846 493 0 2724559 0
Current children cumulated CPU time: 942.31 s
Current children cumulated vsize: 10925016 KiB
Current children cumulated memory: 10820996 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.04 2.05 4/203 10237
/proc/meminfo: memFree=5350928/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=11581452 memory=11506132 CPUtime=1002.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2758447 0 0 0 99801 430 0 0 20 0 1 0 555699423 11859406848 2876533 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 2895363 2876533 846 493 0 2888668 0
Current children cumulated CPU time: 1002.31 s
Current children cumulated vsize: 11581452 KiB
Current children cumulated memory: 11506132 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.03 2.05 4/204 10249
/proc/meminfo: memFree=3933336/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=12237756 memory=12193012 CPUtime=1062.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 2922805 0 0 0 105768 463 0 0 20 0 1 0 555699423 12531462144 3048253 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3059439 3048253 846 493 0 3052744 0
Current children cumulated CPU time: 1062.31 s
Current children cumulated vsize: 12237756 KiB
Current children cumulated memory: 12193012 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.02 2.05 4/205 10256
/proc/meminfo: memFree=2513744/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=13174208 memory=12882520 CPUtime=1122.32 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3087804 0 0 0 111735 497 0 0 20 0 1 0 555699423 13490388992 3220630 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3293552 3220630 846 493 0 3286857 0
Current children cumulated CPU time: 1122.32 s
Current children cumulated vsize: 13174208 KiB
Current children cumulated memory: 12882520 KiB

[startup+1182.3 s]
/proc/loadavg: 2.32 2.08 2.07 3/206 10323
/proc/meminfo: memFree=16641068/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=13836748 memory=13567048 CPUtime=1182.31 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3252065 0 0 0 117701 530 0 0 20 0 1 0 555699423 14168829952 3391762 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3459187 3391762 846 493 0 3452492 0
Current children cumulated CPU time: 1182.31 s
Current children cumulated vsize: 13836748 KiB
Current children cumulated memory: 13567048 KiB

[startup+1242.3 s]
/proc/loadavg: 2.07 2.05 2.06 3/205 10390
/proc/meminfo: memFree=16316108/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=14492392 memory=14255744 CPUtime=1242.29 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3416356 0 0 0 123666 563 0 0 20 0 1 0 555699423 14840209408 3563936 33554432000 4194304 6211132 140722365579904 140722365561304 5451560 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3623098 3563936 846 493 0 3616403 0
Current children cumulated CPU time: 1242.29 s
Current children cumulated vsize: 14492392 KiB
Current children cumulated memory: 14255744 KiB

[startup+1302.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/207 10397
/proc/meminfo: memFree=15627724/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15148168 memory=14942400 CPUtime=1302.26 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3580577 0 0 0 129629 597 0 0 20 0 1 0 555699423 15511724032 3735600 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3787042 3735600 846 493 0 3780347 0
Current children cumulated CPU time: 1302.26 s
Current children cumulated vsize: 15148168 KiB
Current children cumulated memory: 14942400 KiB

[startup+1362.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/205 10402
/proc/meminfo: memFree=14941116/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15803944 memory=15628792 CPUtime=1362.24 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3744817 0 0 0 135591 633 0 0 20 0 1 0 555699423 16183238656 3907198 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3950986 3907198 846 493 0 3944291 0
Current children cumulated CPU time: 1362.24 s
Current children cumulated vsize: 15803944 KiB
Current children cumulated memory: 15628792 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1368.6 s]
/proc/loadavg: 2.16 2.07 2.06 3/205 10402
/proc/meminfo: memFree=14871468/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15872848 memory=15701828 CPUtime=1368.54 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 4202496 3762096 0 0 0 136217 637 0 0 20 0 1 0 555699423 16253796352 3925457 33554432000 4194304 6211132 140722365579904 140722365561304 139914773740517 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3968212 3925457 846 493 0 3961517 0
Current children cumulated CPU time: 1368.54 s
Current children cumulated vsize: 15872848 KiB
Current children cumulated memory: 15701828 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1371.44 s]
# the end of solver process 10146 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1362.45 s, system=7.26653 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1369.6 s]
/proc/loadavg: 2.16 2.07 2.06 3/206 10403
/proc/meminfo: memFree=14633356/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15872848 memory=15701828 CPUtime=1368.7 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 512 3762101 0 0 0 136231 639 0 0 20 0 1 0 555699423 16253796352 3925457 33554432000 4194304 6211132 140722365579904 140722365561304 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3968212 3925457 846 493 0 3961517 0
Current children cumulated CPU time: 1368.7 s
Current children cumulated vsize: 15872848 KiB
Current children cumulated memory: 15701828 KiB

[startup+1370.4 s]
/proc/loadavg: 2.16 2.07 2.06 3/206 10403
/proc/meminfo: memFree=14050292/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15872848 memory=15701828 CPUtime=1368.83 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) S 10143 10146 8842 0 -1 512 3762101 0 0 0 136242 641 0 0 20 0 1 0 555699423 16253796352 3925457 33554432000 4194304 6211132 140722365579904 140722365561304 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3968212 3925457 846 493 0 3961517 0
Current children cumulated CPU time: 1368.83 s
Current children cumulated vsize: 15872848 KiB
Current children cumulated memory: 15701828 KiB

[startup+1370.6 s]
/proc/loadavg: 2.16 2.07 2.06 3/206 10403
/proc/meminfo: memFree=14050292/32770624 swapFree=67003180/67108860
[pid=10146] ppid=10143 vsize=15872848 memory=15701828 CPUtime=1368.87 cores=1,3,5,7
/proc/10146/stat : 10146 (cosoco) R 10143 10146 8842 0 -1 512 3762101 0 0 0 136245 642 0 0 20 0 1 0 555699423 16253796352 3925457 33554432000 4194304 6211132 140722365579904 140722365561304 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 8400896 140722365588491 140722365588593 140722365588593 140722365591502 0
/proc/10146/statm: 3968212 3925457 846 493 0 3961517 0
Current children cumulated CPU time: 1368.87 s
Current children cumulated vsize: 15872848 KiB
Current children cumulated memory: 15701828 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1371.44
CPU time (s): 1369.72
CPU user time (s): 1362.45
CPU system time (s): 7.26653
CPU usage (%): 99.8745
Max. virtual memory (cumulated for all children) (KiB): 15872848
Max. memory (cumulated for all children) (KiB): 15701828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1362.45
system time used= 7.26653
maximum resident set size= 15701920
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3762101
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 144000
involuntary context switches= 1820


# summary of solver processes directly reported to runsolver:
#   pid: 10146
#   total CPU time (s): 1369.72
#   total CPU user time (s): 1362.45
#   total CPU system time (s): 7.26653

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.09108 second user time and 9.11995 second system time

The end

Launcher Data 

Begin job on node133 at 2019-09-30 00:02:39
IDJOB=4408922
IDBENCH=123000
IDSOLVER=2876
FILE ID=node133/4408922-1569794600
RUNJOBID= node133-1569787352-8874
PBS_JOBID= 21705825
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-032-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408922-1569794600/watcher-4408922-1569794600 -o /tmp/evaluation-result-4408922-1569794600/solver-4408922-1569794600 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1569787352-8874 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408922-1569794600.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 60cee350f909e875fed1272f4ca3f397
RANDOM SEED=1835128528

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29077304 kB
MemAvailable:   30378152 kB
Buffers:          222264 kB
Cached:          1410372 kB
SwapCached:         4964 kB
Active:          2346984 kB
Inactive:         779276 kB
Active(anon):    1504968 kB
Inactive(anon):    68868 kB
Active(file):     842016 kB
Inactive(file):   710408 kB
Unevictable:      107984 kB
Mlocked:          107984 kB
SwapTotal:      67108860 kB
SwapFree:       67003180 kB
Dirty:              2756 kB
Writeback:             0 kB
AnonPages:       1604576 kB
Mapped:            28424 kB
Shmem:             71596 kB
Slab:             158528 kB
SReclaimable:     128520 kB
SUnreclaim:        30008 kB
KernelStack:        3632 kB
PageTables:         8612 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2060844 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    167936 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61464 MiB
End job on node133 at 2019-09-30 00:25:30