Trace number 4408405

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1306.69 1308.54

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-10-031-009.xml
MD5SUMc781bc55b7ee4c4bb57d86a03397642c
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark3.79055
Satisfiable
(Un)Satisfiability was proved
Number of variables311
Number of constraints56
Number of domains2
Minimum domain size2
Maximum domain size30
Distribution of domain sizes[{"size":2,"count":310},{"size":30,"count":1}]
Minimum variable degree11
Maximum variable degree46
Distribution of variable degrees[{"degree":11,"count":310},{"degree":46,"count":1}]
Minimum constraint arity31
Maximum constraint arity310
Distribution of constraint arities[{"arity":31,"count":10},{"arity":63,"count":45},{"arity":310,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":55}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10781 MiB free)
  memory of node 1: 16384 MiB (14982 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408405-1569791195/watcher-4408405-1569791195 -o /tmp/evaluation-result-4408405-1569791195/solver-4408405-1569791195 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1569787350-1893 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408405-1569791195.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=3023, runsolver pid=3020
Current StackSize limit: 8192 KiB


[startup+0.100157 s]*
/proc/loadavg: 2.00 2.02 2.03 3/200 3024
/proc/meminfo: memFree=26379840/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=28736 memory=5008 CPUtime=0.1 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 1463 0 0 0 10 0 0 0 20 0 1 0 555382025 29425664 1252 33554432000 4194304 6211132 140729915767216 140729915763752 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 7184 1252 845 493 0 489 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28736 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209707 s]*
/proc/loadavg: 2.00 2.02 2.03 3/200 3024
/proc/meminfo: memFree=26377608/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=30148 memory=6592 CPUtime=0.21 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 1811 0 0 0 21 0 0 0 20 0 1 0 555382025 30871552 1648 33554432000 4194304 6211132 140729915767216 140729915763752 5454192 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 7537 1648 846 493 0 842 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30148 KiB
Current children cumulated memory: 6592 KiB

[startup+0.309137 s]*
/proc/loadavg: 2.00 2.02 2.03 3/200 3024
/proc/meminfo: memFree=26375748/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=31288 memory=7720 CPUtime=0.31 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 2093 0 0 0 31 0 0 0 20 0 1 0 555382025 32038912 1930 33554432000 4194304 6211132 140729915767216 140729915763752 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 7822 1930 846 493 0 1127 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31288 KiB
Current children cumulated memory: 7720 KiB

[startup+0.700279 s]
/proc/loadavg: 2.00 2.02 2.03 3/200 3024
/proc/meminfo: memFree=26371620/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=35900 memory=12204 CPUtime=0.69 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3249 0 0 0 69 0 0 0 20 0 1 0 555382025 36761600 3051 33554432000 4194304 6211132 140729915767216 140729915749000 139945524902718 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 8975 3051 846 493 0 2280 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35900 KiB
Current children cumulated memory: 12204 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.02 2.03 3/200 3024
/proc/meminfo: memFree=26361952/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=45484 memory=21864 CPUtime=1.48 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 5658 0 0 0 148 0 0 0 20 0 1 0 555382025 46575616 5466 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 11371 5466 846 493 0 4676 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 45484 KiB
Current children cumulated memory: 21864 KiB

[startup+3.10943 s]
/proc/loadavg: 2.00 2.02 2.03 3/200 3025
/proc/meminfo: memFree=26322384/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=65032 memory=41228 CPUtime=3.1 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 10541 0 0 0 309 1 0 0 20 0 1 0 555382025 66592768 10307 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 16258 10307 846 493 0 9563 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 65032 KiB
Current children cumulated memory: 41228 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.02 2.03 3/200 3025
/proc/meminfo: memFree=26263524/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=104128 memory=79640 CPUtime=6.28 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 20184 0 0 0 626 2 0 0 20 0 1 0 555382025 106627072 19910 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 26032 19910 846 493 0 19337 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 104128 KiB
Current children cumulated memory: 79640 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.02 2.03 3/199 3025
/proc/meminfo: memFree=26145104/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=183084 memory=156688 CPUtime=12.69 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 39491 0 0 0 1264 5 0 0 20 0 1 0 555382025 187478016 39172 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 45771 39172 846 493 0 39076 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 183084 KiB
Current children cumulated memory: 156688 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.02 2.03 3/199 3025
/proc/meminfo: memFree=25889272/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=335124 memory=310608 CPUtime=25.48 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 77071 0 0 0 2539 9 0 0 20 0 1 0 555382025 343166976 77652 33554432000 4194304 6211132 140729915767216 140729915749000 139945524902718 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 83781 77652 846 493 0 77086 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 335124 KiB
Current children cumulated memory: 310608 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.03 3/199 3027
/proc/meminfo: memFree=25374356/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=647656 memory=620156 CPUtime=51.09 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 151913 0 0 0 5092 17 0 0 20 0 1 0 555382025 663199744 155039 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 161914 155039 846 493 0 155219 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 647656 KiB
Current children cumulated memory: 620156 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 3032
/proc/meminfo: memFree=24370812/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=1277068 memory=1235208 CPUtime=102.28 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 300054 0 0 0 10194 34 0 0 20 0 1 0 555382025 1307717632 308802 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 319267 308802 846 493 0 312572 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 1277068 KiB
Current children cumulated memory: 1235208 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/200 3036
/proc/meminfo: memFree=23191320/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=2004088 memory=1957656 CPUtime=162.27 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 473037 0 0 0 16170 57 0 0 20 0 1 0 555382025 2052186112 489414 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 501022 489414 846 493 0 494327 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 2004088 KiB
Current children cumulated memory: 1957656 KiB

[startup+222.3 s]
/proc/loadavg: 2.08 2.03 2.03 3/200 3042
/proc/meminfo: memFree=22012108/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=2749584 memory=2678560 CPUtime=222.27 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 646162 0 0 0 22151 76 0 0 20 0 1 0 555382025 2815574016 669640 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 687396 669640 846 493 0 680701 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2749584 KiB
Current children cumulated memory: 2678560 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.03 2.03 3/202 3055
/proc/meminfo: memFree=20829232/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=3440328 memory=3401240 CPUtime=282.27 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 818744 0 0 0 28131 96 0 0 20 0 1 0 555382025 3522895872 850310 33554432000 4194304 6211132 140729915767216 140729915749000 139945524902718 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 860082 850310 846 493 0 853387 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 3440328 KiB
Current children cumulated memory: 3401240 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.03 3/202 3059
/proc/meminfo: memFree=19647904/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=4212148 memory=4122724 CPUtime=342.26 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 992061 0 0 0 34109 117 0 0 20 0 1 0 555382025 4313239552 1030681 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 1053037 1030681 846 493 0 1046342 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 4212148 KiB
Current children cumulated memory: 4122724 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/201 3065
/proc/meminfo: memFree=18465768/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=4900792 memory=4844720 CPUtime=402.26 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 1164527 0 0 0 40085 141 0 0 20 0 1 0 555382025 5018411008 1211180 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 1225198 1211180 846 493 0 1218503 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 4900792 KiB
Current children cumulated memory: 4844720 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.03 3/201 3069
/proc/meminfo: memFree=17285520/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=5591860 memory=5565412 CPUtime=462.25 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 1337218 0 0 0 46060 165 0 0 20 0 1 0 555382025 5726064640 1391353 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 1397965 1391353 846 493 0 1391270 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 5591860 KiB
Current children cumulated memory: 5565412 KiB


################
# More data... #
################

Current children cumulated vsize: 9348424 KiB
Current children cumulated memory: 9172508 KiB

[startup+822.3 s]
/proc/loadavg: 2.11 2.05 2.05 3/199 3098
/proc/meminfo: memFree=10204432/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=10041268 memory=9892536 CPUtime=822.22 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 2372556 0 0 0 81896 326 0 0 20 0 1 0 555382025 10282258432 2473134 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 2510317 2473134 846 493 0 2503622 0
Current children cumulated CPU time: 822.22 s
Current children cumulated vsize: 10041268 KiB
Current children cumulated memory: 9892536 KiB

[startup+882.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/200 3110
/proc/meminfo: memFree=9023752/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=10729912 memory=10614440 CPUtime=882.22 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 2545103 0 0 0 87867 355 0 0 20 0 1 0 555382025 10987429888 2653610 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 2682478 2653610 846 493 0 2675783 0
Current children cumulated CPU time: 882.22 s
Current children cumulated vsize: 10729912 KiB
Current children cumulated memory: 10614440 KiB

[startup+942.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/200 3116
/proc/meminfo: memFree=7843616/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=11417764 memory=11335284 CPUtime=942.21 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 2717366 0 0 0 93836 385 0 0 20 0 1 0 555382025 11691790336 2833821 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 2854441 2833821 846 493 0 2847746 0
Current children cumulated CPU time: 942.21 s
Current children cumulated vsize: 11417764 KiB
Current children cumulated memory: 11335284 KiB

[startup+1002.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 3120
/proc/meminfo: memFree=6664300/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=12105352 memory=12056132 CPUtime=1002.21 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 2889628 0 0 0 99805 416 0 0 20 0 1 0 555382025 12395880448 3014033 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3026338 3014033 846 493 0 3019643 0
Current children cumulated CPU time: 1002.21 s
Current children cumulated vsize: 12105352 KiB
Current children cumulated memory: 12056132 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 3124
/proc/meminfo: memFree=5489064/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=13073220 memory=12774996 CPUtime=1062.2 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3062403 0 0 0 105773 447 0 0 20 0 1 0 555382025 13386977280 3193749 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3268305 3193749 846 493 0 3261610 0
Current children cumulated CPU time: 1062.2 s
Current children cumulated vsize: 13073220 KiB
Current children cumulated memory: 12774996 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 3130
/proc/meminfo: memFree=4308052/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=13768892 memory=13497200 CPUtime=1122.2 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3235015 0 0 0 111739 481 0 0 20 0 1 0 555382025 14099345408 3374300 33554432000 4194304 6211132 140729915767216 140729915749000 139945524902718 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3442223 3374300 846 493 0 3435528 0
Current children cumulated CPU time: 1122.2 s
Current children cumulated vsize: 13768892 KiB
Current children cumulated memory: 13497200 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 3135
/proc/meminfo: memFree=3129676/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=14457272 memory=14219100 CPUtime=1182.19 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3407521 0 0 0 117706 513 0 0 20 0 1 0 555382025 14804246528 3554775 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3614318 3554775 846 493 0 3607623 0
Current children cumulated CPU time: 1182.19 s
Current children cumulated vsize: 14457272 KiB
Current children cumulated memory: 14219100 KiB

[startup+1242.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/199 3139
/proc/meminfo: memFree=1947584/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=15145652 memory=14940476 CPUtime=1242.18 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3579949 0 0 0 123671 547 0 0 20 0 1 0 555382025 15509147648 3735119 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3786413 3735119 846 493 0 3779718 0
Current children cumulated CPU time: 1242.18 s
Current children cumulated vsize: 15145652 KiB
Current children cumulated memory: 14940476 KiB

[startup+1302.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 3145
/proc/meminfo: memFree=767596/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=15833768 memory=15661324 CPUtime=1302.18 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3752205 0 0 0 129634 584 0 0 20 0 1 0 555382025 16213778432 3915331 33554432000 4194304 6211132 140729915767216 140729915749000 139945524902718 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3958442 3915331 846 493 0 3951747 0
Current children cumulated CPU time: 1302.18 s
Current children cumulated vsize: 15833768 KiB
Current children cumulated memory: 15661324 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1305.7 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 3145
/proc/meminfo: memFree=708508/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=15872708 memory=15702528 CPUtime=1305.58 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) R 3020 3023 1861 0 -1 4202496 3761996 0 0 0 129972 586 0 0 20 0 1 0 555382025 16253652992 3925632 33554432000 4194304 6211132 140729915767216 140729915749000 139945524906981 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3968177 3925632 846 493 0 3961482 0
Current children cumulated CPU time: 1305.58 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15702528 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1308.54 s]
# the end of solver process 3023 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1299.96 s, system=6.72768 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1306.4 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 3146
/proc/meminfo: memFree=519888/32770624 swapFree=66993608/67108860
[pid=3023] ppid=3020 vsize=15872708 memory=15702528 CPUtime=1305.69 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) S 3020 3023 1861 0 -1 512 3762001 0 0 0 129982 587 0 0 20 0 1 0 555382025 16253652992 3925632 33554432000 4194304 6211132 140729915767216 140729915749000 5189800 0 16384 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3968177 3925632 846 493 0 3961482 0
Current children cumulated CPU time: 1305.69 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15702528 KiB

[startup+1307.21 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 3146
/proc/meminfo: memFree=176424/32770624 swapFree=66993604/67108860
[pid=3023] ppid=3020 vsize=15872708 memory=15702528 CPUtime=1305.81 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) S 3020 3023 1861 0 -1 512 3762001 0 0 0 129993 588 0 0 20 0 1 0 555382025 16253652992 3925632 33554432000 4194304 6211132 140729915767216 140729915749000 5189800 0 16384 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3968177 3925632 846 493 0 3961482 0
Current children cumulated CPU time: 1305.81 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15702528 KiB

[startup+1307.6 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 3146
/proc/meminfo: memFree=176424/32770624 swapFree=66993604/67108860
[pid=3023] ppid=3020 vsize=15872708 memory=15702528 CPUtime=1305.83 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) S 3020 3023 1861 0 -1 512 3762001 0 0 0 129994 589 0 0 20 0 1 0 555382025 16253652992 3925632 33554432000 4194304 6211132 140729915767216 140729915749000 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3968177 3925632 846 493 0 3961482 0
Current children cumulated CPU time: 1305.83 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15702528 KiB

[startup+1307.7 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 3146
/proc/meminfo: memFree=176424/32770624 swapFree=66993604/67108860
[pid=3023] ppid=3020 vsize=15872708 memory=15702528 CPUtime=1305.85 cores=1,3,5,7
/proc/3023/stat : 3023 (cosoco) S 3020 3023 1861 0 -1 512 3762001 0 0 0 129996 589 0 0 20 0 1 0 555382025 16253652992 3925632 33554432000 4194304 6211132 140729915767216 140729915749000 5189800 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 37752832 140729915769867 140729915769969 140729915769969 140729915772878 0
/proc/3023/statm: 3968177 3925632 846 493 0 3961482 0
Current children cumulated CPU time: 1305.85 s
Current children cumulated vsize: 15872708 KiB
Current children cumulated memory: 15702528 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1308.54
CPU time (s): 1306.69
CPU user time (s): 1299.96
CPU system time (s): 6.72768
CPU usage (%): 99.8589
Max. virtual memory (cumulated for all children) (KiB): 15872708
Max. memory (cumulated for all children) (KiB): 15702528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1299.96
system time used= 6.72768
maximum resident set size= 15702564
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3762001
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 110522
involuntary context switches= 1635


# summary of solver processes directly reported to runsolver:
#   pid: 3023
#   total CPU time (s): 1306.69
#   total CPU user time (s): 1299.96
#   total CPU system time (s): 6.72768

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.69303 second user time and 8.87201 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-29 23:05:52
IDJOB=4408405
IDBENCH=122975
IDSOLVER=2874
FILE ID=node121/4408405-1569791195
RUNJOBID= node121-1569787350-1893
PBS_JOBID= 21705831
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-10-031-009.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408405-1569791195/watcher-4408405-1569791195 -o /tmp/evaluation-result-4408405-1569791195/solver-4408405-1569791195 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node121-1569787350-1893 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408405-1569791195.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c781bc55b7ee4c4bb57d86a03397642c
RANDOM SEED=545763179

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26381916 kB
MemAvailable:   28315428 kB
Buffers:          212000 kB
Cached:          2043836 kB
SwapCached:         4476 kB
Active:          4852296 kB
Inactive:         958136 kB
Active(anon):    3547360 kB
Inactive(anon):    81980 kB
Active(file):    1304936 kB
Inactive(file):   876156 kB
Unevictable:      109048 kB
Mlocked:          109048 kB
SwapTotal:      67108860 kB
SwapFree:       66993608 kB
Dirty:              2812 kB
Writeback:             0 kB
AnonPages:       3606396 kB
Mapped:            28544 kB
Shmem:             66252 kB
Slab:             166308 kB
SReclaimable:     136512 kB
SUnreclaim:        29796 kB
KernelStack:        3776 kB
PageTables:        12304 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    4121800 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    534528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61592 MiB
End job on node121 at 2019-09-29 23:27:40