Trace number 4397756

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1377.72 1379.66

General information on the benchmark

NameOpd/Opd-sum-small/
Opd-09-024-008.xml
MD5SUM0092e4980ed4af349e39cdcd3a0de294
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2
Best CPU time to get the best result obtained on this benchmark2.68622
Satisfiable
(Un)Satisfiability was proved
Number of variables217
Number of constraints46
Number of domains2
Minimum domain size2
Maximum domain size23
Distribution of domain sizes[{"size":2,"count":216},{"size":23,"count":1}]
Minimum variable degree10
Maximum variable degree37
Distribution of variable degrees[{"degree":10,"count":216},{"degree":37,"count":1}]
Minimum constraint arity24
Maximum constraint arity216
Distribution of constraint arities[{"arity":24,"count":9},{"arity":49,"count":36},{"arity":216,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":45}]
Optimization problemYES
Type of objectivemin VAR

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9443 MiB free)
  memory of node 1: 16384 MiB (14510 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397756-1568577418/watcher-4397756-1568577418 -o /tmp/evaluation-result-4397756-1568577418/solver-4397756-1568577418 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568572740-702 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397756-1568577418.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=1453, runsolver pid=1450
Current StackSize limit: 8192 KiB


[startup+0.100199 s]*
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24528168/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=28564 memory=5008 CPUtime=0.1 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 1421 0 0 0 10 0 0 0 20 0 1 0 433990491 29249536 1252 33554432000 4194304 6211092 140721844544528 140721844541064 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 7141 1252 845 493 0 446 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28564 KiB
Current children cumulated memory: 5008 KiB

[startup+0.209971 s]*
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24526680/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=29808 memory=6064 CPUtime=0.21 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 1734 0 0 0 21 0 0 0 20 0 1 0 433990491 30523392 1516 33554432000 4194304 6211092 140721844544528 140721844541064 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 7452 1516 846 493 0 757 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 29808 KiB
Current children cumulated memory: 6064 KiB

[startup+0.309664 s]*
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24525564/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=30948 memory=7244 CPUtime=0.31 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2018 0 0 0 31 0 0 0 20 0 1 0 433990491 31690752 1811 33554432000 4194304 6211092 140721844544528 140721844541064 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 7737 1811 846 493 0 1042 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 30948 KiB
Current children cumulated memory: 7244 KiB

[startup+0.700395 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24523704/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=35356 memory=11748 CPUtime=0.69 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3102 0 0 0 69 0 0 0 20 0 1 0 433990491 36204544 2937 33554432000 4194304 6211092 140721844544528 140721844541064 5012856 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 8839 2937 846 493 0 2144 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 35356 KiB
Current children cumulated memory: 11748 KiB

[startup+1.5004 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24518116/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=44516 memory=20744 CPUtime=1.49 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 5367 0 0 0 149 0 0 0 20 0 1 0 433990491 45584384 5186 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 11129 5186 846 493 0 4434 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 44516 KiB
Current children cumulated memory: 20744 KiB

[startup+3.10978 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24492508/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=63144 memory=38920 CPUtime=3.1 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 9975 0 0 0 309 1 0 0 20 0 1 0 433990491 64659456 9730 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 15786 9730 846 493 0 9091 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 63144 KiB
Current children cumulated memory: 38920 KiB

[startup+8.66228 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 1454
/proc/meminfo: memFree=24492508/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=125788 memory=102032 CPUtime=8.65 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 25873 0 0 0 863 2 0 0 20 0 1 0 433990491 128806912 25508 33554432000 4194304 6211092 140721844544528 140721844529000 5443096 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 31447 25508 846 493 0 24752 0
Current children cumulated CPU time: 8.65 s
Current children cumulated vsize: 125788 KiB
Current children cumulated memory: 102032 KiB

[startup+12.7004 s]
/proc/loadavg: 2.32 2.12 2.07 3/200 1455
/proc/meminfo: memFree=24817900/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=171836 memory=147756 CPUtime=12.69 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 37327 0 0 0 1265 4 0 0 20 0 1 0 433990491 175960064 36939 33554432000 4194304 6211092 140721844544528 140721844529000 139850055076670 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 42959 36939 846 493 0 36264 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 171836 KiB
Current children cumulated memory: 147756 KiB

[startup+25.5096 s]
/proc/loadavg: 2.39 2.15 2.08 3/199 1460
/proc/meminfo: memFree=25203952/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=319364 memory=293684 CPUtime=25.51 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 71793 0 0 0 2544 7 0 0 20 0 1 0 433990491 327028736 73421 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 79841 73421 846 493 0 73146 0
Current children cumulated CPU time: 25.51 s
Current children cumulated vsize: 319364 KiB
Current children cumulated memory: 293684 KiB

[startup+51.1003 s]
/proc/loadavg: 2.26 2.14 2.07 3/199 1460
/proc/meminfo: memFree=24920212/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=618044 memory=583108 CPUtime=51.09 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 140674 0 0 0 5093 16 0 0 20 0 1 0 433990491 632877056 145777 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 154511 145777 846 493 0 147816 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 618044 KiB
Current children cumulated memory: 583108 KiB

[startup+102.3 s]
/proc/loadavg: 2.11 2.12 2.07 3/199 1464
/proc/meminfo: memFree=24341804/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=1222092 memory=1164688 CPUtime=102.29 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 277376 0 0 0 10193 36 0 0 20 0 1 0 433990491 1251422208 291172 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 305523 291172 846 493 0 298828 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 1222092 KiB
Current children cumulated memory: 1164688 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.10 2.06 3/200 1471
/proc/meminfo: memFree=23658848/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=1913720 memory=1843268 CPUtime=162.29 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 436776 0 0 0 16174 55 0 0 20 0 1 0 433990491 1959649280 460817 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 478430 460817 846 493 0 471735 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 1913720 KiB
Current children cumulated memory: 1843268 KiB

[startup+222.3 s]
/proc/loadavg: 2.05 2.09 2.06 3/199 1538
/proc/meminfo: memFree=22980644/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=2547584 memory=2523048 CPUtime=222.27 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 595519 0 0 0 22152 75 0 0 20 0 1 0 433990491 2608726016 630762 33554432000 4194304 6211092 140721844544528 140721844529000 5451469 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 636896 630762 846 493 0 630201 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 2547584 KiB
Current children cumulated memory: 2523048 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.08 2.06 3/200 1550
/proc/meminfo: memFree=22299824/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=3266388 memory=3200344 CPUtime=282.27 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 754702 0 0 0 28132 95 0 0 20 0 1 0 433990491 3344781312 800086 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 816597 800086 846 493 0 809902 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 3266388 KiB
Current children cumulated memory: 3200344 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.06 2.05 3/202 1583
/proc/meminfo: memFree=21617600/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=4027664 memory=3879732 CPUtime=342.26 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 913885 0 0 0 34111 115 0 0 20 0 1 0 433990491 4124327936 969933 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 1006916 969933 846 493 0 1000221 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 4027664 KiB
Current children cumulated memory: 3879732 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/201 1587
/proc/meminfo: memFree=20938360/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=4661528 memory=4558680 CPUtime=402.25 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 1072942 0 0 0 40088 137 0 0 20 0 1 0 433990491 4773404672 1139670 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 1165382 1139670 846 493 0 1158687 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 4661528 KiB
Current children cumulated memory: 4558680 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 1592
/proc/meminfo: memFree=20256128/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=5300912 memory=5240140 CPUtime=462.24 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 1232074 0 0 0 46065 159 0 0 20 0 1 0 433990491 5428133888 1310035 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 1325228 1310035 846 493 0 1318533 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 5300912 KiB
Current children cumulated memory: 5240140 KiB


################
# More data... #
################

Current children cumulated vsize: 9577996 KiB
Current children cumulated memory: 9313804 KiB

[startup+882.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 1634
/proc/meminfo: memFree=15494048/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=10210804 memory=9991676 CPUtime=882.18 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2342981 0 0 0 87882 336 0 0 20 0 1 0 433990491 10455863296 2497919 33554432000 4194304 6211092 140721844544528 140721844529000 5456306 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 2552701 2497919 846 493 0 2546006 0
Current children cumulated CPU time: 882.18 s
Current children cumulated vsize: 10210804 KiB
Current children cumulated memory: 9991676 KiB

[startup+942.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1702
/proc/meminfo: memFree=13784196/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=10854680 memory=10668808 CPUtime=942.16 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2501691 0 0 0 93846 370 0 0 20 0 1 0 433990491 11115192320 2667202 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 2713670 2667202 846 493 0 2706975 0
Current children cumulated CPU time: 942.16 s
Current children cumulated vsize: 10854680 KiB
Current children cumulated memory: 10668808 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1706
/proc/meminfo: memFree=13075420/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=11487224 memory=11349152 CPUtime=1002.15 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2660153 0 0 0 99811 404 0 0 20 0 1 0 433990491 11762917376 2837288 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 2871806 2837288 846 493 0 2865111 0
Current children cumulated CPU time: 1002.15 s
Current children cumulated vsize: 11487224 KiB
Current children cumulated memory: 11349152 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 1712
/proc/meminfo: memFree=12393620/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=12119768 memory=12024872 CPUtime=1062.13 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2818452 0 0 0 105772 441 0 0 20 0 1 0 433990491 12410642432 3006218 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3029942 3006218 846 493 0 3023247 0
Current children cumulated CPU time: 1062.13 s
Current children cumulated vsize: 12119768 KiB
Current children cumulated memory: 12024872 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1716
/proc/meminfo: memFree=11713644/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=12752048 memory=12704152 CPUtime=1122.12 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 2976692 0 0 0 111733 479 0 0 20 0 1 0 433990491 13058097152 3176038 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3188012 3176038 846 493 0 3181317 0
Current children cumulated CPU time: 1122.12 s
Current children cumulated vsize: 12752048 KiB
Current children cumulated memory: 12704152 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 1720
/proc/meminfo: memFree=11033616/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=13805148 memory=13379588 CPUtime=1182.11 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3135448 0 0 0 117695 516 0 0 20 0 1 0 433990491 14136471552 3344897 33554432000 4194304 6211092 140721844544528 140721844529000 139850055078717 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3451287 3344897 846 493 0 3444592 0
Current children cumulated CPU time: 1182.11 s
Current children cumulated vsize: 13805148 KiB
Current children cumulated memory: 13379588 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1726
/proc/meminfo: memFree=10353036/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=14437824 memory=14059392 CPUtime=1242.11 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3293768 0 0 0 123658 553 0 0 20 0 1 0 433990491 14784331776 3514848 33554432000 4194304 6211092 140721844544528 140721844529000 5451500 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3609456 3514848 846 493 0 3602761 0
Current children cumulated CPU time: 1242.11 s
Current children cumulated vsize: 14437824 KiB
Current children cumulated memory: 14059392 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 1730
/proc/meminfo: memFree=9676856/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15069972 memory=14734580 CPUtime=1302.09 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3451959 0 0 0 129620 589 0 0 20 0 1 0 433990491 15431651328 3683645 33554432000 4194304 6211092 140721844544528 140721844529000 139850056001457 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3767493 3683645 846 493 0 3760798 0
Current children cumulated CPU time: 1302.09 s
Current children cumulated vsize: 15069972 KiB
Current children cumulated memory: 14734580 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 1734
/proc/meminfo: memFree=8997396/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15718392 memory=15412892 CPUtime=1362.08 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3610448 0 0 0 135580 628 0 0 20 0 1 0 433990491 16095633408 3853223 33554432000 4194304 6211092 140721844544528 140721844529000 139850055080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3929598 3853223 846 493 0 3922903 0
Current children cumulated CPU time: 1362.08 s
Current children cumulated vsize: 15718392 KiB
Current children cumulated memory: 15412892 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1376.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 1737
/proc/meminfo: memFree=8828524/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15872172 memory=15577656 CPUtime=1376.68 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) R 1450 1453 671 0 -1 4202496 3649099 0 0 0 137032 636 0 0 20 0 1 0 433990491 16253104128 3894414 33554432000 4194304 6211092 140721844544528 140721844529000 5446158 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3968043 3894414 846 493 0 3961348 0
Current children cumulated CPU time: 1376.68 s
Current children cumulated vsize: 15872172 KiB
Current children cumulated memory: 15577656 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1379.66 s]
# the end of solver process 1453 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1370.57 s, system=7.14358 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1378.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1738
/proc/meminfo: memFree=8561544/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15872172 memory=15577656 CPUtime=1376.86 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) S 1450 1453 671 0 -1 512 3649104 0 0 0 137048 638 0 0 20 0 1 0 433990491 16253104128 3894414 33554432000 4194304 6211092 140721844544528 140721844529000 5189768 0 16384 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3968043 3894414 846 493 0 3961348 0
Current children cumulated CPU time: 1376.86 s
Current children cumulated vsize: 15872172 KiB
Current children cumulated memory: 15577656 KiB

[startup+1378.6 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1738
/proc/meminfo: memFree=8082344/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15872172 memory=15577656 CPUtime=1376.91 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) S 1450 1453 671 0 -1 512 3649104 0 0 0 137053 638 0 0 20 0 1 0 433990491 16253104128 3894414 33554432000 4194304 6211092 140721844544528 140721844529000 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3968043 3894414 846 493 0 3961348 0
Current children cumulated CPU time: 1376.91 s
Current children cumulated vsize: 15872172 KiB
Current children cumulated memory: 15577656 KiB

[startup+1378.8 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1738
/proc/meminfo: memFree=8082344/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15872172 memory=15577656 CPUtime=1376.94 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) S 1450 1453 671 0 -1 512 3649104 0 0 0 137056 638 0 0 20 0 1 0 433990491 16253104128 3894414 33554432000 4194304 6211092 140721844544528 140721844529000 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3968043 3894414 846 493 0 3961348 0
Current children cumulated CPU time: 1376.94 s
Current children cumulated vsize: 15872172 KiB
Current children cumulated memory: 15577656 KiB

[startup+1378.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 1738
/proc/meminfo: memFree=8082344/32770624 swapFree=67002444/67108860
[pid=1453] ppid=1450 vsize=15872172 memory=15577656 CPUtime=1376.95 cores=0,2,4,6
/proc/1453/stat : 1453 (cosoco) S 1450 1453 671 0 -1 512 3649104 0 0 0 137057 638 0 0 20 0 1 0 433990491 16253104128 3894414 33554432000 4194304 6211092 140721844544528 140721844529000 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 4 0 0 0 0 0 8312316 8317760 33370112 140721844548619 140721844548721 140721844548721 140721844551630 0
/proc/1453/statm: 3968043 3894414 846 493 0 3961348 0
Current children cumulated CPU time: 1376.95 s
Current children cumulated vsize: 15872172 KiB
Current children cumulated memory: 15577656 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1379.66
CPU time (s): 1377.72
CPU user time (s): 1370.57
CPU system time (s): 7.14358
CPU usage (%): 99.8594
Max. virtual memory (cumulated for all children) (KiB): 15872172
Max. memory (cumulated for all children) (KiB): 15577656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1370.57
system time used= 7.14358
maximum resident set size= 15577712
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3649104
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 121637
involuntary context switches= 1061


# summary of solver processes directly reported to runsolver:
#   pid: 1453
#   total CPU time (s): 1377.72
#   total CPU user time (s): 1370.57
#   total CPU system time (s): 7.14358

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.73156 second user time and 9.93851 second system time

The end

Launcher Data 

Begin job on node136 at 2019-09-15 21:56:14
IDJOB=4397756
IDBENCH=122987
IDSOLVER=2850
FILE ID=node136/4397756-1568577418
RUNJOBID= node136-1568572740-702
PBS_JOBID= 21703318
Free space on /tmp= 60708 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Opd/Opd-sum-small/Opd-09-024-008.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397756-1568577418/watcher-4397756-1568577418 -o /tmp/evaluation-result-4397756-1568577418/solver-4397756-1568577418 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node136-1568572740-702 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397756-1568577418.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0092e4980ed4af349e39cdcd3a0de294
RANDOM SEED=823908379

node136.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24529456 kB
MemAvailable:   31869448 kB
Buffers:           99960 kB
Cached:          7513784 kB
SwapCached:         3784 kB
Active:          2121904 kB
Inactive:        5501856 kB
Active(anon):       8856 kB
Inactive(anon):    50164 kB
Active(file):    2113048 kB
Inactive(file):  5451692 kB
Unevictable:      108592 kB
Mlocked:          108592 kB
SwapTotal:      67108860 kB
SwapFree:       67002444 kB
Dirty:            815176 kB
Writeback:         80980 kB
AnonPages:        116908 kB
Mapped:            49516 kB
Shmem:             40272 kB
Slab:             211696 kB
SReclaimable:     182176 kB
SUnreclaim:        29520 kB
KernelStack:        3488 kB
PageTables:         5792 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     540084 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 60696 MiB
End job on node136 at 2019-09-15 22:19:14