Trace number 4396921

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (MO) 1766.87 1769.12

General information on the benchmark

NameBibd/Bibd-sum-open/
Bibd-sum-57-076-20-15-05.xml
MD5SUM103999ad3c646e4e3c5e6682f24aa76f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4332
Number of constraints1730
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":4332}]
Minimum variable degree59
Maximum variable degree59
Distribution of variable degrees[{"degree":59,"count":4332}]
Minimum constraint arity57
Maximum constraint arity4332
Distribution of constraint arities[{"arity":57,"count":76},{"arity":76,"count":57},{"arity":152,"count":1596},{"arity":4332,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"lex","count":1},{"type":"sum","count":1729}]
Optimization problemNO
Type of objective

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14785 MiB free)
  memory of node 1: 16384 MiB (14977 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396921-1568577883/watcher-4396921-1568577883 -o /tmp/evaluation-result-4396921-1568577883/solver-4396921-1568577883 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node137-1568572741-13814 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396921-1568577883.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=14668, runsolver pid=14665


[startup+0.100598 s]*
/proc/loadavg: 2.00 2.01 2.04 3/201 14669
/proc/meminfo: memFree=30471168/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=33412 memory=9816 CPUtime=0.09 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2659 0 0 0 9 0 0 0 20 0 1 0 434035603 34213888 2454 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 8353 2454 842 493 0 1658 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 33412 KiB
Current children cumulated memory: 9816 KiB

[startup+0.209995 s]*
/proc/loadavg: 2.00 2.01 2.04 3/201 14669
/proc/meminfo: memFree=30469780/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=34488 memory=10872 CPUtime=0.2 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2900 0 0 0 20 0 0 0 20 0 1 0 434035603 35315712 2718 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 8622 2718 842 493 0 1927 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 34488 KiB
Current children cumulated memory: 10872 KiB

[startup+0.309204 s]*
/proc/loadavg: 2.00 2.01 2.04 3/201 14669
/proc/meminfo: memFree=30469036/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=35304 memory=11664 CPUtime=0.3 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3121 0 0 0 30 0 0 0 20 0 1 0 434035603 36151296 2916 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 8826 2916 842 493 0 2131 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 35304 KiB
Current children cumulated memory: 11664 KiB

[startup+0.700279 s]
/proc/loadavg: 2.00 2.01 2.04 3/201 14669
/proc/meminfo: memFree=30467176/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=38736 memory=15096 CPUtime=0.68 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3976 0 0 0 68 0 0 0 20 0 1 0 434035603 39665664 3774 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 9684 3774 842 493 0 2989 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 38736 KiB
Current children cumulated memory: 15096 KiB

[startup+1.50028 s]
/proc/loadavg: 2.00 2.01 2.04 3/201 14669
/proc/meminfo: memFree=30462228/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=45940 memory=22316 CPUtime=1.48 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 5761 0 0 0 148 0 0 0 20 0 1 0 434035603 47042560 5579 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 11485 5579 842 493 0 4790 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 45940 KiB
Current children cumulated memory: 22316 KiB

[startup+3.10963 s]
/proc/loadavg: 2.00 2.01 2.04 3/202 14671
/proc/meminfo: memFree=30444352/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=60256 memory=36512 CPUtime=3.1 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 9417 0 0 0 309 1 0 0 20 0 1 0 434035603 61702144 9128 33554432000 4194304 6211092 140735304596640 140735304561336 140089630148515 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 15064 9128 842 493 0 8369 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 60256 KiB
Current children cumulated memory: 36512 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.04 3/202 14671
/proc/meminfo: memFree=30417104/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=88820 memory=65188 CPUtime=6.28 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 16617 0 0 0 626 2 0 0 20 0 1 0 434035603 90951680 16297 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 22205 16297 842 493 0 15510 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 88820 KiB
Current children cumulated memory: 65188 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.04 3/201 14671
/proc/meminfo: memFree=30363536/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=146520 memory=122276 CPUtime=12.68 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 30994 0 0 0 1264 4 0 0 20 0 1 0 434035603 150036480 30569 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 36630 30569 842 493 0 29935 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 146520 KiB
Current children cumulated memory: 122276 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.04 3/201 14671
/proc/meminfo: memFree=30247276/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=262168 memory=236800 CPUtime=25.48 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 59754 0 0 0 2541 7 0 0 20 0 1 0 434035603 268460032 59200 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 65542 59200 842 493 0 58847 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 262168 KiB
Current children cumulated memory: 236800 KiB

[startup+51.1097 s]
/proc/loadavg: 2.00 2.01 2.04 3/201 14674
/proc/meminfo: memFree=30014224/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=489620 memory=465404 CPUtime=51.09 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 116997 0 0 0 5095 14 0 0 20 0 1 0 434035603 501370880 116351 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 122405 116351 842 493 0 115710 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 489620 KiB
Current children cumulated memory: 465404 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 14678
/proc/meminfo: memFree=29558112/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=950024 memory=922184 CPUtime=102.25 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 229710 0 0 0 10197 28 0 0 20 0 1 0 434035603 972824576 230546 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 237506 230546 842 493 0 230811 0
Current children cumulated CPU time: 102.25 s
Current children cumulated vsize: 950024 KiB
Current children cumulated memory: 922184 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 14682
/proc/meminfo: memFree=29019128/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=1485904 memory=1459336 CPUtime=162.22 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 361443 0 0 0 16176 46 0 0 20 0 1 0 434035603 1521565696 364834 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 371476 364834 842 493 0 364781 0
Current children cumulated CPU time: 162.22 s
Current children cumulated vsize: 1485904 KiB
Current children cumulated memory: 1459336 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 14686
/proc/meminfo: memFree=28482648/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=2027704 memory=1994848 CPUtime=222.19 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 493248 0 0 0 22157 62 0 0 20 0 1 0 434035603 2076368896 498712 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 506926 498712 842 493 0 500231 0
Current children cumulated CPU time: 222.19 s
Current children cumulated vsize: 2027704 KiB
Current children cumulated memory: 1994848 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 14753
/proc/meminfo: memFree=27862540/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=2577788 memory=2528400 CPUtime=282.17 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 624619 0 0 0 28136 81 0 0 20 0 1 0 434035603 2639654912 632100 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 644447 632100 842 493 0 637752 0
Current children cumulated CPU time: 282.17 s
Current children cumulated vsize: 2577788 KiB
Current children cumulated memory: 2528400 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 14757
/proc/meminfo: memFree=27322932/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=3103988 memory=3063784 CPUtime=342.15 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 756414 0 0 0 34115 100 0 0 20 0 1 0 434035603 3178483712 765946 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 775997 765946 842 493 0 769302 0
Current children cumulated CPU time: 342.15 s
Current children cumulated vsize: 3103988 KiB
Current children cumulated memory: 3063784 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 14769
/proc/meminfo: memFree=26781432/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=3628292 memory=3599364 CPUtime=402.13 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 887718 0 0 0 40098 115 0 0 20 0 1 0 434035603 3715371008 899841 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 907073 899841 842 493 0 900378 0
Current children cumulated CPU time: 402.13 s
Current children cumulated vsize: 3628292 KiB
Current children cumulated memory: 3599364 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/200 14775
/proc/meminfo: memFree=26241852/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=4189904 memory=4134944 CPUtime=462.11 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 1019617 0 0 0 46079 132 0 0 20 0 1 0 434035603 4290461696 1033736 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 1047476 1033736 842 493 0 1040781 0
Current children cumulated CPU time: 462.11 s
Current children cumulated vsize: 4189904 KiB
Current children cumulated memory: 4134944 KiB


################
# More data... #
################

Current children cumulated vsize: 10115404 KiB
Current children cumulated memory: 10030308 KiB

[startup+1182.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/201 14840
/proc/meminfo: memFree=19714264/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=10640236 memory=10567352 CPUtime=1181.92 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2596047 0 0 0 117860 332 0 0 20 0 1 0 434035603 10895601664 2641838 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 2660059 2641838 842 493 0 2653364 0
Current children cumulated CPU time: 1181.92 s
Current children cumulated vsize: 10640236 KiB
Current children cumulated memory: 10567352 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/201 14844
/proc/meminfo: memFree=19178304/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=11164276 memory=11102456 CPUtime=1241.9 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2727283 0 0 0 123837 353 0 0 20 0 1 0 434035603 11432218624 2775614 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 2791069 2775614 842 493 0 2784374 0
Current children cumulated CPU time: 1241.9 s
Current children cumulated vsize: 11164276 KiB
Current children cumulated memory: 11102456 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/198 14849
/proc/meminfo: memFree=18646244/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=11698988 memory=11635812 CPUtime=1301.88 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2858680 0 0 0 129813 375 0 0 20 0 1 0 434035603 11979763712 2908953 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 2924747 2908953 842 493 0 2918052 0
Current children cumulated CPU time: 1301.88 s
Current children cumulated vsize: 11698988 KiB
Current children cumulated memory: 11635812 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 14856
/proc/meminfo: memFree=18104688/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=12222896 memory=12173984 CPUtime=1361.87 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 2989785 0 0 0 135784 403 0 0 20 0 1 0 434035603 12516245504 3043496 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3055724 3043496 842 493 0 3049029 0
Current children cumulated CPU time: 1361.87 s
Current children cumulated vsize: 12222896 KiB
Current children cumulated memory: 12173984 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 14860
/proc/meminfo: memFree=17570508/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=12746408 memory=12707752 CPUtime=1421.85 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3120813 0 0 0 141757 428 0 0 20 0 1 0 434035603 13052321792 3176938 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3186602 3176938 842 493 0 3179907 0
Current children cumulated CPU time: 1421.85 s
Current children cumulated vsize: 12746408 KiB
Current children cumulated memory: 12707752 KiB

[startup+1482.3 s]
/proc/loadavg: 1.95 2.00 2.04 3/199 14864
/proc/meminfo: memFree=17035460/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=13269920 memory=13241536 CPUtime=1481.84 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3251796 0 0 0 147728 456 0 0 20 0 1 0 434035603 13588398080 3310384 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3317480 3310384 842 493 0 3310785 0
Current children cumulated CPU time: 1481.84 s
Current children cumulated vsize: 13269920 KiB
Current children cumulated memory: 13241536 KiB

[startup+1542.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/199 14870
/proc/meminfo: memFree=16498620/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=13918132 memory=13777464 CPUtime=1541.82 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3383337 0 0 0 153702 480 0 0 20 0 1 0 434035603 14252167168 3444366 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3479533 3444366 842 493 0 3472838 0
Current children cumulated CPU time: 1541.82 s
Current children cumulated vsize: 13918132 KiB
Current children cumulated memory: 13777464 KiB

[startup+1602.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/200 14882
/proc/meminfo: memFree=15961460/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=14441776 memory=14311324 CPUtime=1601.8 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3514350 0 0 0 159673 507 0 0 20 0 1 0 434035603 14788378624 3577831 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3610444 3577831 842 493 0 3603749 0
Current children cumulated CPU time: 1601.8 s
Current children cumulated vsize: 14441776 KiB
Current children cumulated memory: 14311324 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 14886
/proc/meminfo: memFree=15426136/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=14965156 memory=14844920 CPUtime=1661.79 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3645292 0 0 0 165645 534 0 0 20 0 1 0 434035603 15324319744 3711230 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3741289 3711230 842 493 0 3734594 0
Current children cumulated CPU time: 1661.79 s
Current children cumulated vsize: 14965156 KiB
Current children cumulated memory: 14844920 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 14892
/proc/meminfo: memFree=14888676/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=15488272 memory=15380480 CPUtime=1721.76 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3776221 0 0 0 171614 562 0 0 20 0 1 0 434035603 15859990528 3845120 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3872068 3845120 842 493 0 3865373 0
Current children cumulated CPU time: 1721.76 s
Current children cumulated vsize: 15488272 KiB
Current children cumulated memory: 15380480 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1766.4 s]
/proc/loadavg: 2.00 2.00 2.04 3/200 14896
/proc/meminfo: memFree=14498664/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=15872260 memory=15770424 CPUtime=1765.86 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 4202496 3872283 0 0 0 176000 586 0 0 20 0 1 0 434035603 16253194240 3942606 33554432000 4194304 6211092 140735304596640 140735304561336 140089629228005 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3968065 3942606 842 493 0 3961370 0
Current children cumulated CPU time: 1765.86 s
Current children cumulated vsize: 15872260 KiB
Current children cumulated memory: 15770424 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+1769.12 s]
# the end of solver process 14668 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1760.26 s, system=6.6151 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1767.2 s]
/proc/loadavg: 2.00 2.00 2.04 3/201 14897
/proc/meminfo: memFree=14323824/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=15872260 memory=15770424 CPUtime=1765.94 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) S 14665 14668 13782 0 -1 512 3872288 0 0 0 176007 587 0 0 20 0 1 0 434035603 16253194240 3942606 33554432000 4194304 6211092 140735304596640 140735304561336 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 3 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3968065 3942606 842 493 0 3961370 0
Current children cumulated CPU time: 1765.94 s
Current children cumulated vsize: 15872260 KiB
Current children cumulated memory: 15770424 KiB

[startup+1768 s]*
/proc/loadavg: 2.08 2.02 2.05 3/201 14897
/proc/meminfo: memFree=13768800/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=15872260 memory=15770424 CPUtime=1766.08 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) S 14665 14668 13782 0 -1 512 3872288 0 0 0 176019 589 0 0 20 0 1 0 434035603 16253194240 3942606 33554432000 4194304 6211092 140735304596640 140735304561336 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3968065 3942606 842 493 0 3961370 0
Current children cumulated CPU time: 1766.08 s
Current children cumulated vsize: 15872260 KiB
Current children cumulated memory: 15770424 KiB

[startup+1768.4 s]
/proc/loadavg: 2.08 2.02 2.05 3/201 14897
/proc/meminfo: memFree=13768800/32770624 swapFree=66927296/67108860
[pid=14668] ppid=14665 vsize=15872260 memory=15770424 CPUtime=1766.14 cores=1,3,5,7
/proc/14668/stat : 14668 (cosoco) R 14665 14668 13782 0 -1 512 3872288 0 0 0 176025 589 0 0 20 0 1 0 434035603 16253194240 3942606 33554432000 4194304 6211092 140735304596640 140735304561336 5189768 0 16384 4096 8405026 18446744071580971376 0 0 17 5 0 0 0 0 0 8312316 8317760 41222144 140735304598539 140735304598641 140735304598641 140735304601550 0
/proc/14668/statm: 3968065 3942606 842 493 0 3961370 0
Current children cumulated CPU time: 1766.14 s
Current children cumulated vsize: 15872260 KiB
Current children cumulated memory: 15770424 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1769.12
CPU time (s): 1766.87
CPU user time (s): 1760.26
CPU system time (s): 6.6151
CPU usage (%): 99.8729
Max. virtual memory (cumulated for all children) (KiB): 15872260
Max. memory (cumulated for all children) (KiB): 15770424

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1760.26
system time used= 6.6151
maximum resident set size= 15770632
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3872288
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 119947
involuntary context switches= 955


# summary of solver processes directly reported to runsolver:
#   pid: 14668
#   total CPU time (s): 1766.87
#   total CPU user time (s): 1760.26
#   total CPU system time (s): 6.6151

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.56949 second user time and 11.9291 second system time

The end

Launcher Data 

Begin job on node137 at 2019-09-15 22:04:00
IDJOB=4396921
IDBENCH=124102
IDSOLVER=2848
FILE ID=node137/4396921-1568577883
RUNJOBID= node137-1568572741-13814
PBS_JOBID= 21703317
Free space on /tmp= 61416 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Bibd/Bibd-sum-open/Bibd-sum-57-076-20-15-05.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396921-1568577883/watcher-4396921-1568577883 -o /tmp/evaluation-result-4396921-1568577883/solver-4396921-1568577883 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node137-1568572741-13814 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396921-1568577883.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 103999ad3c646e4e3c5e6682f24aa76f
RANDOM SEED=823908379

node137.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30477384 kB
MemAvailable:   31810820 kB
Buffers:          122772 kB
Cached:          1497660 kB
SwapCached:        77512 kB
Active:          1442892 kB
Inactive:         258032 kB
Active(anon):       5124 kB
Inactive(anon):   124992 kB
Active(file):    1437768 kB
Inactive(file):   133040 kB
Unevictable:      109912 kB
Mlocked:          109912 kB
SwapTotal:      67108860 kB
SwapFree:       66927296 kB
Dirty:              2724 kB
Writeback:             0 kB
AnonPages:         60804 kB
Mapped:            48556 kB
Shmem:             41000 kB
Slab:             186084 kB
SReclaimable:     156928 kB
SUnreclaim:        29156 kB
KernelStack:        3568 kB
PageTables:         5692 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     536736 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     14336 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 60952 MiB
End job on node137 at 2019-09-15 22:33:30