Trace number 4397216

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0? (MO) 1506.46 1508.58

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_12_14.xml
MD5SUMb79ed9a63f5f06b259b31d8f3686f277
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark228
Best CPU time to get the best result obtained on this benchmark2520.17
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":14,"count":111},{"size":49,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13929 MiB free)
  memory of node 1: 16384 MiB (15612 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397216-1568594375/watcher-4397216-1568594375 -o /tmp/evaluation-result-4397216-1568594375/solver-4397216-1568594375 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568594485-1022 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4397216-1568594375.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=1048, runsolver pid=1043

[startup+0.100116 s]*
/proc/loadavg: 1.00 1.01 1.25 3/197 1053
/proc/meminfo: memFree=30228404/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=38888 memory=15092 CPUtime=0.09 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3980 0 0 0 9 0 0 0 20 0 1 0 435705926 39821312 3773 33554432000 4194304 6211092 140732757763024 140732757759560 139942870332544 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 9722 3773 809 493 0 3027 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 38888 KiB
Current children cumulated memory: 15092 KiB

[startup+0.20966 s]*
/proc/loadavg: 1.00 1.01 1.25 3/197 1053
/proc/meminfo: memFree=30224544/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=40596 memory=16872 CPUtime=0.2 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 4415 0 0 0 20 0 0 0 20 0 1 0 435705926 41570304 4218 33554432000 4194304 6211092 140732757763024 140732757759560 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 10149 4218 819 493 0 3454 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 40596 KiB
Current children cumulated memory: 16872 KiB

[startup+0.309059 s]*
/proc/loadavg: 1.00 1.01 1.25 3/197 1054
/proc/meminfo: memFree=30222684/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=41712 memory=17928 CPUtime=0.3 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 4675 0 0 0 30 0 0 0 20 0 1 0 435705926 42713088 4482 33554432000 4194304 6211092 140732757763024 140732757759560 5012856 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 10428 4482 819 493 0 3733 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 41712 KiB
Current children cumulated memory: 17928 KiB

[startup+0.700281 s]
/proc/loadavg: 1.00 1.01 1.25 3/197 1054
/proc/meminfo: memFree=30217848/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=45840 memory=21992 CPUtime=0.68 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 5677 0 0 0 68 0 0 0 20 0 1 0 435705926 46940160 5498 33554432000 4194304 6211092 140732757763024 140732757759560 139942854265662 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 11460 5498 819 493 0 4765 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 45840 KiB
Current children cumulated memory: 21992 KiB

[startup+1.50028 s]
/proc/loadavg: 1.00 1.01 1.25 3/197 1054
/proc/meminfo: memFree=30207680/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=54208 memory=30316 CPUtime=1.49 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 7760 0 0 0 148 1 0 0 20 0 1 0 435705926 55508992 7579 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 13552 7579 819 493 0 6857 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 54208 KiB
Current children cumulated memory: 30316 KiB

[startup+3.10938 s]
/proc/loadavg: 1.08 1.03 1.25 3/197 1054
/proc/meminfo: memFree=30166716/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=71156 memory=47068 CPUtime=3.09 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 12122 0 0 0 308 1 0 0 20 0 1 0 435705926 72863744 11767 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 17789 11767 819 493 0 11094 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 71156 KiB
Current children cumulated memory: 47068 KiB

[startup+6.30027 s]
/proc/loadavg: 1.08 1.03 1.25 3/197 1054
/proc/meminfo: memFree=30104844/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=104964 memory=80256 CPUtime=6.29 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 20601 0 0 0 626 3 0 0 20 0 1 0 435705926 107483136 20064 33554432000 4194304 6211092 140732757763024 140732757736584 139942854265662 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 26241 20064 819 493 0 19546 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 104964 KiB
Current children cumulated memory: 80256 KiB

[startup+12.7003 s]
/proc/loadavg: 1.22 1.06 1.26 3/197 1054
/proc/meminfo: memFree=29981356/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=170952 memory=146784 CPUtime=12.69 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 37435 0 0 0 1264 5 0 0 20 0 1 0 435705926 175054848 36696 33554432000 4194304 6211092 140732757763024 140732757736584 5012856 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 42738 36696 819 493 0 36043 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 170952 KiB
Current children cumulated memory: 146784 KiB

[startup+25.5003 s]
/proc/loadavg: 1.34 1.09 1.27 3/197 1054
/proc/meminfo: memFree=29711900/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=305448 memory=280056 CPUtime=25.49 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 70590 0 0 0 2539 10 0 0 20 0 1 0 435705926 312778752 70014 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 76362 70014 819 493 0 69667 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 305448 KiB
Current children cumulated memory: 280056 KiB

[startup+51.1095 s]
/proc/loadavg: 1.57 1.17 1.28 3/197 1056
/proc/meminfo: memFree=29169336/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=576584 memory=548368 CPUtime=51.09 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 136283 0 0 0 5090 19 0 0 20 0 1 0 435705926 590422016 137092 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 144146 137092 819 493 0 137451 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 576584 KiB
Current children cumulated memory: 548368 KiB

[startup+102.3 s]
/proc/loadavg: 1.81 1.29 1.32 3/197 1060
/proc/meminfo: memFree=28107540/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=1124004 memory=1084444 CPUtime=102.27 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 267246 0 0 0 10190 37 0 0 20 0 1 0 435705926 1150980096 271111 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 281001 271111 819 493 0 274306 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1124004 KiB
Current children cumulated memory: 1084444 KiB

[startup+162.3 s]
/proc/loadavg: 2.55 1.57 1.41 3/197 1064
/proc/meminfo: memFree=26856304/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=1758052 memory=1714792 CPUtime=162.26 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 420270 0 0 0 16167 59 0 0 20 0 1 0 435705926 1800245248 428698 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 439513 428698 819 493 0 432818 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 1758052 KiB
Current children cumulated memory: 1714792 KiB

[startup+222.3 s]
/proc/loadavg: 2.54 1.77 1.50 3/197 1071
/proc/meminfo: memFree=25605708/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=2367496 memory=2342764 CPUtime=222.24 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 572659 0 0 0 22143 81 0 0 20 0 1 0 435705926 2424315904 585691 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 591874 585691 819 493 0 585179 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 2367496 KiB
Current children cumulated memory: 2342764 KiB

[startup+282.3 s]
/proc/loadavg: 2.20 1.82 1.53 3/197 1075
/proc/meminfo: memFree=24356392/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=3013984 memory=2972956 CPUtime=282.23 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 725611 0 0 0 28120 103 0 0 20 0 1 0 435705926 3086319616 743239 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 753496 743239 819 493 0 746801 0
Current children cumulated CPU time: 282.23 s
Current children cumulated vsize: 3013984 KiB
Current children cumulated memory: 2972956 KiB

[startup+342.3 s]
/proc/loadavg: 2.07 1.85 1.56 3/197 1079
/proc/meminfo: memFree=23106428/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=3678792 memory=3602940 CPUtime=342.21 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 878585 0 0 0 34095 126 0 0 20 0 1 0 435705926 3767083008 900735 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 919698 900735 819 493 0 913003 0
Current children cumulated CPU time: 342.21 s
Current children cumulated vsize: 3678792 KiB
Current children cumulated memory: 3602940 KiB

[startup+402.3 s]
/proc/loadavg: 2.03 1.88 1.58 3/197 1085
/proc/meminfo: memFree=21857744/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=4287972 memory=4230504 CPUtime=402.19 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 1030998 0 0 0 40071 148 0 0 20 0 1 0 435705926 4390883328 1057626 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 1071993 1057626 819 493 0 1065298 0
Current children cumulated CPU time: 402.19 s
Current children cumulated vsize: 4287972 KiB
Current children cumulated memory: 4230504 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 1.90 1.61 3/197 1089
/proc/meminfo: memFree=20609012/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=4897152 memory=4860328 CPUtime=462.18 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 1183424 0 0 0 46049 169 0 0 20 0 1 0 435705926 5014683648 1215082 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 1224288 1215082 819 493 0 1217593 0
Current children cumulated CPU time: 462.18 s
Current children cumulated vsize: 4897152 KiB
Current children cumulated memory: 4860328 KiB


################
# More data... #
################

Current children cumulated CPU time: 942.05 s
Current children cumulated vsize: 9975960 KiB
Current children cumulated memory: 9888372 KiB

[startup+1002.3 s]
/proc/loadavg: 2.00 1.99 1.78 3/197 1143
/proc/meminfo: memFree=9372916/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=10584612 memory=10515372 CPUtime=1002.04 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 2556066 0 0 0 99814 390 0 0 20 0 1 0 435705926 10838642688 2628843 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 2646153 2628843 819 493 0 2639458 0
Current children cumulated CPU time: 1002.04 s
Current children cumulated vsize: 10584612 KiB
Current children cumulated memory: 10515372 KiB

[startup+1062.3 s]
/proc/loadavg: 2.00 1.99 1.79 3/197 1147
/proc/meminfo: memFree=8126052/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=11193132 memory=11144368 CPUtime=1062.03 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 2708465 0 0 0 105783 420 0 0 20 0 1 0 435705926 11461767168 2786092 33554432000 4194304 6211092 140732757763024 140732757736584 5452157 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 2798283 2786092 819 493 0 2791588 0
Current children cumulated CPU time: 1062.03 s
Current children cumulated vsize: 11193132 KiB
Current children cumulated memory: 11144368 KiB

[startup+1122.3 s]
/proc/loadavg: 2.00 1.99 1.81 3/198 1161
/proc/meminfo: memFree=6878164/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=11801256 memory=11773100 CPUtime=1122.02 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 2860783 0 0 0 111752 450 0 0 20 0 1 0 435705926 12084486144 2943275 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 2950314 2943275 819 493 0 2943619 0
Current children cumulated CPU time: 1122.02 s
Current children cumulated vsize: 11801256 KiB
Current children cumulated memory: 11773100 KiB

[startup+1182.3 s]
/proc/loadavg: 2.00 1.99 1.82 4/199 1187
/proc/meminfo: memFree=5630956/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=12596368 memory=12399296 CPUtime=1182 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3013479 0 0 0 117719 481 0 0 20 0 1 0 435705926 12898680832 3099824 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3149092 3099824 819 493 0 3142397 0
Current children cumulated CPU time: 1182 s
Current children cumulated vsize: 12596368 KiB
Current children cumulated memory: 12399296 KiB

[startup+1242.3 s]
/proc/loadavg: 2.00 1.99 1.83 3/199 1194
/proc/meminfo: memFree=4382428/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=13204624 memory=13027764 CPUtime=1241.99 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3165789 0 0 0 123689 510 0 0 20 0 1 0 435705926 13521534976 3256941 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3301156 3256941 819 493 0 3294461 0
Current children cumulated CPU time: 1241.99 s
Current children cumulated vsize: 13204624 KiB
Current children cumulated memory: 13027764 KiB

[startup+1302.3 s]
/proc/loadavg: 2.00 1.99 1.84 3/199 1205
/proc/meminfo: memFree=3135808/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=13812748 memory=13656496 CPUtime=1301.97 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3318084 0 0 0 129653 544 0 0 20 0 1 0 435705926 14144253952 3414124 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3453187 3414124 819 493 0 3446492 0
Current children cumulated CPU time: 1301.97 s
Current children cumulated vsize: 13812748 KiB
Current children cumulated memory: 13656496 KiB

[startup+1362.3 s]
/proc/loadavg: 2.00 1.99 1.85 3/199 1209
/proc/meminfo: memFree=1891020/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=14420608 memory=14282920 CPUtime=1361.95 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3470322 0 0 0 135624 571 0 0 20 0 1 0 435705926 14766702592 3570730 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3605152 3570730 819 493 0 3598457 0
Current children cumulated CPU time: 1361.95 s
Current children cumulated vsize: 14420608 KiB
Current children cumulated memory: 14282920 KiB

[startup+1422.3 s]
/proc/loadavg: 2.00 1.99 1.86 3/199 1213
/proc/meminfo: memFree=642352/32770624 swapFree=66932320/67108860
[pid=1048] ppid=1043 vsize=15028600 memory=14911184 CPUtime=1421.94 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3622620 0 0 0 141588 606 0 0 20 0 1 0 435705926 15389286400 3727796 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3757150 3727796 819 493 0 3750455 0
Current children cumulated CPU time: 1421.94 s
Current children cumulated vsize: 15028600 KiB
Current children cumulated memory: 14911184 KiB

[startup+1482.3 s]
/proc/loadavg: 2.00 1.99 1.87 3/198 1219
/proc/meminfo: memFree=181640/32770624 swapFree=66711404/67108860
[pid=1048] ppid=1043 vsize=15635272 memory=15535128 CPUtime=1481.93 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3775078 0 0 0 147554 639 0 0 20 0 1 0 435705926 16010518528 3831098 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3908818 3831098 512 493 0 3902123 0
Current children cumulated CPU time: 1481.93 s
Current children cumulated vsize: 15635272 KiB
Current children cumulated memory: 15535128 KiB



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1505.8 s]
/proc/loadavg: 2.00 1.99 1.87 3/198 1221
/proc/meminfo: memFree=192820/32770624 swapFree=66422164/67108860
[pid=1048] ppid=1043 vsize=15872080 memory=15780184 CPUtime=1505.43 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 4202496 3834402 0 0 0 149890 653 0 0 20 0 1 0 435705926 16253009920 3820012 33554432000 4194304 6211092 140732757763024 140732757736584 139942854269925 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3968020 3820012 512 493 0 3961325 0
Current children cumulated CPU time: 1505.43 s
Current children cumulated vsize: 15872080 KiB
Current children cumulated memory: 15780184 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
WARNING: unexpectedly, some solver processes are still present and will be killed:

[startup+0 s]*
/proc/loadavg: 2.16 2.02 1.88 2/199 1222
/proc/meminfo: memFree=184504/32770624 swapFree=66422272/67108860
[pid=1048] ppid=1043 vsize=15872212 memory=15780408 CPUtime=1505.69 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) D 1043 1048 988 0 -1 512 3852881 0 2648 0 149892 677 0 0 20 0 1 0 435705926 16253145088 3841088 33554432000 4194304 6211092 140732757763024 140732757736584 5189768 256 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 136 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3968053 3841088 519 493 0 3961358 0
??? kill 1048 sig 9
??? end of watcher thread

[startup+1508.58 s]
# the end of solver process 1048 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=1498.92 s, system=7.53757 s

Solver just ended.
Dumping a history of the last processes samples

[startup+1507.2 s]
/proc/loadavg: 2.00 1.99 1.87 2/199 1222
/proc/meminfo: memFree=189292/32770624 swapFree=66422276/67108860
[pid=1048] ppid=1043 vsize=15872212 memory=15780408 CPUtime=1505.64 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) D 1043 1048 988 0 -1 512 3848294 0 1992 0 149892 672 0 0 20 0 1 0 435705926 16253145088 3835875 33554432000 4194304 6211092 140732757763024 140732757736584 5189768 0 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 83 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3968053 3835875 519 493 0 3961358 0
Current children cumulated CPU time: 1505.64 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15780408 KiB

[startup+1507.6 s]
/proc/loadavg: 2.00 1.99 1.87 2/199 1222
/proc/meminfo: memFree=189292/32770624 swapFree=66422276/67108860
[pid=1048] ppid=1043 vsize=15872212 memory=15780408 CPUtime=1505.66 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) R 1043 1048 988 0 -1 512 3851132 0 2397 0 149892 674 0 0 20 0 1 0 435705926 16253145088 3839108 33554432000 4194304 6211092 140732757763024 140732757736584 5189768 0 16384 4096 8405026 0 0 0 17 5 0 0 122 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3968053 3839108 519 493 0 3961358 0
Current children cumulated CPU time: 1505.66 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15780408 KiB

[startup+1507.8 s]
/proc/loadavg: 2.00 1.99 1.87 2/199 1222
/proc/meminfo: memFree=189292/32770624 swapFree=66422276/67108860
[pid=1048] ppid=1043 vsize=15872212 memory=15780408 CPUtime=1505.69 cores=1,3,5,7
/proc/1048/stat : 1048 (cosoco) D 1043 1048 988 0 -1 512 3852881 0 2648 0 149892 677 0 0 20 0 1 0 435705926 16253145088 3841088 33554432000 4194304 6211092 140732757763024 140732757736584 5189768 0 16384 4096 8405026 18446744071580419444 0 0 17 5 0 0 136 0 0 8312316 8317760 39391232 140732757771275 140732757771377 140732757771377 140732757774286 0
/proc/1048/statm: 3968053 3841088 519 493 0 3961358 0
Current children cumulated CPU time: 1505.69 s
Current children cumulated vsize: 15872212 KiB
Current children cumulated memory: 15780408 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1508.58
CPU time (s): 1506.46
CPU user time (s): 1498.92
CPU system time (s): 7.53757
CPU usage (%): 99.8593
Max. virtual memory (cumulated for all children) (KiB): 15872212
Max. memory (cumulated for all children) (KiB): 15780408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1498.92
system time used= 7.53757
maximum resident set size= 15364504
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3852881
page faults= 2649
swaps= 0
block input operations= 174152
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4864
involuntary context switches= 1854


# summary of solver processes directly reported to runsolver:
#   pid: 1048
#   total CPU time (s): 1506.46
#   total CPU user time (s): 1498.92
#   total CPU system time (s): 7.53757

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.08827 second user time and 10.4816 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-16 02:41:25
IDJOB=4397216
IDBENCH=139629
IDSOLVER=2848
FILE ID=node139/4397216-1568594375
RUNJOBID= node139-1568594485-1022
PBS_JOBID= 21703351
Free space on /tmp= 59556 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_12_14.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397216-1568594375/watcher-4397216-1568594375 -o /tmp/evaluation-result-4397216-1568594375/solver-4397216-1568594375 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node139-1568594485-1022 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4397216-1568594375.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b79ed9a63f5f06b259b31d8f3686f277
RANDOM SEED=1403502350

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30251284 kB
MemAvailable:   31814876 kB
Buffers:          158188 kB
Cached:          1693032 kB
SwapCached:        74320 kB
Active:           602740 kB
Inactive:        1326944 kB
Active(anon):       4580 kB
Inactive(anon):   123252 kB
Active(file):     598160 kB
Inactive(file):  1203692 kB
Unevictable:      108020 kB
Mlocked:          108020 kB
SwapTotal:      67108860 kB
SwapFree:       66932320 kB
Dirty:              5444 kB
Writeback:             0 kB
AnonPages:        111912 kB
Mapped:            45528 kB
Shmem:             40520 kB
Slab:             183992 kB
SReclaimable:     155152 kB
SUnreclaim:        28840 kB
KernelStack:        3248 kB
PageTables:         6212 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     500264 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 59464 MiB
End job on node139 at 2019-09-16 03:06:34