Trace number 4398489

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.O parallel? (TO) 2520.75 2523.23

General information on the benchmark

NameSteelMillSlab/
SteelMillSlab-bench_9_13.xml
MD5SUM3c8d95ae467c6bf4a4f8a8c9b5dc34f0
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkSAT TO
Best value of the objective obtained on this benchmark244
Best CPU time to get the best result obtained on this benchmark19937.7
Satisfiable
(Un)Satisfiability was proved
Number of variables12654
Number of constraints466
Number of domains4
Minimum domain size2
Maximum domain size111
Distribution of domain sizes[{"size":2,"count":12321},{"size":15,"count":111},{"size":50,"count":111},{"size":111,"count":111}]
Minimum variable degree2
Maximum variable degree114
Distribution of variable degrees[{"degree":2,"count":12432},{"degree":3,"count":111},{"degree":112,"count":78},{"degree":113,"count":24},{"degree":114,"count":9}]
Minimum constraint arity2
Maximum constraint arity112
Distribution of constraint arities[{"arity":2,"count":132},{"arity":111,"count":112},{"arity":112,"count":222}]
Number of extensional constraints0
Number of intensional constraints132
Distribution of constraint types[{"type":"intension","count":132},{"type":"sum","count":112},{"type":"element","count":111},{"type":"channel","count":111}]
Optimization problemYES
Type of objectivemin SUM

Solver Data


Verifier Data 

One s line expected

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15194 MiB free)
  memory of node 1: 16384 MiB (15262 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398489-1568614168/watcher-4398489-1568614168 -o /tmp/evaluation-result-4398489-1568614168/solver-4398489-1568614168 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node137-1568606919-19609 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398489-1568614168.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=20913, runsolver pid=20910
Current StackSize limit: 8192 KiB


[startup+0.10017 s]*
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31153868/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=66956 memory=42960 CPUtime=0.1 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 10923 0 0 0 9 1 0 0 20 0 1 0 437664164 68562944 10740 33554432000 4194304 6211092 140723516759856 140723516755736 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 16772 10740 754 493 0 10077 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 66956 KiB
Current children cumulated memory: 42960 KiB

[startup+0.209418 s]*
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31123392/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=93216 memory=69360 CPUtime=0.21 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 17517 0 0 0 19 2 0 0 20 0 1 0 437664164 95453184 17340 33554432000 4194304 6211092 140723516759856 140723516755736 5453828 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 23304 17340 809 493 0 16609 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 93216 KiB
Current children cumulated memory: 69360 KiB

[startup+0.309404 s]*
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31121904/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=94664 memory=70708 CPUtime=0.31 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 17890 0 0 0 29 2 0 0 20 0 1 0 437664164 96935936 17677 33554432000 4194304 6211092 140723516759856 140723516755736 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 23666 17677 819 493 0 16971 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 94664 KiB
Current children cumulated memory: 70708 KiB

[startup+0.700275 s]
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31119672/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=98632 memory=74668 CPUtime=0.69 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 18873 0 0 0 67 2 0 0 20 0 1 0 437664164 100999168 18667 33554432000 4194304 6211092 140723516759856 140723516755736 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 24658 18667 819 493 0 17963 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 98632 KiB
Current children cumulated memory: 74668 KiB

[startup+1.50028 s]
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31114836/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=106952 memory=82828 CPUtime=1.49 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 20931 0 0 0 146 3 0 0 20 0 1 0 437664164 109518848 20707 33554432000 4194304 6211092 140723516759856 140723516755736 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 26738 20707 819 493 0 20043 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 106952 KiB
Current children cumulated memory: 82828 KiB

[startup+3.10931 s]
/proc/loadavg: 2.89 4.13 6.11 2/193 20914
/proc/meminfo: memFree=31095040/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=123768 memory=99584 CPUtime=3.1 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 25313 0 0 0 307 3 0 0 20 0 1 0 437664164 126738432 24896 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 30942 24896 819 493 0 24247 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 123768 KiB
Current children cumulated memory: 99584 KiB

[startup+6.30027 s]
/proc/loadavg: 2.74 4.08 6.08 2/193 20914
/proc/meminfo: memFree=31064164/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=157048 memory=132244 CPUtime=6.28 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 33763 0 0 0 624 4 0 0 20 0 1 0 437664164 160817152 33061 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 39262 33061 819 493 0 32567 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 157048 KiB
Current children cumulated memory: 132244 KiB

[startup+12.7003 s]
/proc/loadavg: 2.60 4.02 6.05 2/193 20914
/proc/meminfo: memFree=31002784/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=222376 memory=198240 CPUtime=12.68 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 50474 0 0 0 1262 6 0 0 20 0 1 0 437664164 227713024 49560 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 55594 49560 819 493 0 48899 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 222376 KiB
Current children cumulated memory: 198240 KiB

[startup+25.5003 s]
/proc/loadavg: 2.25 3.88 5.97 2/193 20914
/proc/meminfo: memFree=30868100/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=355288 memory=330400 CPUtime=25.48 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 83524 0 0 0 2538 10 0 0 20 0 1 0 437664164 363814912 82600 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 88822 82600 819 493 0 82127 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 355288 KiB
Current children cumulated memory: 330400 KiB

[startup+51.1093 s]
/proc/loadavg: 1.82 3.65 5.84 2/193 20917
/proc/meminfo: memFree=30599000/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=622728 memory=595436 CPUtime=51.09 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 148969 0 0 0 5091 18 0 0 20 0 1 0 437664164 637673472 148859 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 155682 148859 819 493 0 148987 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 622728 KiB
Current children cumulated memory: 595436 KiB

[startup+102.3 s]
/proc/loadavg: 1.36 3.24 5.58 2/194 20928
/proc/meminfo: memFree=30075572/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=1160644 memory=1120300 CPUtime=102.27 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 277162 0 0 0 10192 35 0 0 20 0 1 0 437664164 1188499456 280075 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 290161 280075 819 493 0 283466 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 1160644 KiB
Current children cumulated memory: 1120300 KiB

[startup+162.3 s]
/proc/loadavg: 1.13 2.83 5.30 2/193 20931
/proc/meminfo: memFree=29456224/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=1784660 memory=1740100 CPUtime=162.25 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 428112 0 0 0 16170 55 0 0 20 0 1 0 437664164 1827491840 435025 33554432000 4194304 6211092 140723516759856 140723516733416 140327548701502 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 446165 435025 819 493 0 439470 0
Current children cumulated CPU time: 162.25 s
Current children cumulated vsize: 1784660 KiB
Current children cumulated memory: 1740100 KiB

[startup+222.3 s]
/proc/loadavg: 1.05 2.50 5.03 2/193 20936
/proc/meminfo: memFree=28837304/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=2384468 memory=2358408 CPUtime=222.23 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 578184 0 0 0 22146 77 0 0 20 0 1 0 437664164 2441695232 589602 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 596117 589602 819 493 0 589422 0
Current children cumulated CPU time: 222.23 s
Current children cumulated vsize: 2384468 KiB
Current children cumulated memory: 2358408 KiB

[startup+282.3 s]
/proc/loadavg: 1.02 2.23 4.78 2/193 20939
/proc/meminfo: memFree=28215652/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=3021320 memory=2979100 CPUtime=282.21 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 728424 0 0 0 28125 96 0 0 20 0 1 0 437664164 3093831680 744775 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 755330 744775 819 493 0 748635 0
Current children cumulated CPU time: 282.21 s
Current children cumulated vsize: 3021320 KiB
Current children cumulated memory: 2979100 KiB

[startup+342.3 s]
/proc/loadavg: 1.01 2.00 4.54 2/192 20942
/proc/meminfo: memFree=27596652/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=3621128 memory=3597364 CPUtime=342.19 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 878517 0 0 0 34103 116 0 0 20 0 1 0 437664164 3708035072 899341 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 905282 899341 819 493 0 898587 0
Current children cumulated CPU time: 342.19 s
Current children cumulated vsize: 3621128 KiB
Current children cumulated memory: 3597364 KiB

[startup+402.3 s]
/proc/loadavg: 1.00 1.82 4.32 2/192 20947
/proc/meminfo: memFree=26973716/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=4276300 memory=4217768 CPUtime=402.17 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 1029303 0 0 0 40077 140 0 0 20 0 1 0 437664164 4378931200 1054442 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 1069075 1054442 819 493 0 1062380 0
Current children cumulated CPU time: 402.17 s
Current children cumulated vsize: 4276300 KiB
Current children cumulated memory: 4217768 KiB

[startup+462.3 s]
/proc/loadavg: 1.00 1.67 4.11 2/191 20950
/proc/meminfo: memFree=26355088/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=4875976 memory=4835868 CPUtime=462.16 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 1179452 0 0 0 46054 162 0 0 20 0 1 0 437664164 4992999424 1208967 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 1218994 1208967 819 493 0 1212299 0
Current children cumulated CPU time: 462.16 s
Current children cumulated vsize: 4875976 KiB
Current children cumulated memory: 4835868 KiB


################
# More data... #
################

Current children cumulated vsize: 19914832 KiB
Current children cumulated memory: 19663336 KiB

[startup+1962.3 s]
/proc/loadavg: 1.00 1.01 1.62 2/192 21068
/proc/meminfo: memFree=10875344/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=20511868 memory=20278892 CPUtime=1961.67 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 4934589 0 0 0 195199 968 0 0 20 0 1 0 437664164 21004152832 5069723 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5127967 5069723 819 493 0 5121272 0
Current children cumulated CPU time: 1961.67 s
Current children cumulated vsize: 20511868 KiB
Current children cumulated memory: 20278892 KiB

[startup+2022.3 s]
/proc/loadavg: 1.00 1.01 1.58 2/193 21073
/proc/meminfo: memFree=10256616/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=21108772 memory=20896228 CPUtime=2021.65 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5084359 0 0 0 201151 1014 0 0 20 0 1 0 437664164 21615382528 5224057 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5277193 5224057 819 493 0 5270498 0
Current children cumulated CPU time: 2021.65 s
Current children cumulated vsize: 21108772 KiB
Current children cumulated memory: 20896228 KiB

[startup+2082.3 s]
/proc/loadavg: 1.00 1.01 1.54 2/192 21076
/proc/meminfo: memFree=9640592/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=21705676 memory=21511740 CPUtime=2081.63 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5234152 0 0 0 207106 1057 0 0 20 0 1 0 437664164 22226612224 5377935 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5426419 5377935 819 493 0 5419724 0
Current children cumulated CPU time: 2081.63 s
Current children cumulated vsize: 21705676 KiB
Current children cumulated memory: 21511740 KiB

[startup+2142.3 s]
/proc/loadavg: 1.00 1.01 1.51 2/192 21079
/proc/meminfo: memFree=9021852/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=22302580 memory=22128960 CPUtime=2141.61 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5383990 0 0 0 213055 1106 0 0 20 0 1 0 437664164 22837841920 5532240 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5575645 5532240 819 493 0 5568950 0
Current children cumulated CPU time: 2141.61 s
Current children cumulated vsize: 22302580 KiB
Current children cumulated memory: 22128960 KiB

[startup+2202.3 s]
/proc/loadavg: 1.00 1.01 1.48 2/192 21084
/proc/meminfo: memFree=8405460/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=22899220 memory=22743988 CPUtime=2201.59 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5533687 0 0 0 219006 1153 0 0 20 0 1 0 437664164 23448801280 5685997 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5724805 5685997 819 493 0 5718110 0
Current children cumulated CPU time: 2201.59 s
Current children cumulated vsize: 22899220 KiB
Current children cumulated memory: 22743988 KiB

[startup+2262.3 s]
/proc/loadavg: 1.00 1.01 1.45 2/191 21087
/proc/meminfo: memFree=7789796/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=23495728 memory=23359008 CPUtime=2261.57 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5683349 0 0 0 224954 1203 0 0 20 0 1 0 437664164 24059625472 5839752 33554432000 4194304 6211092 140723516759856 140723516733416 140327548701502 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 5873932 5839752 819 493 0 5867237 0
Current children cumulated CPU time: 2261.57 s
Current children cumulated vsize: 23495728 KiB
Current children cumulated memory: 23359008 KiB

[startup+2322.3 s]
/proc/loadavg: 1.00 1.01 1.42 2/191 21090
/proc/meminfo: memFree=7171188/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=24092236 memory=23975928 CPUtime=2321.55 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5833150 0 0 0 230902 1253 0 0 20 0 1 0 437664164 24670449664 5993982 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6023059 5993982 819 493 0 6016364 0
Current children cumulated CPU time: 2321.55 s
Current children cumulated vsize: 24092236 KiB
Current children cumulated memory: 23975928 KiB

[startup+2382.3 s]
/proc/loadavg: 1.00 1.01 1.39 2/192 21095
/proc/meminfo: memFree=6555508/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=24688480 memory=24590688 CPUtime=2381.52 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 5982741 0 0 0 236848 1304 0 0 20 0 1 0 437664164 25281003520 6147672 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6172120 6147672 819 493 0 6165425 0
Current children cumulated CPU time: 2381.52 s
Current children cumulated vsize: 24688480 KiB
Current children cumulated memory: 24590688 KiB

[startup+2442.3 s]
/proc/loadavg: 1.00 1.01 1.37 2/191 21098
/proc/meminfo: memFree=5937724/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=25284724 memory=25207336 CPUtime=2441.5 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 6132449 0 0 0 242795 1355 0 0 20 0 1 0 437664164 25891557376 6301834 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6321181 6301834 819 493 0 6314486 0
Current children cumulated CPU time: 2441.5 s
Current children cumulated vsize: 25284724 KiB
Current children cumulated memory: 25207336 KiB

[startup+2502.3 s]
/proc/loadavg: 1.34 1.09 1.37 2/192 21109
/proc/meminfo: memFree=5322028/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=25880704 memory=25821792 CPUtime=2501.49 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 6282005 0 0 0 248743 1406 0 0 20 0 1 0 437664164 26501840896 6455448 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6470176 6455448 819 493 0 6463481 0
Current children cumulated CPU time: 2501.49 s
Current children cumulated vsize: 25880704 KiB
Current children cumulated memory: 25821792 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 1.53 1.15 1.39 2/192 21111
/proc/meminfo: memFree=5136432/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=26056660 memory=26003736 CPUtime=2519.19 cores=0-7
/proc/20913/stat : 20913 (cosoco) R 20910 20913 19582 0 -1 4202496 6326169 0 0 0 250496 1423 0 0 20 0 1 0 437664164 26682019840 6500934 33554432000 4194304 6211092 140723516759856 140723516733416 140327548705765 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6514165 6500934 819 493 0 6507470 0
Current children cumulated CPU time: 2519.19 s
Current children cumulated vsize: 26056660 KiB
Current children cumulated memory: 26003736 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)
??? end of watcher thread

[startup+2523.23 s]
# the end of solver process 20913 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2505.29 s, system=15.4619 s

Solver just ended.
Dumping a history of the last processes samples

[startup+2520.8 s]
/proc/loadavg: 1.53 1.15 1.39 2/192 21111
/proc/meminfo: memFree=5136432/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=26056660 memory=26004000 CPUtime=2519.31 cores=0-7
/proc/20913/stat : 20913 (cosoco) S 20910 20913 19582 0 -1 512 6326176 0 0 0 250508 1423 0 0 20 0 1 0 437664164 26682019840 6501000 33554432000 4194304 6211092 140723516759856 140723516733416 5189550 0 16384 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6514165 6501000 819 493 0 6507470 0
Current children cumulated CPU time: 2519.31 s
Current children cumulated vsize: 26056660 KiB
Current children cumulated memory: 26004000 KiB

[startup+2521.6 s]
/proc/loadavg: 1.53 1.15 1.39 2/193 21112
/proc/meminfo: memFree=4580284/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=26056660 memory=26004000 CPUtime=2519.45 cores=0-7
/proc/20913/stat : 20913 (cosoco) S 20910 20913 19582 0 -1 512 6326176 0 0 0 250521 1424 0 0 20 0 1 0 437664164 26682019840 6501000 33554432000 4194304 6211092 140723516759856 140723516733416 5189550 0 16384 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6514165 6501000 819 493 0 6507470 0
Current children cumulated CPU time: 2519.45 s
Current children cumulated vsize: 26056660 KiB
Current children cumulated memory: 26004000 KiB

[startup+2522 s]*
/proc/loadavg: 1.53 1.15 1.39 2/193 21112
/proc/meminfo: memFree=4024256/32770624 swapFree=66927304/67108860
[pid=20913] ppid=20910 vsize=26056660 memory=26004000 CPUtime=2519.52 cores=0-7
/proc/20913/stat : 20913 (cosoco) S 20910 20913 19582 0 -1 512 6326176 0 0 0 250528 1424 0 0 20 0 1 0 437664164 26682019840 6501000 33554432000 4194304 6211092 140723516759856 140723516733416 5189550 0 16384 4096 8405026 18446744071580971376 0 0 17 1 0 0 0 0 0 8312316 8317760 36274176 140723516761105 140723516761197 140723516761197 140723516764110 0
/proc/20913/statm: 6514165 6501000 819 493 0 6507470 0
Current children cumulated CPU time: 2519.52 s
Current children cumulated vsize: 26056660 KiB
Current children cumulated memory: 26004000 KiB

Child ended because it received signal 9 (SIGKILL)
Real time (s): 2523.23
CPU time (s): 2520.75
CPU user time (s): 2505.29
CPU system time (s): 15.4619
CPU usage (%): 99.9019
Max. virtual memory (cumulated for all children) (KiB): 26056660
Max. memory (cumulated for all children) (KiB): 26004000

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2505.29
system time used= 15.4619
maximum resident set size= 26004012
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6326176
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 140993
involuntary context switches= 1242


# summary of solver processes directly reported to runsolver:
#   pid: 20913
#   total CPU time (s): 2520.75
#   total CPU user time (s): 2505.29
#   total CPU system time (s): 15.4619

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.53747 second user time and 16.1305 second system time

The end

Launcher Data 

Begin job on node137 at 2019-09-16 08:08:46
IDJOB=4398489
IDBENCH=139552
IDSOLVER=2851
FILE ID=node137/4398489-1568614168
RUNJOBID= node137-1568606919-19609
PBS_JOBID= 21703428
Free space on /tmp= 61420 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/SteelMillSlab/SteelMillSlab-bench_9_13.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398489-1568614168/watcher-4398489-1568614168 -o /tmp/evaluation-result-4398489-1568614168/solver-4398489-1568614168 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node137-1568606919-19609 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398489-1568614168.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3c8d95ae467c6bf4a4f8a8c9b5dc34f0
RANDOM SEED=2137886244

node137.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31188104 kB
MemAvailable:   31807644 kB
Buffers:          107600 kB
Cached:           800588 kB
SwapCached:        77504 kB
Active:           825008 kB
Inactive:         163388 kB
Active(anon):       1924 kB
Inactive(anon):   127908 kB
Active(file):     823084 kB
Inactive(file):    35480 kB
Unevictable:      109916 kB
Mlocked:          109916 kB
SwapTotal:      67108860 kB
SwapFree:       66927304 kB
Dirty:              6160 kB
Writeback:             0 kB
AnonPages:        114488 kB
Mapped:            47500 kB
Shmem:             41004 kB
Slab:             183164 kB
SReclaimable:     153620 kB
SUnreclaim:        29544 kB
KernelStack:        3392 kB
PageTables:         5184 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     507728 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 60872 MiB
End job on node137 at 2019-09-16 08:50:49