Trace number 4103745

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (exit code) 1276.1 1276.35

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-sc205.opb
MD5SUMcfa0de6a5c077caf94404f012a430180
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark3.2925
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved YES
Number of variables6090
Total number of constraints204
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints204
Minimum length of a constraint30
Maximum length of a constraint120
Number of terms in the objective function 30
Biggest coefficient in the objective function 536870912
Number of bits for the biggest coefficient in the objective function 30
Sum of the numbers in the objective function 1073741823
Number of bits of the sum of numbers in the objective function 30
Biggest number in a constraint 8589934592
Number of bits of the biggest number in a constraint 34
Biggest sum of numbers in a constraint 22548578283
Number of bits of the biggest sum of numbers35
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T10:35:24+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103745-1466238924.opb"]
0.00/0.01	c use --random-gen="2733240015 765641766 300156129 277873228 4166260789 2777605069 3669963516 1831495136 2825222027 1643924407 1682797931 2948422249 1919563106 1422118524 14379101 4130138138 312043139 1695381758 1459918052 2776493890 786366366 1419634899 350931826 4092775183 173847846 2282892949 2329788028 698885333 2330050078 966948622 3937614386 3675171111 3140310473 3731158595 1577887625 2443426973 3058046892 3031857969 2310341683 1364591644 2334875669 43351130 2012326204 44737772 2192598262 2474457756 3485909545 1088450589 3099882303 2300992343 237619567 2250135737 2977383966 2843122045 3988059693 4265681375 3385261916 1994048114 2962344738 158871249 2406750635 727922393 334101957 3437558270 1295717619 2588655351 852671571 2247344782 2151760016 3634735217 62280451 4141696578 3698405657 328604624 2126314780 813431084 250273812 67233172 1991666105 4268854199 599090016 960565890 1304245757 3243450222 2783818699 403846290 1681680808 157330248 1097143786 3232662552 2105564276 3268489706 2665637825 918493348 419489018 1362782208 1300072334 2623152374 1366929889 2384397438 2216146156 2705245273 3165549245 2139443679 4283818485 309873032 3638553119 423947000 3129947596 3006192794 646561999 3751109325 641794685 241480376 968751866 1464757536 2790490935 1590293564 3492456570 3423426895 874793129 2842328743 4117460417 1745548720 2924350975 2094746984 2741687580 1323308461 2119366920 888063284 2374860607 1260122348 663260671 1737859263 3219758235 2824508169 4208570975 2731608745 3789415991 2019514250 2134039485 170818228 1134885219 1150325257 1449532836 360336875 4294035331 1133032368 2084092434 993855772 51930258 4484924 4239802711 1122147622 2758281913 1414008495 3413871485 1411729801 2930945498 3725299675 2812870941 3593065720 2626347062 618016876 989781807 763885647 656411544 1349948666 2353561139 2684807379 2487119119 158597848 441536650 1038732733 1163037016 3912227193 927015041 404760051 1279199475 692087533 4112811727 1509549664 3808136691 4002763764 2458879799 3586099114 1512290761 3712396477 1633047491 3773022052 1188577330 1566191711 2582634013 81890992 345035493 3844877579 3647024668 1368216818 205180829 2943421805 891483242 2372589316 3961573573 3499765216 3408848036 1079688828 2023742127 2366232113 447368791 3055699289 1962370951 587219465 3558137044 1884907404 3458348300 1668839165 4212906073 648244432 839805724 592948498 460035777 1546587419 3140742115 636243276 2730608545 2975225875 427225162 3869461906 4291018415 3629503320 355864904 2774802758 3156540306 2162339402 470718082 1643891464 1610941472 356056996 1075131217 2213545259 576402235 834196576 1717551702 1093639311 831244954 235654084 3813877531 3251306942 653088953 2532368753 396186682 4215464348 3719338458 3221031948 2039925421 1417546147 255 362436" option to reproduce the execution
0.00/0.05	c #vars 6090
0.00/0.05	c #constraints 204
1275.15/1275.45	toysat: out of memory (requested 244318208 bytes)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103745-1466238924/watcher-4103745-1466238924 -o /tmp/evaluation-result-4103745-1466238924/solver-4103745-1466238924 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node130-1466206066-12999 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103745-1466238924.opb 

pid=18059
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.19 2.24 2.19 2/179 18062
/proc/meminfo: memFree=17852556/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=761276 CPUtime=0 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 2851 0 0 0 0 0 0 0 20 0 4 0 25939145 779546624 2700 33554432000 4194304 16246674 140736432428080 140736432427504 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 191087 2708 441 2943 0 187981 0
[pid=18062/tid=18063] ppid=18059 vsize=778684 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 797372416 2768 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=782780 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 801566720 2783 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=787900 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25939146 806809600 2803 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100172 s]
/proc/loadavg: 2.19 2.24 2.19 2/179 18062
/proc/meminfo: memFree=17852556/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1220164 CPUtime=0.08 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 26822 0 0 0 5 3 0 0 20 0 4 0 25939145 1249447936 26609 33554432000 4194304 16246674 140736432428080 140736432410848 12652961 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 305041 26616 821 2943 0 301935 0
[pid=18062/tid=18063] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 26621 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 26626 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 26631 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1220164

[startup+0.200523 s]
/proc/loadavg: 2.19 2.24 2.19 2/179 18062
/proc/meminfo: memFree=17852556/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1220164 CPUtime=0.19 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 50571 0 0 0 11 8 0 0 20 0 4 0 25939145 1249447936 50359 33554432000 4194304 16246674 140736432428080 140736432410848 12654533 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 305041 50375 835 2943 0 301935 0
[pid=18062/tid=18063] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 50386 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 50397 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 50406 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1220164

[startup+0.300487 s]
/proc/loadavg: 2.19 2.24 2.19 2/179 18062
/proc/meminfo: memFree=17852556/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1220164 CPUtime=0.29 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 76994 0 0 0 18 11 0 0 20 0 4 0 25939145 1249447936 76781 33554432000 4194304 16246674 140736432428080 140736432409984 12652021 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 305041 76787 835 2943 0 301935 0
[pid=18062/tid=18063] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 76791 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 76797 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 76801 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1220164

[startup+0.700399 s]
/proc/loadavg: 2.19 2.24 2.19 2/179 18062
/proc/meminfo: memFree=17852556/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1220164 CPUtime=0.69 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 172378 0 0 0 45 24 0 0 20 0 4 0 25939145 1249447936 172166 33554432000 4194304 16246674 140736432428080 140736432409984 12449273 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 305041 172180 835 2943 0 301935 0
[pid=18062/tid=18063] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 172189 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 172197 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1249447936 172206 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1220164

[startup+1.50042 s]
/proc/loadavg: 2.18 2.23 2.19 3/183 18066
/proc/meminfo: memFree=16833848/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1330756 CPUtime=1.49 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 273704 0 0 0 110 39 0 0 20 0 4 0 25939145 1362694144 273491 33554432000 4194304 16246674 140736432428080 140736432427392 12429806 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 332689 273491 836 2943 0 329583 0
[pid=18062/tid=18063] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273491 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273491 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273491 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1330756

[startup+3.10041 s]
/proc/loadavg: 2.18 2.23 2.19 4/183 18066
/proc/meminfo: memFree=16759348/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1330756 CPUtime=3.09 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 273822 0 0 0 270 39 0 0 20 0 4 0 25939145 1362694144 273609 33554432000 4194304 16246674 140736432428080 140736432409984 12429784 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 332689 273609 836 2943 0 329583 0
[pid=18062/tid=18063] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273609 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273609 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1330756 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1362694144 273609 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1330756

[startup+6.30033 s]
/proc/loadavg: 2.16 2.23 2.19 4/183 18066
/proc/meminfo: memFree=16759600/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1340996 CPUtime=6.28 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 276382 0 0 0 589 39 0 0 20 0 4 0 25939145 1373179904 276169 33554432000 4194304 16246674 140736432428080 140736432425920 12654379 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 335249 276169 836 2943 0 332143 0
[pid=18062/tid=18063] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1340996

[startup+12.7004 s]
/proc/loadavg: 2.15 2.22 2.19 3/183 18066
/proc/meminfo: memFree=16750040/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1340996 CPUtime=12.68 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 276382 0 0 0 1229 39 0 0 20 0 4 0 25939145 1373179904 276169 33554432000 4194304 16246674 140736432428080 140736432409984 13007864 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 335249 276169 836 2943 0 332143 0
[pid=18062/tid=18063] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1340996 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1373179904 276169 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1340996

[startup+25.5005 s]
/proc/loadavg: 2.13 2.22 2.18 3/183 18066
/proc/meminfo: memFree=14436492/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1727044 CPUtime=25.48 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 379038 0 0 0 2497 51 0 0 20 0 4 0 25939145 1768493056 372681 33554432000 4194304 16246674 140736432428080 140736432425920 13892715 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 431761 372681 836 2943 0 428655 0
[pid=18062/tid=18063] ppid=18059 vsize=1727044 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1768493056 372681 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1727044 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1768493056 372681 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1727044 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1768493056 372681 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1727044

[startup+51.1005 s]
/proc/loadavg: 2.20 2.22 2.19 3/183 18066
/proc/meminfo: memFree=14555376/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=1608260 CPUtime=51.08 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 443294 0 0 0 5046 62 0 0 20 0 4 0 25939145 1646858240 342985 33554432000 4194304 16246674 140736432428080 140736432427392 12429087 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 402065 342985 836 2943 0 398959 0
[pid=18062/tid=18063] ppid=18059 vsize=1608260 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 1646858240 342985 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=1608260 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 1646858240 342985 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=1608260 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 1646858240 342985 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1608260

[startup+102.3 s]
/proc/loadavg: 2.23 2.23 2.19 4/183 18116
/proc/meminfo: memFree=24064976/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=3177028 CPUtime=102.27 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 1063840 0 0 0 10074 153 0 0 20 0 4 0 25939145 3253276672 735179 33554432000 4194304 16246674 140736432428080 140736432425920 4220495 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 794257 735179 837 2943 0 791151 0
[pid=18062/tid=18063] ppid=18059 vsize=3177028 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 3253276672 735179 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=3177028 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 3253276672 735179 33554432000 4194304 16246674 140736432428080 140722343746576 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=3177028 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 3253276672 735179 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 3177028


################
# More data... #
################

/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 14178390016 3402454 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=13846084 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 14178390016 3402454 33554432000 4194304 16246674 140736432428080 140722343746576 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=13846084 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 14178390016 3402454 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1062.08
Current children cumulated vsize (KiB) 13846084

[startup+1122.3 s]
/proc/loadavg: 1.74 2.07 2.14 2/173 18319
/proc/meminfo: memFree=16540544/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=14314052 CPUtime=1122.07 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10600952 0 0 0 110511 1696 0 0 20 0 4 0 25939145 14657589248 3519160 33554432000 4194304 16246674 140736432428080 140736432426048 14016651 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3578513 3519160 842 2943 0 3575407 0
[pid=18062/tid=18063] ppid=18059 vsize=14314052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 14657589248 3519160 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=14314052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 14657589248 3519160 33554432000 4194304 16246674 140736432428080 140722343746576 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=14314052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 14657589248 3519160 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1122.07
Current children cumulated vsize (KiB) 14314052

[startup+1182.3 s]
/proc/loadavg: 1.35 1.90 2.08 2/173 18320
/proc/meminfo: memFree=16325568/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=14989892 CPUtime=1182.06 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10716943 0 0 0 116482 1724 0 0 20 0 4 0 25939145 15349649408 3688295 33554432000 4194304 16246674 140736432428080 140736432427176 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3747473 3688306 842 2943 0 3744367 0
[pid=18062/tid=18063] ppid=18059 vsize=14989892 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15349649408 3688312 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=14989892 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15349649408 3688318 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=14989892 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15349649408 3688324 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1182.06
Current children cumulated vsize (KiB) 14989892

[startup+1242.3 s]
/proc/loadavg: 1.22 1.77 2.02 2/173 18321
/proc/meminfo: memFree=15385548/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15466052 CPUtime=1242.05 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10778244 0 0 0 122468 1737 0 0 20 0 4 0 25939145 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140736432425920 14014061 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3866513 3807339 842 2943 0 3863407 0
[pid=18062/tid=18063] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722343746576 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1242.05
Current children cumulated vsize (KiB) 15466052

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 18062 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1254.4 s]
/proc/loadavg: 1.18 1.74 2.00 2/173 18321
/proc/meminfo: memFree=15385784/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15466052 CPUtime=1254.15 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10778244 0 0 0 123678 1737 0 0 20 0 4 0 25939145 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140736432426048 14014083 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3866513 3807339 842 2943 0 3863407 0
[pid=18062/tid=18063] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722343746576 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807339 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1254.15
Current children cumulated vsize (KiB) 15466052

[startup+1267.2 s]
/proc/loadavg: 1.14 1.70 1.99 2/173 18321
/proc/meminfo: memFree=15385184/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15466052 CPUtime=1266.95 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10778351 0 0 0 124957 1738 0 0 20 0 4 0 25939145 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140736432427176 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3866513 3807446 842 2943 0 3863407 0
[pid=18062/tid=18063] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1266.95
Current children cumulated vsize (KiB) 15466052

[startup+1270.4 s]
/proc/loadavg: 1.14 1.70 1.99 2/173 18321
/proc/meminfo: memFree=15385308/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15466052 CPUtime=1270.15 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10778351 0 0 0 125276 1739 0 0 20 0 4 0 25939145 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140736432427256 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3866513 3807446 842 2943 0 3863407 0
[pid=18062/tid=18063] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1270.15
Current children cumulated vsize (KiB) 15466052

[startup+1273.6 s]
/proc/loadavg: 1.13 1.69 1.98 2/173 18321
/proc/meminfo: memFree=15385432/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15466052 CPUtime=1273.35 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10778351 0 0 0 125595 1740 0 0 20 0 4 0 25939145 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140736432427256 15015658 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3866513 3807446 842 2943 0 3863407 0
[pid=18062/tid=18063] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15466052 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15837237248 3807446 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1273.35
Current children cumulated vsize (KiB) 15466052

[startup+1275.2 s]
/proc/loadavg: 1.13 1.69 1.98 2/173 18321
/proc/meminfo: memFree=15385168/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=15607364 CPUtime=1274.95 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) R 18059 18062 12983 0 -1 4202496 10813521 0 0 0 125750 1745 0 0 20 0 4 0 25939145 15981940736 3842617 33554432000 4194304 16246674 140736432428080 140736432427176 4221016 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 3901841 3842627 842 2943 0 3898735 0
[pid=18062/tid=18063] ppid=18059 vsize=15607364 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18063/stat : 18063 (toysat) S 18059 18062 12983 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25939146 15981940736 3842634 33554432000 4194304 16246674 140736432428080 140722354236656 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=15607364 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) S 18059 18062 12983 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25939146 15981940736 3842640 33554432000 4194304 16246674 140736432428080 140722343746800 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=18062/tid=18065] ppid=18059 vsize=15607364 CPUtime=0 cores=0,2,4,6
/proc/18062/task/18065/stat : 18065 (toysat) S 18059 18062 12983 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25939146 15981940736 3842646 33554432000 4194304 16246674 140736432428080 140722333273264 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1274.95
Current children cumulated vsize (KiB) 15607364

[startup+1276 s]
/proc/loadavg: 1.12 1.68 1.98 2/171 18321
/proc/meminfo: memFree=24400176/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=0 CPUtime=1275.75 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) Z 18059 18062 12983 0 -1 4202508 10839083 0 0 0 125771 1804 0 0 20 0 2 0 25939145 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 0 0 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=0 CPUtime=0.54 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) R 18059 18062 12983 0 -1 4203588 8 0 0 0 0 54 0 0 20 0 2 0 25939146 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1275.75
Current children cumulated vsize (KiB) 0

[startup+1276.2 s]
/proc/loadavg: 1.12 1.68 1.98 2/171 18321
/proc/meminfo: memFree=24400176/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=0 CPUtime=1275.94 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) Z 18059 18062 12983 0 -1 4202508 10839083 0 0 0 125771 1823 0 0 20 0 2 0 25939145 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 0 0 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=0 CPUtime=0.74 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) R 18059 18062 12983 0 -1 4203588 8 0 0 0 0 74 0 0 20 0 2 0 25939146 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1275.94
Current children cumulated vsize (KiB) 0

[startup+1276.3 s]
/proc/loadavg: 1.12 1.68 1.98 2/171 18321
/proc/meminfo: memFree=24400176/32872528 swapFree=1286400/1433568
[pid=18062] ppid=18059 vsize=0 CPUtime=1276.04 cores=0,2,4,6
/proc/18062/stat : 18062 (toysat) Z 18059 18062 12983 0 -1 4202508 10839083 0 0 0 125771 1833 0 0 20 0 2 0 25939145 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/18062/statm: 0 0 0 0 0 0 0
[pid=18062/tid=18064] ppid=18059 vsize=0 CPUtime=0.84 cores=0,2,4,6
/proc/18062/task/18064/stat : 18064 (toysat) R 18059 18062 12983 0 -1 4203588 8 0 0 0 0 84 0 0 20 0 2 0 25939146 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1276.04
Current children cumulated vsize (KiB) 0

Child status: 1
Real time (s): 1276.35
CPU time (s): 1276.1
CPU user time (s): 1257.72
CPU system time (s): 18.3872
CPU usage (%): 99.9805
Max. virtual memory (cumulated for all children) (KiB): 15709764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1257.72
system time used= 18.3872
maximum resident set size= 15472712
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10839083
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 696
involuntary context switches= 1342

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.59615 second user time and 6.35503 second system time

The end

Launcher Data 

Begin job on node130 at 2016-06-18 10:35:24
IDJOB=4103745
IDBENCH=2450
IDSOLVER=2542
FILE ID=node130/4103745-1466238924
RUNJOBID= node130-1466206066-12999
PBS_JOBID= 19918147
Free space on /tmp= 71732 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-sc205.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103745-1466238924/watcher-4103745-1466238924 -o /tmp/evaluation-result-4103745-1466238924/solver-4103745-1466238924 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node130-1466206066-12999 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103745-1466238924.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cfa0de6a5c077caf94404f012a430180
RANDOM SEED=238061394

node130.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.365
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        17853192 kB
Buffers:            1664 kB
Cached:            70960 kB
SwapCached:         1796 kB
Active:         12811488 kB
Inactive:          17068 kB
Active(anon):   12756192 kB
Inactive(anon):     1872 kB
Active(file):      55296 kB
Inactive(file):    15196 kB
Unevictable:     1433568 kB
Mlocked:         1286400 kB
SwapTotal:      67108856 kB
SwapFree:       67096720 kB
Dirty:             16316 kB
Writeback:             0 kB
AnonPages:      14270356 kB
Mapped:             8348 kB
Shmem:                 0 kB
Slab:             597640 kB
SReclaimable:      41172 kB
SUnreclaim:       556468 kB
KernelStack:        1504 kB
PageTables:        31884 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   14334756 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    231424 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71732 MiB
End job on node130 at 2016-06-18 10:56:40