Trace number 3257338

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? 4800.07 1206.18

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_12_2_4_cmp.cnf
MD5SUM7ea97a36d5ab6c8a5aa99830d5253591
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark62.0956
Satisfiable
(Un)Satisfiability was proved
Number of variables12584
Number of clauses155712
Sum of the clauses size523920
Maximum clause length100
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 217404
Number of clauses of size 3103200
Number of clauses of size 417828
Number of clauses of size 517000
Number of clauses of size over 5280

Solver Data 

0.09/0.17	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257338-1304045223.cnf 
0.09/0.17	c Using SATTIMEOUT of 4800
0.09/0.17	c Using SATRAM of 15500
0.09/0.17	c Size of subset node = 32
0.09/0.17	c Variables = 12584
0.09/0.17	c Clauses = 155712
0.09/0.17	c Literals = 523920
0.09/0.17	c Reduced size:
0.09/0.17	c Variables = 12584
0.09/0.17	c Clauses = 155712
0.09/0.17	c Literals = 523920
0.09/0.17	c a2
0.49/0.57	c a1
2.10/2.16	c Independent sub-problems = 1
2.10/2.16	c Sub-problem with 12584 variables and 155712 clauses
2.10/2.16	c using permutation method 4
2.10/2.16	c count = 1
2.10/2.16	c Ordering finished 2.130 seconds
2.10/2.16	c mapped 2.160 seconds
2.10/2.16	c permuted 2.160 seconds
2.10/2.16	c about to sort
2.10/2.18	c sorted
2.49/2.57	c clauses now 155712
2.49/2.57	c init finished 2.300 seconds
2.49/2.57	c tree built 2.560 seconds
2.49/2.57	c 
2.49/2.57	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
2.49/2.57	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
2.49/2.57	c ................................ | ..........                    |                                  2.6         0.0             
2.49/2.58	c ................................ | ..........                  1 |                                  2.6         0.4             
2.49/2.58	c ................................ | ..........                  2 |                                  2.6         0.8             
2.49/2.58	c ................................ | ..........                  3 |                                  2.6         1.2             
2.49/2.58	c ................................ | ..........                  4 |                                  2.6         1.6             
2.49/2.58	c ................................ | ..........                  5 |                                  2.6         1.9             
2.49/2.58	c ................................ | ..........               1000 |              53                  2.6       384.6          988
95.98/26.21	c ................................ | ..........            2518000 | 10943        188302             96.0     26226.4       553966
192.02/50.30	c ................................ | ..........            4612000 | 14131        218497            192.0     24018.3       618992
287.66/74.38	c ................................ | ..........            6697000 | 17501        247800            288.0     23253.5       652566
383.75/98.46	c ................................ | ..........            8787000 | 21192        278555            384.0     22882.2       672993
479.83/122.54	c ................................ | *.........           10897000 | 24156        310865            480.0     22701.1       727430
575.89/146.63	c ................................ | *.........           12986000 | 27699        341504            576.0     22544.4       762956
672.00/170.73	c ................................ | *.........           15078000 | 31230        372116            672.1     22433.8       780458
767.69/194.78	c ................................ | *.........           17178000 | 34369        404057            768.0     22367.2       794443
863.76/218.87	c ................................ | *.........           19286000 | 37817        434201            864.0     22320.7       803024
959.80/242.95	c ................................ | **........           21380000 | 41083        465811            960.0     22270.1       815129
1055.86/267.03	c ................................ | **........           23464000 | 44470        497246           1056.0     22219.7       830010
1151.96/291.11	c ................................ | **........           25555000 | 47856        527733           1152.0     22183.0       841198
1247.65/315.18	c ................................ | **........           27658000 | 51180        558863           1248.0     22161.7       856128
1343.74/339.27	c ................................ | **........           29765000 | 54652        589690           1344.0     22146.1       865634
1439.85/363.34	c ................................ | ***.......           31859000 | 58061        620499           1440.0     22123.8       875709
1535.94/387.42	c ................................ | ***.......           33959000 | 61069        652545           1536.0     22108.4       896989
1631.66/411.49	c ................................ | ***.......           36046000 | 64469        683069           1632.0     22086.7       909524
1727.73/435.57	c ................................ | ***.......           38131000 | 68126        713584           1728.0     22066.6       921089
1823.80/459.65	c ................................ | ***.......           40239000 | 71256        745327           1824.0     22060.5       921210
1919.88/483.73	c ................................ | ****......           42344000 | 74693        775377           1920.0     22053.9       921210
2015.99/507.82	c ................................ | ****......           44435000 | 77918        807500           2016.1     22040.4       934518
2111.63/531.89	c ................................ | ****......           46522000 | 81343        838999           2112.0     22027.3       940101
2207.71/555.97	c ................................ | ****......           48620000 | 84739        869580           2208.0     22019.7       946836
2303.77/580.05	c ................................ | ****......           50720000 | 88016        900684           2304.0     22013.8      1000050
2399.86/604.15	c ................................ | *****.....           52790000 | 91344        932184           2400.1     21995.1      1039367
2495.94/628.21	c ................................ | *****.....           54866000 | 94707        962534           2496.0     21981.6      1069317
2592.05/652.32	c ................................ | *****.....           56960000 | 98068        993524           2592.1     21974.4      1091042
2687.71/676.37	c ................................ | *****.....           59059000 | 101348       1025076          2688.0     21971.4      1100999
2783.75/700.47	c ................................ | *****.....           61157000 | 104748       1055914          2784.1     21966.8      1106962
2879.83/724.54	c ................................ | ******....           63269000 | 108193       1087357          2880.0     21968.4      1113188
2976.00/748.60	c ................................ | ******....           65399000 | 111605       1120580          2976.0     21975.3      1114615
3071.81/772.64	c ................................ | ******....           67513000 | 115103       1154058          3072.0     21976.9      1117138
3167.68/796.68	c ................................ | ******....           69645000 | 118279       1189846          3168.0     21983.8      1118545
3263.94/820.73	c ................................ | ******....           71775000 | 121758       1223470          3264.1     21989.6      1118858
3360.05/844.83	c ................................ | *******...           73289000 | 129240       1263995          3360.2     21811.2      1807544
3455.78/868.88	c ................................ | *******...           74184000 | 139900       1286193          3456.1     21464.5      2643579
3551.91/892.93	c ................................ | *******...           75041000 | 149342       1308102          3552.0     21126.2      2924289
3647.62/916.99	c ................................ | *******...           75866000 | 158953       1330920          3648.0     20796.6      3039288
3743.72/941.09	c ................................ | *******...           76688000 | 168450       1353188          3744.1     20482.5      3122930
3839.83/965.14	c ................................ | ********..           77532000 | 177941       1375088          3840.0     20190.6      3417269
3935.95/989.34	c ................................ | ********..           79090000 | 189398       1479521          3936.1     20093.4      4026685
4032.00/1013.42	c ................................ | ********..           79974000 | 198104       1502377          4032.1     19834.3      4604674
4127.69/1037.48	c ................................ | ********..           80817000 | 205391       1522914          4128.0     19577.7      4931152
4224.01/1061.71	c ................................ | ********..           81651000 | 212300       1543690          4224.1     19330.0      4937335
4319.79/1085.77	c ................................ | *********.           82518000 | 220033       1566451          4320.1     19101.1      5034228
4415.89/1109.85	c ................................ | *********.           83388000 | 226927       1587868          4416.1     18882.8      5042880
4512.00/1133.90	c ................................ | *********.           84222000 | 233685       1608363          4512.0     18666.1      5051428
4607.86/1157.93	c ................................ | *********.           85058000 | 240503       1630517          4608.0     18458.7      5052100
4703.70/1181.98	c ................................ | *********.           85974000 | 248036       1660487          4704.0     18276.7      5102915
4799.83/1206.15	c CPU limit (4800) reached
4799.83/1206.15	c Time = 4800.04 seconds
4799.83/1206.15	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257338-1304045223/watcher-3257338-1304045223 -o /tmp/evaluation-result-3257338-1304045223/solver-3257338-1304045223 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257338-1304045223.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.95 7.97 7.81 6/185 18286
/proc/meminfo: memFree=24584108/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=8840 CPUtime=0 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 284 0 0 0 0 0 0 0 25 0 1 0 516120522 9052160 226 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335437782 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 2210 228 146 36 0 115 0

[startup+0.0357459 s]
/proc/loadavg: 7.95 7.97 7.81 6/185 18286
/proc/meminfo: memFree=24584108/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=12628 CPUtime=0.03 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 1210 0 0 0 3 0 0 0 25 0 1 0 516120522 12931072 1152 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335553221 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 3157 1153 148 36 0 1062 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 12628

[startup+0.100734 s]
/proc/loadavg: 7.95 7.97 7.81 6/185 18286
/proc/meminfo: memFree=24584108/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=20648 CPUtime=0.09 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 3169 0 0 0 9 0 0 0 25 0 1 0 516120522 21143552 3111 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335553221 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 5162 3112 148 36 0 3067 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 20648

[startup+0.300698 s]
/proc/loadavg: 7.95 7.97 7.81 6/185 18286
/proc/meminfo: memFree=24584108/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=82764 CPUtime=0.29 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 17950 0 0 0 27 2 0 0 25 0 1 0 516120522 84750336 17820 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206976 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 20691 17820 210 36 0 18596 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 82764

[startup+0.70064 s]
/proc/loadavg: 7.95 7.97 7.81 6/185 18286
/proc/meminfo: memFree=24584108/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=82652 CPUtime=0.69 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 18624 0 0 0 67 2 0 0 25 0 1 0 516120522 84635648 17883 33554432000 4194304 4338100 140735928095552 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 20663 17883 211 36 0 18568 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 82652

[startup+1.50049 s]
/proc/loadavg: 7.95 7.97 7.81 6/186 18287
/proc/meminfo: memFree=24504872/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=82652 CPUtime=1.49 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) R 18284 18286 18211 0 -1 4202496 18625 0 0 0 147 2 0 0 25 0 1 0 516120522 84635648 17884 33554432000 4194304 4338100 140735928095552 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/18286/statm: 20663 17884 212 36 0 18568 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 82652

[startup+3.10017 s]
/proc/loadavg: 7.71 7.92 7.80 6/186 18287
/proc/meminfo: memFree=24497680/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=484644 CPUtime=4.6 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 59694 0 0 0 442 18 0 0 25 0 5 0 516120522 496275456 58591 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 121161 58591 176 36 0 119066 0
Current children cumulated CPU time (s) 4.6
Current children cumulated vsize (KiB) 484644

[startup+6.3006 s]
/proc/loadavg: 7.71 7.92 7.80 9/190 18291
/proc/meminfo: memFree=24310912/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=485568 CPUtime=17.2 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 60640 0 0 0 1651 69 0 0 25 0 5 0 516120522 497221632 59537 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 121392 59537 176 36 0 119297 0
[pid=18286/tid=18288] ppid=18284 vsize=485568 CPUtime=3.7 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 1616 0 0 0 360 10 0 0 18 0 5 0 516120780 497221632 59537 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335890491 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=485568 CPUtime=3.62 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 1629 0 0 0 344 18 0 0 18 0 5 0 516120780 497221632 59537 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=485568 CPUtime=3.64 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 1852 0 0 0 347 17 0 0 18 0 5 0 516120780 497221632 59537 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718004 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=485568 CPUtime=3.63 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 1722 0 0 0 346 17 0 0 18 0 5 0 516120780 497221632 59537 33554432000 4194304 4338100 140735928095552 18446744073709551615 4286520 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 17.2
Current children cumulated vsize (KiB) 485568

[startup+12.7005 s]
/proc/loadavg: 7.91 7.96 7.81 10/190 18291
/proc/meminfo: memFree=24261628/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=490544 CPUtime=42.4 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 63261 0 0 0 4063 177 0 0 25 0 5 0 516120522 502317056 62158 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 122636 62158 176 36 0 120541 0
[pid=18286/tid=18288] ppid=18284 vsize=490544 CPUtime=10.09 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 2077 0 0 0 982 27 0 0 18 0 5 0 516120780 502317056 62158 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=490544 CPUtime=9.88 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 2268 0 0 0 941 47 0 0 19 0 5 0 516120780 502317056 62158 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287577 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=490544 CPUtime=9.93 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 2598 0 0 0 945 48 0 0 18 0 5 0 516120780 502317056 62158 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287325 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=490544 CPUtime=9.9 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 2497 0 0 0 942 48 0 0 18 0 5 0 516120780 502317056 62158 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335589034 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 42.4
Current children cumulated vsize (KiB) 490544

[startup+25.5012 s]
/proc/loadavg: 7.93 7.96 7.81 9/190 18291
/proc/meminfo: memFree=24164908/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=507096 CPUtime=93.19 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 68335 0 0 0 9036 283 0 0 25 0 5 0 516120522 519266304 67232 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 126774 67232 176 36 0 124679 0
[pid=18286/tid=18288] ppid=18284 vsize=507096 CPUtime=22.88 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3199 0 0 0 2244 44 0 0 18 0 5 0 516120780 519266304 67232 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=507096 CPUtime=22.56 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3397 0 0 0 2180 76 0 0 18 0 5 0 516120780 519266304 67232 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=507096 CPUtime=22.55 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4063 0 0 0 2179 76 0 0 25 0 5 0 516120780 519266304 67232 33554432000 4194304 4338100 140735928095552 18446744073709551615 4288130 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=507096 CPUtime=22.59 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3855 0 0 0 2180 79 0 0 25 0 5 0 516120780 519266304 67232 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 93.19
Current children cumulated vsize (KiB) 507096

[startup+51.1006 s]
/proc/loadavg: 8.25 8.02 7.84 9/190 18292
/proc/meminfo: memFree=24019504/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=510884 CPUtime=195.2 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 69167 0 0 0 19160 360 0 0 25 0 5 0 516120522 523145216 68064 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 127721 68064 176 36 0 125626 0
[pid=18286/tid=18288] ppid=18284 vsize=510884 CPUtime=48.47 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3381 0 0 0 4789 58 0 0 25 0 5 0 516120780 523145216 68064 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287721 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=510884 CPUtime=48.07 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3600 0 0 0 4709 98 0 0 18 0 5 0 516120780 523145216 68064 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287724 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=510884 CPUtime=47.94 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4293 0 0 0 4700 94 0 0 20 0 5 0 516120780 523145216 68064 33554432000 4194304 4338100 140735928095552 18446744073709551615 4257952 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=510884 CPUtime=48.11 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4072 0 0 0 4709 102 0 0 20 0 5 0 516120780 523145216 68064 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287738 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 195.2
Current children cumulated vsize (KiB) 510884

[startup+102.307 s]
/proc/loadavg: 8.10 8.02 7.84 9/190 18293
/proc/meminfo: memFree=23747436/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=514276 CPUtime=399.32 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 69903 0 0 0 39455 477 0 0 25 0 5 0 516120522 526618624 68800 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 128569 68801 176 36 0 126474 0
[pid=18286/tid=18288] ppid=18284 vsize=514276 CPUtime=99.43 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3498 0 0 0 9864 79 0 0 25 0 5 0 516120780 526618624 68801 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287423 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=514276 CPUtime=99.09 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3750 0 0 0 9773 136 0 0 18 0 5 0 516120780 526618624 68801 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287730 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=514276 CPUtime=98.93 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4566 0 0 0 9763 130 0 0 18 0 5 0 516120780 526618624 68801 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287348 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=514276 CPUtime=99.26 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4269 0 0 0 9801 125 0 0 25 0 5 0 516120780 526618624 68801 33554432000 4194304 4338100 140735928095552 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 399.32
Current children cumulated vsize (KiB) 514276

[startup+162.301 s]
/proc/loadavg: 8.17 8.06 7.86 9/190 18295
/proc/meminfo: memFree=23486772/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=517404 CPUtime=638.52 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 70871 0 0 0 63257 595 0 0 25 0 5 0 516120522 529821696 69768 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 129351 69768 176 36 0 127256 0
[pid=18286/tid=18288] ppid=18284 vsize=517404 CPUtime=159.09 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3553 0 0 0 15822 87 0 0 25 0 5 0 516120780 529821696 69768 33554432000 4194304 4338100 140735928095552 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=517404 CPUtime=158.88 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3972 0 0 0 15710 178 0 0 21 0 5 0 516120780 529821696 69768 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=517404 CPUtime=158.69 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4988 0 0 0 15696 173 0 0 18 0 5 0 516120780 529821696 69768 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=517404 CPUtime=159.25 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4537 0 0 0 15776 149 0 0 25 0 5 0 516120780 529821696 69768 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 638.52
Current children cumulated vsize (KiB) 517404

[startup+222.3 s]
/proc/loadavg: 8.06 8.04 7.87 9/190 18296
/proc/meminfo: memFree=23252516/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=520532 CPUtime=877.67 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 71372 0 0 0 87061 706 0 0 25 0 5 0 516120522 533024768 70269 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 130133 70269 176 36 0 128038 0
[pid=18286/tid=18288] ppid=18284 vsize=520532 CPUtime=218.75 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 3561 0 0 0 21783 92 0 0 25 0 5 0 516120780 533024768 70269 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288201 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=520532 CPUtime=218.64 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4127 0 0 0 21643 221 0 0 18 0 5 0 516120780 533024768 70269 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=520532 CPUtime=218.45 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 5189 0 0 0 21630 215 0 0 18 0 5 0 516120780 533024768 70269 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335588784 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=520532 CPUtime=219.23 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 4674 0 0 0 21752 171 0 0 18 0 5 0 516120780 533024768 70269 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288034 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 877.67
Current children cumulated vsize (KiB) 520532

################
# More data... #
################

/proc/loadavg: 8.60 8.32 8.10 10/191 18331
/proc/meminfo: memFree=21054984/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=663552 CPUtime=4226.38 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 111950 0 0 0 420326 2312 0 0 25 0 5 0 516120522 679477248 110847 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 165888 110847 176 36 0 163793 0
[pid=18286/tid=18288] ppid=18284 vsize=663552 CPUtime=1054.79 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 11537 0 0 0 105137 342 0 0 25 0 5 0 516120780 679477248 110847 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335588849 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=663552 CPUtime=1056.28 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 11769 0 0 0 104960 668 0 0 25 0 5 0 516120780 679477248 110847 33554432000 4194304 4338100 140735928095552 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=663552 CPUtime=1055.17 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 19502 0 0 0 104786 731 0 0 25 0 5 0 516120780 679477248 110847 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287742 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=663552 CPUtime=1057.52 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 15321 0 0 0 105189 563 0 0 25 0 5 0 516120780 679477248 110847 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287521 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4226.38
Current children cumulated vsize (KiB) 663552

[startup+1122.3 s]
/proc/loadavg: 8.55 8.35 8.12 9/190 18332
/proc/meminfo: memFree=20964888/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=667960 CPUtime=4465.71 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 113387 0 0 0 444125 2446 0 0 25 0 5 0 516120522 683991040 112284 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 166990 112284 176 36 0 164895 0
[pid=18286/tid=18288] ppid=18284 vsize=667960 CPUtime=1114.66 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12277 0 0 0 111085 381 0 0 18 0 5 0 516120780 683991040 112284 33554432000 4194304 4338100 140735928095552 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=667960 CPUtime=1116.27 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12072 0 0 0 110936 691 0 0 22 0 5 0 516120780 683991040 112284 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=667960 CPUtime=1115.06 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 19829 0 0 0 110735 771 0 0 18 0 5 0 516120780 683991040 112284 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=667960 CPUtime=1117.12 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 15388 0 0 0 111116 596 0 0 21 0 5 0 516120780 683991040 112284 33554432000 4194304 4338100 140735928095552 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4465.71
Current children cumulated vsize (KiB) 667960

[startup+1182.3 s]
/proc/loadavg: 8.26 8.28 8.11 9/190 18366
/proc/meminfo: memFree=24663296/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=667960 CPUtime=4705.28 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 114118 0 0 0 468011 2517 0 0 25 0 5 0 516120522 683991040 113015 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 166990 113015 176 36 0 164895 0
[pid=18286/tid=18288] ppid=18284 vsize=667960 CPUtime=1174.62 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12434 0 0 0 117051 411 0 0 18 0 5 0 516120780 683991040 113015 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=667960 CPUtime=1176.27 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12229 0 0 0 116929 698 0 0 18 0 5 0 516120780 683991040 113015 33554432000 4194304 4338100 140735928095552 18446744073709551615 4285817 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=667960 CPUtime=1175.01 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 20146 0 0 0 116707 794 0 0 18 0 5 0 516120780 683991040 113015 33554432000 4194304 4338100 140735928095552 18446744073709551615 4241570 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=667960 CPUtime=1176.76 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 15488 0 0 0 117070 606 0 0 18 0 5 0 516120780 683991040 113015 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4705.28
Current children cumulated vsize (KiB) 667960

Solver just ended. Dumping a history of the last processes samples

[startup+1190.3 s]
/proc/loadavg: 8.40 8.31 8.12 9/190 18366
/proc/meminfo: memFree=24616792/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=680736 CPUtime=4736.86 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 116842 0 0 0 471058 2628 0 0 25 0 5 0 516120522 697073664 115739 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170184 115739 176 36 0 168089 0
[pid=18286/tid=18288] ppid=18284 vsize=680736 CPUtime=1182.49 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12964 0 0 0 117805 444 0 0 18 0 5 0 516120780 697073664 115739 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718004 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=680736 CPUtime=1184.26 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) S 18284 18286 18211 0 -1 4202560 12874 0 0 0 117711 715 0 0 19 0 5 0 516120780 697073664 115739 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718004 0 0 4096 0 18446604453979866304 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=680736 CPUtime=1182.89 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21152 0 0 0 117463 826 0 0 18 0 5 0 516120780 697073664 115739 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347718325 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=680736 CPUtime=1184.61 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16031 0 0 0 117825 636 0 0 21 0 5 0 516120780 697073664 115739 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347705038 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4736.86
Current children cumulated vsize (KiB) 680736

[startup+1196.7 s]
/proc/loadavg: 8.34 8.30 8.12 9/190 18366
/proc/meminfo: memFree=24594344/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=680736 CPUtime=4762.38 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 116935 0 0 0 473588 2650 0 0 25 0 5 0 516120522 697073664 115832 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170184 115832 176 36 0 168089 0
[pid=18286/tid=18288] ppid=18284 vsize=680736 CPUtime=1188.87 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12985 0 0 0 118437 450 0 0 21 0 5 0 516120780 697073664 115832 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287692 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=680736 CPUtime=1190.66 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12901 0 0 0 118348 718 0 0 18 0 5 0 516120780 697073664 115832 33554432000 4194304 4338100 140735928095552 18446744073709551615 4253933 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=680736 CPUtime=1189.27 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21179 0 0 0 118095 832 0 0 20 0 5 0 516120780 697073664 115832 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=680736 CPUtime=1190.96 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16049 0 0 0 118454 642 0 0 18 0 5 0 516120780 697073664 115832 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4762.38
Current children cumulated vsize (KiB) 680736

[startup+1203.1 s]
/proc/loadavg: 8.31 8.30 8.11 9/190 18367
/proc/meminfo: memFree=24572768/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=680868 CPUtime=4787.86 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 116981 0 0 0 476120 2666 0 0 25 0 5 0 516120522 697208832 115878 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170217 115878 176 36 0 168122 0
[pid=18286/tid=18288] ppid=18284 vsize=680868 CPUtime=1195.25 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12997 0 0 0 119070 455 0 0 18 0 5 0 516120780 697208832 115878 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287521 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=680868 CPUtime=1197.05 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12913 0 0 0 118984 721 0 0 18 0 5 0 516120780 697208832 115878 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287724 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=680868 CPUtime=1195.65 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21189 0 0 0 118728 837 0 0 18 0 5 0 516120780 697208832 115878 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=680868 CPUtime=1197.31 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16061 0 0 0 119086 645 0 0 20 0 5 0 516120780 697208832 115878 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335589096 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4787.86
Current children cumulated vsize (KiB) 680868

[startup+1204.7 s]
/proc/loadavg: 8.31 8.30 8.11 10/190 18367
/proc/meminfo: memFree=24565576/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=683996 CPUtime=4794.24 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 116997 0 0 0 476753 2671 0 0 25 0 5 0 516120522 700411904 115894 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170999 115894 176 36 0 168904 0
[pid=18286/tid=18288] ppid=18284 vsize=683996 CPUtime=1196.83 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12999 0 0 0 119227 456 0 0 21 0 5 0 516120780 700411904 115894 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287712 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=683996 CPUtime=1198.65 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12917 0 0 0 119143 722 0 0 21 0 5 0 516120780 700411904 115894 33554432000 4194304 4338100 140735928095552 18446744073709551615 4253888 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=683996 CPUtime=1197.25 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21194 0 0 0 118886 839 0 0 21 0 5 0 516120780 700411904 115894 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335589088 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=683996 CPUtime=1198.91 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16066 0 0 0 119244 647 0 0 18 0 5 0 516120780 700411904 115894 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206902 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4794.24
Current children cumulated vsize (KiB) 683996

[startup+1205.5 s]
/proc/loadavg: 8.31 8.30 8.11 9/190 18367
/proc/meminfo: memFree=24560368/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=683996 CPUtime=4797.45 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 117002 0 0 0 477070 2675 0 0 25 0 5 0 516120522 700411904 115899 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170999 115899 176 36 0 168904 0
[pid=18286/tid=18288] ppid=18284 vsize=683996 CPUtime=1197.63 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 13001 0 0 0 119306 457 0 0 24 0 5 0 516120780 700411904 115899 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288034 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=683996 CPUtime=1199.46 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12918 0 0 0 119223 723 0 0 25 0 5 0 516120780 700411904 115899 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=683996 CPUtime=1198.05 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21195 0 0 0 118965 840 0 0 25 0 5 0 516120780 700411904 115899 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=683996 CPUtime=1199.71 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16067 0 0 0 119323 648 0 0 19 0 5 0 516120780 700411904 115899 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287312 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4797.45
Current children cumulated vsize (KiB) 683996

[startup+1205.9 s]
/proc/loadavg: 8.31 8.30 8.11 9/190 18367
/proc/meminfo: memFree=24560368/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=683996 CPUtime=4799.03 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 117004 0 0 0 477227 2676 0 0 25 0 5 0 516120522 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170999 115901 176 36 0 168904 0
[pid=18286/tid=18288] ppid=18284 vsize=683996 CPUtime=1198.02 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 13001 0 0 0 119345 457 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 4285738 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=683996 CPUtime=1199.85 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12919 0 0 0 119262 723 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=683996 CPUtime=1198.45 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21196 0 0 0 119004 841 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=683996 CPUtime=1200.1 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16067 0 0 0 119362 648 0 0 19 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335288046 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4799.03
Current children cumulated vsize (KiB) 683996

[startup+1206.1 s]
/proc/loadavg: 8.31 8.30 8.11 9/190 18367
/proc/meminfo: memFree=24560368/32951124 swapFree=67111524/67111528
[pid=18286] ppid=18284 vsize=683996 CPUtime=4799.83 cores=0,2,4,6
/proc/18286/stat : 18286 (ttsth-5-4) S 18284 18286 18211 0 -1 4202496 117004 0 0 0 477305 2678 0 0 25 0 5 0 516120522 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 232347695077 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18286/statm: 170999 115901 176 36 0 168904 0
[pid=18286/tid=18288] ppid=18284 vsize=683996 CPUtime=1198.22 cores=0,2,4,6
/proc/18286/task/18288/stat : 18288 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 13001 0 0 0 119364 458 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 4253962 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=18286/tid=18289] ppid=18284 vsize=683996 CPUtime=1200.05 cores=0,2,4,6
/proc/18286/task/18289/stat : 18289 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 12919 0 0 0 119282 723 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=18286/tid=18290] ppid=18284 vsize=683996 CPUtime=1198.65 cores=0,2,4,6
/proc/18286/task/18290/stat : 18290 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 21196 0 0 0 119024 841 0 0 25 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 4206902 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=18286/tid=18291] ppid=18284 vsize=683996 CPUtime=1200.3 cores=0,2,4,6
/proc/18286/task/18291/stat : 18291 (ttsth-5-4) R 18284 18286 18211 0 -1 4202560 16067 0 0 0 119382 648 0 0 20 0 5 0 516120780 700411904 115901 33554432000 4194304 4338100 140735928095552 18446744073709551615 232335287428 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4799.83
Current children cumulated vsize (KiB) 683996

Child status: 0
Real time (s): 1206.18
CPU time (s): 4800.07
CPU user time (s): 4773.27
CPU system time (s): 26.8039
CPU usage (%): 397.958
Max. virtual memory (cumulated for all children) (KiB): 683996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4773.27
system time used= 26.8039
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 117007
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 249230
involuntary context switches= 80801

runsolver used 1.9447 second user time and 4.63729 second system time

The end

Launcher Data 

Begin job on node132 at 2011-04-29 04:47:04
IDJOB=3257338
IDBENCH=70908
IDSOLVER=1654
FILE ID=node132/3257338-1304045223
RUNJOBID= node132-1304045149-18229
PBS_JOBID= 13170396
Free space on /tmp= 71868 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_12_2_4_cmp.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257338-1304045223/watcher-3257338-1304045223 -o /tmp/evaluation-result-3257338-1304045223/solver-3257338-1304045223 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257338-1304045223.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7ea97a36d5ab6c8a5aa99830d5253591
RANDOM SEED=1584513301

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24584388 kB
Buffers:        760084 kB
Cached:        6210704 kB
SwapCached:          4 kB
Active:        2693592 kB
Inactive:      5174676 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24584388 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            3552 kB
Writeback:           0 kB
AnonPages:      896936 kB
Mapped:          15328 kB
Slab:           434896 kB
PageTables:       6456 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1087940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71868 MiB
End job on node132 at 2011-04-29 05:07:10