Trace number 3299539

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.41 1201.62

General information on the benchmark

NameSAT02/handmade/simon/satex-challenges/
par32-3.shuffled.cnf
MD5SUM0115a0e26236f3f01aa829c2004452c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.6469
Satisfiable
(Un)Satisfiability was proved
Number of variables3176
Number of clauses10297
Sum of the clauses size27581
Maximum clause length3
Minimum clause length1
Number of clauses of size 1141
Number of clauses of size 23028
Number of clauses of size 37128
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...107634/instance-3299539-1304107634.cnf
0.00/0.02	c Solving...
4800.36/1201.61	
4800.36/1201.61	*** INTERRUPTED! ***
4800.36/1201.61	*** Shutting down threads...
4800.36/1201.62	s UNKNOWN
4800.36/1201.62	
4800.36/1201.62	c INTERRUPTED   : 1
4800.36/1201.62	c Models        : 0+    
4800.36/1201.62	c Time          : 1201.609s (Solving: 1201.59s 1st Model: 0.00s Unsat: 0.00s)
4800.36/1201.62	c CPU Time      : 4800.390s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299539-1304107634/watcher-3299539-1304107634 -o /tmp/evaluation-result-3299539-1304107634/solver-3299539-1304107634 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299539-1304107634.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.93 6.63 7.51 3/177 27840
/proc/meminfo: memFree=30916936/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=21896 CPUtime=0 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 790 0 0 0 0 0 0 0 25 0 1 0 522360442 22421504 694 33554432000 4194304 4964704 140736815805184 18446744073709551615 239476694784 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27840/statm: 5474 695 388 189 0 348 0

[startup+0.00753296 s]
/proc/loadavg: 3.93 6.63 7.51 3/177 27840
/proc/meminfo: memFree=30916936/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=22348 CPUtime=0 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 943 0 0 0 0 0 0 0 25 0 1 0 522360442 22884352 817 33554432000 4194304 4964704 140736815805184 18446744073709551615 239476392144 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/27840/statm: 5587 821 399 189 0 461 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 22348

[startup+0.130445 s]
/proc/loadavg: 3.93 6.63 7.51 3/177 27840
/proc/meminfo: memFree=30916936/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=171144 CPUtime=0.42 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 1936 0 0 0 42 0 0 0 25 0 4 0 522360442 175251456 1734 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668505 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 42786 1734 458 189 0 37135 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 171144

[startup+0.300413 s]
/proc/loadavg: 3.93 6.63 7.51 3/177 27840
/proc/meminfo: memFree=30916936/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=171276 CPUtime=1.1 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 2096 0 0 0 110 0 0 0 25 0 4 0 522360442 175386624 1894 33554432000 4194304 4964704 140736815805184 18446744073709551615 4669200 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 42819 1894 458 189 0 37168 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 171276

[startup+0.700337 s]
/proc/loadavg: 3.93 6.63 7.51 3/177 27840
/proc/meminfo: memFree=30916936/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=171672 CPUtime=2.7 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 2426 0 0 0 270 0 0 0 25 0 4 0 522360442 175792128 2224 33554432000 4194304 4964704 140736815805184 18446744073709551615 4320879 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 42918 2225 458 189 0 37267 0
Current children cumulated CPU time (s) 2.7
Current children cumulated vsize (KiB) 171672

[startup+1.50018 s]
/proc/loadavg: 3.93 6.63 7.51 10/184 27847
/proc/meminfo: memFree=30901884/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=172204 CPUtime=5.89 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 2956 0 0 0 589 0 0 0 25 0 4 0 522360442 176336896 2754 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321082 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 43051 2754 458 189 0 37400 0
[pid=27840/tid=27845] ppid=27838 vsize=172204 CPUtime=1.46 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 458 0 0 0 146 0 0 0 25 0 4 0 522360445 176336896 2754 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=172204 CPUtime=1.46 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 574 0 0 0 146 0 0 0 25 0 4 0 522360445 176336896 2754 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668857 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=172204 CPUtime=1.46 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 474 0 0 0 146 0 0 0 25 0 4 0 522360445 176336896 2754 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 172204

[startup+3.10088 s]
/proc/loadavg: 3.93 6.63 7.51 9/184 27848
/proc/meminfo: memFree=30894816/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=174240 CPUtime=12.29 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 3843 0 0 0 1229 0 0 0 25 0 4 0 522360442 178421760 3641 33554432000 4194304 4964704 140736815805184 18446744073709551615 4660415 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 43560 3641 458 189 0 37909 0
[pid=27840/tid=27845] ppid=27838 vsize=174240 CPUtime=3.07 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 701 0 0 0 307 0 0 0 25 0 4 0 522360445 178421760 3641 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=174240 CPUtime=3.06 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 946 0 0 0 306 0 0 0 25 0 4 0 522360445 178421760 3641 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=174240 CPUtime=3.06 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 602 0 0 0 306 0 0 0 25 0 4 0 522360445 178421760 3641 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.29
Current children cumulated vsize (KiB) 174240

[startup+6.30027 s]
/proc/loadavg: 4.25 6.66 7.51 9/184 27848
/proc/meminfo: memFree=30883024/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=174768 CPUtime=25.07 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 4398 0 0 0 2506 1 0 0 25 0 4 0 522360442 178962432 4196 33554432000 4194304 4964704 140736815805184 18446744073709551615 4332355 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 43692 4196 460 189 0 38041 0
[pid=27840/tid=27845] ppid=27838 vsize=174768 CPUtime=6.26 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 835 0 0 0 626 0 0 0 25 0 4 0 522360445 178962432 4196 33554432000 4194304 4964704 140736815805184 18446744073709551615 4653187 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=174768 CPUtime=6.26 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 1075 0 0 0 626 0 0 0 25 0 4 0 522360445 178962432 4196 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=174768 CPUtime=6.24 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 755 0 0 0 624 0 0 0 25 0 4 0 522360445 178962432 4196 33554432000 4194304 4964704 140736815805184 18446744073709551615 4332351 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 174768

[startup+12.701 s]
/proc/loadavg: 4.55 6.68 7.52 9/184 27848
/proc/meminfo: memFree=30874744/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=175428 CPUtime=50.64 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 5061 0 0 0 5063 1 0 0 25 0 4 0 522360442 179638272 4859 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 43857 4859 460 189 0 38206 0
[pid=27840/tid=27845] ppid=27838 vsize=175428 CPUtime=12.66 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 1038 0 0 0 1266 0 0 0 25 0 4 0 522360445 179638272 4859 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321076 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=175428 CPUtime=12.66 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 1331 0 0 0 1266 0 0 0 25 0 4 0 522360445 179638272 4859 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=175428 CPUtime=12.61 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 874 0 0 0 1261 0 0 0 25 0 4 0 522360445 179638272 4859 33554432000 4194304 4964704 140736815805184 18446744073709551615 4332711 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.64
Current children cumulated vsize (KiB) 175428

[startup+25.5006 s]
/proc/loadavg: 5.32 6.74 7.52 9/184 27848
/proc/meminfo: memFree=30867036/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=176732 CPUtime=101.77 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 5796 0 0 0 10175 2 0 0 25 0 4 0 522360442 180973568 5594 33554432000 4194304 4964704 140736815805184 18446744073709551615 239476351982 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 44183 5594 460 189 0 38532 0
[pid=27840/tid=27845] ppid=27838 vsize=176732 CPUtime=25.46 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 1357 0 0 0 2546 0 0 0 25 0 4 0 522360445 180973568 5594 33554432000 4194304 4964704 140736815805184 18446744073709551615 4370236 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=176732 CPUtime=25.46 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 1548 0 0 0 2546 0 0 0 25 0 4 0 522360445 180973568 5594 33554432000 4194304 4964704 140736815805184 18446744073709551615 4627328 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=176732 CPUtime=25.35 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 988 0 0 0 2535 0 0 0 25 0 4 0 522360445 180973568 5594 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668840 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 176732

[startup+51.1007 s]
/proc/loadavg: 6.23 6.84 7.54 9/184 27849
/proc/meminfo: memFree=30858188/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=177652 CPUtime=204.05 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 6532 0 0 0 20401 4 0 0 25 0 4 0 522360442 181915648 6330 33554432000 4194304 4964704 140736815805184 18446744073709551615 4627461 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 44413 6330 460 189 0 38762 0
[pid=27840/tid=27845] ppid=27838 vsize=177652 CPUtime=51.06 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 1726 0 0 0 5105 1 0 0 25 0 4 0 522360445 181915648 6330 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=177652 CPUtime=51.06 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 1799 0 0 0 5105 1 0 0 25 0 4 0 522360445 181915648 6330 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=177652 CPUtime=50.83 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1031 0 0 0 5082 1 0 0 25 0 4 0 522360445 181915648 6330 33554432000 4194304 4964704 140736815805184 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 204.05
Current children cumulated vsize (KiB) 177652

[startup+102.307 s]
/proc/loadavg: 7.33 7.05 7.57 9/184 27850
/proc/meminfo: memFree=30848512/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=179264 CPUtime=408.62 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 7494 0 0 0 40856 6 0 0 25 0 4 0 522360442 183566336 7292 33554432000 4194304 4964704 140736815805184 18446744073709551615 4658292 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 44816 7292 460 189 0 39165 0
[pid=27840/tid=27845] ppid=27838 vsize=179264 CPUtime=102.26 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 2249 0 0 0 10225 1 0 0 25 0 4 0 522360445 183566336 7292 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=179264 CPUtime=102.26 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2054 0 0 0 10225 1 0 0 25 0 4 0 522360445 183566336 7292 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=179264 CPUtime=101.79 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1153 0 0 0 10178 1 0 0 25 0 4 0 522360445 183566336 7292 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 179264

[startup+162.3 s]
/proc/loadavg: 7.81 7.23 7.60 9/184 27852
/proc/meminfo: memFree=30839924/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=179576 CPUtime=648.3 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 8238 0 0 0 64821 9 0 0 25 0 4 0 522360442 183885824 8036 33554432000 4194304 4964704 140736815805184 18446744073709551615 4660367 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 44894 8036 460 189 0 39243 0
[pid=27840/tid=27845] ppid=27838 vsize=179576 CPUtime=162.24 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 2600 0 0 0 16223 1 0 0 25 0 4 0 522360445 183885824 8036 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=179576 CPUtime=162.26 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2224 0 0 0 16224 2 0 0 25 0 4 0 522360445 183885824 8036 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=179576 CPUtime=161.5 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1235 0 0 0 16148 2 0 0 25 0 4 0 522360445 183885824 8036 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 648.3
Current children cumulated vsize (KiB) 179576

[startup+222.301 s]
/proc/loadavg: 8.01 7.39 7.63 9/184 27853
/proc/meminfo: memFree=30833340/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=180416 CPUtime=887.99 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 8867 0 0 0 88787 12 0 0 25 0 4 0 522360442 184745984 8665 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 45104 8665 460 189 0 39453 0
[pid=27840/tid=27845] ppid=27838 vsize=180416 CPUtime=222.24 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 2932 0 0 0 22222 2 0 0 25 0 4 0 522360445 184745984 8665 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=180416 CPUtime=222.26 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2343 0 0 0 22223 3 0 0 25 0 4 0 522360445 184745984 8665 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=180416 CPUtime=221.19 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1362 0 0 0 22117 2 0 0 25 0 4 0 522360445 184745984 8665 33554432000 4194304 4964704 140736815805184 18446744073709551615 4320879 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 887.99
Current children cumulated vsize (KiB) 180416

[startup+282.3 s]

################
# More data... #
################

[pid=27840] ppid=27838 vsize=184244 CPUtime=2565.97 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 11422 0 0 0 256564 33 0 0 25 0 4 0 522360442 188665856 11208 33554432000 4194304 4964704 140736815805184 18446744073709551615 4312134 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46061 11208 460 189 0 40410 0
[pid=27840/tid=27845] ppid=27838 vsize=184244 CPUtime=642.19 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4138 0 0 0 64212 7 0 0 25 0 4 0 522360445 188665856 11208 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668714 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=184244 CPUtime=642.25 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2813 0 0 0 64217 8 0 0 25 0 4 0 522360445 188665856 11208 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=184244 CPUtime=639.23 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1826 0 0 0 63915 8 0 0 25 0 4 0 522360445 188665856 11208 33554432000 4194304 4964704 140736815805184 18446744073709551615 239476362171 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2565.97
Current children cumulated vsize (KiB) 184244

[startup+702.301 s]
/proc/loadavg: 8.14 7.96 7.80 9/184 27866
/proc/meminfo: memFree=30805412/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=184708 CPUtime=2805.65 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 11689 0 0 0 280529 36 0 0 25 0 4 0 522360442 189140992 11475 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46177 11475 460 189 0 40526 0
[pid=27840/tid=27845] ppid=27838 vsize=184708 CPUtime=702.18 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4307 0 0 0 70210 8 0 0 25 0 4 0 522360445 189140992 11475 33554432000 4194304 4964704 140736815805184 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=184708 CPUtime=702.24 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2821 0 0 0 70216 8 0 0 25 0 4 0 522360445 189140992 11475 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=184708 CPUtime=698.93 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1897 0 0 0 69884 9 0 0 25 0 4 0 522360445 189140992 11475 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670179 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.65
Current children cumulated vsize (KiB) 184708

[startup+762.307 s]
/proc/loadavg: 8.17 7.99 7.82 9/184 27868
/proc/meminfo: memFree=30803292/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=184828 CPUtime=3045.36 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 11982 0 0 0 304498 38 0 0 25 0 4 0 522360442 189263872 11768 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46207 11768 460 189 0 40556 0
[pid=27840/tid=27845] ppid=27838 vsize=184828 CPUtime=762.18 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4505 0 0 0 76209 9 0 0 25 0 4 0 522360445 189263872 11768 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=184828 CPUtime=762.25 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2857 0 0 0 76216 9 0 0 25 0 4 0 522360445 189263872 11768 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=184828 CPUtime=758.64 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1938 0 0 0 75855 9 0 0 25 0 4 0 522360445 189263872 11768 33554432000 4194304 4964704 140736815805184 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3045.36
Current children cumulated vsize (KiB) 184828

[startup+822.301 s]
/proc/loadavg: 8.17 8.02 7.84 9/184 27869
/proc/meminfo: memFree=30799436/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=185332 CPUtime=3285.03 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 12248 0 0 0 328462 41 0 0 25 0 4 0 522360442 189779968 12010 33554432000 4194304 4964704 140736815805184 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46333 12010 460 189 0 40682 0
[pid=27840/tid=27845] ppid=27838 vsize=185332 CPUtime=822.17 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4601 0 0 0 82207 10 0 0 25 0 4 0 522360445 189779968 12010 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670062 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=185332 CPUtime=822.24 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2878 0 0 0 82214 10 0 0 25 0 4 0 522360445 189779968 12010 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=185332 CPUtime=818.33 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 1975 0 0 0 81824 9 0 0 25 0 4 0 522360445 189779968 12010 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3285.03
Current children cumulated vsize (KiB) 185332

[startup+882.301 s]
/proc/loadavg: 8.10 8.03 7.85 9/184 27871
/proc/meminfo: memFree=30797676/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=185720 CPUtime=3524.73 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 12481 0 0 0 352430 43 0 0 25 0 4 0 522360442 190177280 12243 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46430 12243 460 189 0 40779 0
[pid=27840/tid=27845] ppid=27838 vsize=185720 CPUtime=882.16 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4753 0 0 0 88206 10 0 0 25 0 4 0 522360445 190177280 12243 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=185720 CPUtime=882.24 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2889 0 0 0 88214 10 0 0 25 0 4 0 522360445 190177280 12243 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668673 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=185720 CPUtime=878.05 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2018 0 0 0 87795 10 0 0 25 0 4 0 522360445 190177280 12243 33554432000 4194304 4964704 140736815805184 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.73
Current children cumulated vsize (KiB) 185720

[startup+942.301 s]
/proc/loadavg: 8.07 8.03 7.86 9/184 27873
/proc/meminfo: memFree=30795684/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=185904 CPUtime=3764.43 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 12697 0 0 0 376398 45 0 0 25 0 4 0 522360442 190365696 12459 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46476 12459 460 189 0 40825 0
[pid=27840/tid=27845] ppid=27838 vsize=185904 CPUtime=942.16 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4831 0 0 0 94205 11 0 0 25 0 4 0 522360445 190365696 12459 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=185904 CPUtime=942.23 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2930 0 0 0 94213 10 0 0 25 0 4 0 522360445 190365696 12459 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=185904 CPUtime=937.75 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2041 0 0 0 93765 10 0 0 25 0 4 0 522360445 190365696 12459 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668673 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3764.43
Current children cumulated vsize (KiB) 185904

[startup+1002.3 s]
/proc/loadavg: 8.09 8.04 7.87 9/184 27874
/proc/meminfo: memFree=30793792/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=186160 CPUtime=4004.12 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 12913 0 0 0 400365 47 0 0 25 0 4 0 522360442 190627840 12675 33554432000 4194304 4964704 140736815805184 18446744073709551615 4372040 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46540 12675 460 189 0 40889 0
[pid=27840/tid=27845] ppid=27838 vsize=186160 CPUtime=1002.15 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 4933 0 0 0 100204 11 0 0 25 0 4 0 522360445 190627840 12675 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=186160 CPUtime=1002.23 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2947 0 0 0 100212 11 0 0 25 0 4 0 522360445 190627840 12675 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=186160 CPUtime=997.46 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2106 0 0 0 99735 11 0 0 25 0 4 0 522360445 190627840 12675 33554432000 4194304 4964704 140736815805184 18446744073709551615 4661017 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4004.12
Current children cumulated vsize (KiB) 186160

[startup+1062.3 s]
/proc/loadavg: 8.03 8.03 7.88 9/184 27876
/proc/meminfo: memFree=30792288/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=186244 CPUtime=4243.84 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 13047 0 0 0 424334 50 0 0 25 0 4 0 522360442 190713856 12809 33554432000 4194304 4964704 140736815805184 18446744073709551615 4669391 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46561 12809 460 189 0 40910 0
[pid=27840/tid=27845] ppid=27838 vsize=186244 CPUtime=1062.14 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 5046 0 0 0 106203 11 0 0 25 0 4 0 522360445 190713856 12809 33554432000 4194304 4964704 140736815805184 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=186244 CPUtime=1062.22 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2947 0 0 0 106210 12 0 0 25 0 4 0 522360445 190713856 12809 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=186244 CPUtime=1057.19 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2122 0 0 0 105707 12 0 0 25 0 4 0 522360445 190713856 12809 33554432000 4194304 4964704 140736815805184 18446744073709551615 4660304 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.84
Current children cumulated vsize (KiB) 186244

[startup+1122.3 s]
/proc/loadavg: 8.08 8.04 7.89 9/184 27877
/proc/meminfo: memFree=30790772/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=186688 CPUtime=4483.55 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 13243 0 0 0 448303 52 0 0 25 0 4 0 522360442 191168512 13005 33554432000 4194304 4964704 140736815805184 18446744073709551615 4364611 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46672 13005 460 189 0 41021 0
[pid=27840/tid=27845] ppid=27838 vsize=186688 CPUtime=1122.14 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 5165 0 0 0 112202 12 0 0 25 0 4 0 522360445 191168512 13005 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=186688 CPUtime=1122.22 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2952 0 0 0 112210 12 0 0 25 0 4 0 522360445 191168512 13005 33554432000 4194304 4964704 140736815805184 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=186688 CPUtime=1116.9 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2165 0 0 0 111678 12 0 0 25 0 4 0 522360445 191168512 13005 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4483.55
Current children cumulated vsize (KiB) 186688

[startup+1182.3 s]
/proc/loadavg: 8.10 8.04 7.90 9/184 27879
/proc/meminfo: memFree=30787528/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=186688 CPUtime=4723.24 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 13334 0 0 0 472270 54 0 0 25 0 4 0 522360442 191168512 13096 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46672 13096 460 189 0 41021 0
[pid=27840/tid=27845] ppid=27838 vsize=186688 CPUtime=1182.13 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 5189 0 0 0 118201 12 0 0 25 0 4 0 522360445 191168512 13096 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=186688 CPUtime=1182.23 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2957 0 0 0 118209 14 0 0 25 0 4 0 522360445 191168512 13096 33554432000 4194304 4964704 140736815805184 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=186688 CPUtime=1176.62 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2189 0 0 0 117649 13 0 0 25 0 4 0 522360445 191168512 13096 33554432000 4194304 4964704 140736815805184 18446744073709551615 4320890 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4723.24
Current children cumulated vsize (KiB) 186688



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 8.07 8.04 7.90 6/182 27880
/proc/meminfo: memFree=30787280/32950928 swapFree=67086612/67111528
[pid=27840] ppid=27838 vsize=186688 CPUtime=4800.36 cores=1,3,5,7
/proc/27840/stat : 27840 (claspmt) R 27838 27840 27507 0 -1 4202496 13348 0 0 0 479981 55 0 0 25 0 4 0 522360442 191168512 13110 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/27840/statm: 46672 13110 460 189 0 41021 0
[pid=27840/tid=27845] ppid=27838 vsize=186688 CPUtime=1201.44 cores=1,3,5,7
/proc/27840/task/27845/stat : 27845 (claspmt) R 27838 27840 27507 0 -1 4202560 5202 0 0 0 120131 13 0 0 25 0 4 0 522360445 191168512 13110 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=27840/tid=27846] ppid=27838 vsize=186688 CPUtime=1201.53 cores=1,3,5,7
/proc/27840/task/27846/stat : 27846 (claspmt) R 27838 27840 27507 0 -1 4202560 2957 0 0 0 120139 14 0 0 25 0 4 0 522360445 191168512 13110 33554432000 4194304 4964704 140736815805184 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=27840/tid=27847] ppid=27838 vsize=186688 CPUtime=1195.82 cores=1,3,5,7
/proc/27840/task/27847/stat : 27847 (claspmt) R 27838 27840 27507 0 -1 4202560 2190 0 0 0 119569 13 0 0 25 0 4 0 522360445 191168512 13110 33554432000 4194304 4964704 140736815805184 18446744073709551615 4660059 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 186688

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.62
CPU time (s): 4800.41
CPU user time (s): 4799.85
CPU system time (s): 0.556915
CPU usage (%): 399.494
Max. virtual memory (cumulated for all children) (KiB): 186688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.85
system time used= 0.556915
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13362
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 62246
involuntary context switches= 35296

runsolver used 1.64975 second user time and 4.10238 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-29 22:07:14
IDJOB=3299539
IDBENCH=87739
IDSOLVER=1683
FILE ID=node148/3299539-1304107634
RUNJOBID= node148-1304107634-27821
PBS_JOBID= 13170644
Free space on /tmp= 71432 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT02/handmade/simon/satex-challenges/par32-3.shuffled.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299539-1304107634/watcher-3299539-1304107634 -o /tmp/evaluation-result-3299539-1304107634/solver-3299539-1304107634 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299539-1304107634.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0115a0e26236f3f01aa829c2004452c1
RANDOM SEED=1504683022

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30917216 kB
Buffers:        700356 kB
Cached:         924968 kB
SwapCached:       3696 kB
Active:         113268 kB
Inactive:      1557564 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30917216 kB
SwapTotal:    67111528 kB
SwapFree:     67086612 kB
Dirty:            2060 kB
Writeback:           0 kB
AnonPages:       43316 kB
Mapped:          14252 kB
Slab:           300124 kB
PageTables:       4760 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   212412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71432 MiB
End job on node148 at 2011-04-29 22:27:17