Trace number 4409777

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2.0 parallelSAT (TO)3 20053.5 2520.03

General information on the benchmark

NameChessboardColoration/ChessboardColoration-int-s2/
ChessboardColoration-int-11-13.xml
MD5SUMb332b46b2d271d96c2352c0c61c10556
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark84.6157
Satisfiable
(Un)Satisfiability was proved
Number of variables143
Number of constraints4291
Number of domains1
Minimum domain size143
Maximum domain size143
Distribution of domain sizes[{"size":143,"count":143}]
Minimum variable degree122
Maximum variable degree122
Distribution of variable degrees[{"degree":122,"count":143}]
Minimum constraint arity4
Maximum constraint arity143
Distribution of constraint arities[{"arity":4,"count":4290},{"arity":143,"count":1}]
Number of extensional constraints0
Number of intensional constraints4290
Distribution of constraint types[{"type":"intension","count":4290},{"type":"lex","count":1}]
Optimization problemYES
Type of objectivemin MAXIMUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

18.55/10.35	c
18.55/10.35	c This is cosoco 2.00 --  
18.55/10.35	c
18.55/10.35	c command line: cosoco -model -nbcores=8 HOME/instance-4409777-1569838936.xml 
18.55/10.35	c enable optimization
18.55/10.35	c ========================================[ Problem Statistics ]===========================================
18.55/10.35	c |                                                                                                       
18.55/10.35	c |  Parse time        :         8.85 s 
18.55/10.35	c |
18.55/10.35	c |               Variables: 143
18.55/10.35	c |            Domain Sizes: 143..143
18.55/10.35	c |
18.55/10.35	c |             Constraints: 4313
18.55/10.35	c |                   Arity: 4..143
18.55/10.35	c | 
18.55/10.35	c |                   Types: 
18.55/10.35	c |                          Intension: 4290
18.55/10.35	c |                          Lex: 22
18.55/10.35	c |                          Max constant: 1
18.55/10.35	c |                          
18.55/10.35	c |               Objective: Minimize Max constant
18.55/10.35	
18.55/10.35	c =========================================================================================================
18.55/10.35	c Parallel mode: Portfolio
18.55/10.35	c [pFactory][Group N°0] created (threads:8).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
18.55/10.35	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
18.55/10.35	c [pFactory][Group N°0] concurrent mode: enabled.
18.55/10.35	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
18.55/10.35	c [pFactory][Group N°0] task 7 launched on thread 0.
18.55/10.35	c [pFactory][Group N°0] task 6 launched on thread 1.
18.55/10.35	c [pFactory][Group N°0] task 5 launched on thread 5.
18.55/10.35	c [pFactory][Group N°0] task 4 launched on thread 2.
18.55/10.35	c [pFactory][Group N°0] task 3 launched on thread 6.
18.55/10.35	c [pFactory][Group N°0] task 2 launched on thread 3.
18.55/10.35	c [pFactory][Group N°0] task 1 launched on thread 4.
18.55/10.35	c [pFactory][Group N°0] task 0 launched on thread 7.
18.55/10.35	o 7
19.15/10.41	o 6
24.77/11.20	o 5
32.03/12.12	o 4
71.15/17.08	o 3
20053.40/2520.02	
20053.40/2520.02	c *** INTERRUPTED ***
20053.40/2520.02	c call to solver        : 1
20053.40/2520.02	c
20053.40/2520.02	c restarts              : 16446       
20053.40/2520.02	c conflicts             : 193350       (10 /sec)
20053.40/2520.02	c decisions             : 909716       (45 /sec)
20053.40/2520.02	c propagations          : 5632542     (281 /sec)
20053.40/2520.02	c root propagations     : 72856       
20053.40/2520.02	c filter calls          : 324361764      (16179 /sec)
20053.40/2520.02	c useless filter calls  : 320720052      (98 %)
20053.40/2520.02	c Memory used           : 1158.79 MB
20053.40/2520.02	c Best bound time (wc)  : 17.076 s
20053.40/2520.02	c CPU time              : 20048.8 s
20053.40/2520.02	c real time             : 2520.02 s
20053.40/2520.02	
20053.40/2520.02	s SATISFIABLE
20053.40/2520.02	c Best value found: 3
20053.40/2520.02	
20053.40/2520.02	
20053.40/2520.02	v <instantiation type='solution' cost='3'>
20053.40/2520.02	v <list>x[0][0] x[0][10] x[0][11] x[0][12] x[0][1] x[0][2] x[0][3] x[0][4] x[0][5] x[0][6] x[0][7] x[0][8] x[0][9] x[10][0] x[10][10] x[10][11] x[10][12] x[10][1] x[10][2] x[10][3] x[10][4] x[10][5] x[10][6] x[10][7] x[10][8] x[10][9] x[1][0] x[1][10] x[1][11] x[1][12] x[1][1] x[1][2] x[1][3] x[1][4] x[1][5] x[1][6] x[1][7] x[1][8] x[1][9] x[2][0] x[2][10] x[2][11] x[2][12] x[2][1] x[2][2] x[2][3] x[2][4] x[2][5] x[2][6] x[2][7] x[2][8] x[2][9] x[3][0] x[3][10] x[3][11] x[3][12] x[3][1] x[3][2] x[3][3] x[3][4] x[3][5] x[3][6] x[3][7] x[3][8] x[3][9] x[4][0] x[4][10] x[4][11] x[4][12] x[4][1] x[4][2] x[4][3] x[4][4] x[4][5] x[4][6] x[4][7] x[4][8] x[4][9] x[5][0] x[5][10] x[5][11] x[5][12] x[5][1] x[5][2] x[5][3] x[5][4] x[5][5] x[5][6] x[5][7] x[5][8] x[5][9] x[6][0] x[6][10] x[6][11] x[6][12] x[6][1] x[6][2] x[6][3] x[6][4] x[6][5] x[6][6] x[6][7] x[6][8] x[6][9] x[7][0] x[7][10] x[7][11] x[7][12] x[7][1] x[7][2] x[7][3] x[7][4] x[7][5] x[7][6] x[7][7] x[7][8] x[7][9] x[8][0] x[8][10] x[8][11] x[8][12] x[8][1] x[8][2] x[8][3] x[8][4] x[8][5] x[8][6] x[8][7] x[8][8] x[8][9] x[9][0] x[9][10] x[9][11] x[9][12] x[9][1] x[9][2] x[9][3] x[9][4] x[9][5] x[9][6] x[9][7] x[9][8] x[9][9] </list>
20053.40/2520.02	v <values>0 3 3 3 0 0 0 1 1 1 2 3 3 3 0 1 1 2 3 1 1 0 0 0 2 3 1 2 2 3 1 1 1 0 2 3 3 1 2 1 1 2 2 2 3 3 2 0 1 3 3 0 1 0 3 2 3 0 3 3 1 2 2 2 0 2 3 2 1 1 3 0 3 1 3 0 2 1 2 3 1 0 2 2 0 0 1 0 3 1 0 2 2 0 2 3 0 2 0 0 1 3 1 3 3 1 3 0 0 2 2 2 0 3 2 1 2 3 1 0 1 2 1 2 3 2 2 0 3 0 3 2 1 3 2 1 3 0 3 1 0 0 1 </values>
20053.40/2520.02	v </instantiation>
20053.40/2520.02

Verifier Data 

OK	3

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15213 MiB free)
  memory of node 1: 16384 MiB (15485 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409777-1569838936/watcher-4409777-1569838936 -o /tmp/evaluation-result-4409777-1569838936/solver-4409777-1569838936 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node120-1325353310-26745 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409777-1569838936.xml 

running on 8 cores: 0-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=26986, runsolver pid=26983

[startup+0.100157 s]*
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31434960/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=29440 memory=5536 CPUtime=0.1 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 1561 0 0 0 10 0 0 0 20 0 1 0 559899632 30146560 1384 33554432000 4194304 6211132 140733817778816 140733817775352 5810242 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 7360 1384 806 493 0 665 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29440 KiB
Current children cumulated memory: 5536 KiB

[startup+0.210427 s]*
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31428884/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=35904 memory=12032 CPUtime=0.21 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 3223 0 0 0 21 0 0 0 20 0 1 0 559899632 36765696 3008 33554432000 4194304 6211132 140733817778816 140733817775352 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 8976 3008 823 493 0 2281 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 35904 KiB
Current children cumulated memory: 12032 KiB

[startup+0.309818 s]*
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31422560/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=42100 memory=18360 CPUtime=0.31 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 4782 0 0 0 31 0 0 0 20 0 1 0 559899632 43110400 4590 33554432000 4194304 6211132 140733817778816 140733817775352 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 10525 4590 823 493 0 3830 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 42100 KiB
Current children cumulated memory: 18360 KiB

[startup+0.700322 s]
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31410140/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=66232 memory=42492 CPUtime=0.69 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 10811 0 0 0 68 1 0 0 20 0 1 0 559899632 67821568 10623 33554432000 4194304 6211132 140733817778816 140733817773912 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 16558 10623 823 493 0 9863 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 66232 KiB
Current children cumulated memory: 42492 KiB

[startup+1.50033 s]
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31379596/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=116832 memory=93088 CPUtime=1.48 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 23451 0 0 0 146 2 0 0 20 0 1 0 559899632 119635968 23272 33554432000 4194304 6211132 140733817778816 140733817773912 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 29208 23272 823 493 0 22513 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 116832 KiB
Current children cumulated memory: 93088 KiB

[startup+3.11014 s]
/proc/loadavg: 6.91 8.29 8.61 2/192 26987
/proc/meminfo: memFree=31253048/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=218580 memory=194840 CPUtime=3.09 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 49312 0 0 0 302 7 0 0 20 0 1 0 559899632 223825920 48710 33554432000 4194304 6211132 140733817778816 140733817773912 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 54645 48710 823 493 0 47950 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 218580 KiB
Current children cumulated memory: 194840 KiB

[startup+6.30031 s]
/proc/loadavg: 6.44 8.17 8.57 2/192 26987
/proc/meminfo: memFree=31063916/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=419956 memory=396216 CPUtime=6.29 cores=0-7
/proc/26986/stat : 26986 (cosoco) R 26983 26986 26718 0 -1 4202496 100157 0 0 0 613 16 0 0 20 0 1 0 559899632 430034944 99054 33554432000 4194304 6211132 140733817778816 140733817773912 139727892749285 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 104989 99054 823 493 0 98294 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 419956 KiB
Current children cumulated memory: 396216 KiB

[startup+12.701 s]
/proc/loadavg: 6.01 8.05 8.53 9/200 26995
/proc/meminfo: memFree=30657636/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1191728 memory=781436 CPUtime=36.74 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 565872 0 0 0 3558 116 0 0 20 0 9 0 559899632 1220329472 195359 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 297932 195359 857 493 0 291237 0
[pid=26986/tid=26988] ppid=26983 vsize=1191728 memory=300898369 CPUtime=3.47 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 44942 0 0 0 334 13 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727885646520 5068958 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1191728 memory=56 CPUtime=3.45 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 43316 0 0 0 334 11 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727877253768 5442996 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1191728 memory=0 CPUtime=3.39 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 45156 0 0 0 329 10 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727868861112 5397407 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1191728 memory=140141561796451 CPUtime=3.4 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 46895 0 0 0 334 6 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727860468824 5009142 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1191728 memory=6935054825532540783 CPUtime=3.49 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 65478 0 0 0 330 19 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727852075432 5069663 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1191728 memory=0 CPUtime=3.47 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 45430 0 0 0 341 6 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727843683000 5452258 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1191728 memory=0 CPUtime=3.43 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 46118 0 0 0 326 17 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727835290712 5451618 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1191728 memory=0 CPUtime=3.48 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 54958 0 0 0 343 5 0 0 20 0 9 0 559900543 1220329472 195359 33554432000 4194304 6211132 140733817778816 139727826897320 139727902694237 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 36.74 s
Current children cumulated vsize: 1191728 KiB
Current children cumulated memory: 781436 KiB

[startup+25.501 s]
/proc/loadavg: 6.45 8.04 8.52 9/200 26998
/proc/meminfo: memFree=30659596/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1189672 memory=780224 CPUtime=138.91 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 1279361 0 0 0 13686 205 0 0 20 0 9 0 559899632 1218224128 195056 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 297418 195056 857 493 0 290723 0
[pid=26986/tid=26988] ppid=26983 vsize=1189672 memory=780224 CPUtime=16.24 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 126311 0 0 0 1602 22 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727885646520 5439818 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1189672 memory=639 CPUtime=16.25 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 122199 0 0 0 1599 26 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727877254416 5164777 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1189672 memory=1604 CPUtime=16.19 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 132781 0 0 0 1595 24 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727868861112 5068955 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1189672 memory=280283123669360 CPUtime=16.19 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 138505 0 0 0 1605 14 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727860469064 5068981 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1189672 memory=6944652177228980320 CPUtime=16.28 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 167539 0 0 0 1596 32 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727852075432 5440652 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1189672 memory=3624 CPUtime=16.26 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 128180 0 0 0 1614 12 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727843683000 139727893675423 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1189672 memory=12000 CPUtime=16.04 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 117751 0 0 0 1577 27 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727835290952 5165031 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1189672 memory=6935054825532540783 CPUtime=16.28 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 172526 0 0 0 1609 19 0 0 20 0 9 0 559900543 1218224128 195056 33554432000 4194304 6211132 140733817778816 139727826897320 5446650 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 138.91 s
Current children cumulated vsize: 1189672 KiB
Current children cumulated memory: 780224 KiB

[startup+51.111 s]
/proc/loadavg: 6.98 8.04 8.51 9/200 26998
/proc/meminfo: memFree=30661924/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=343.27 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 1723429 0 0 0 34077 250 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=6935054825532540783 CPUtime=41.79 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 173440 0 0 0 4153 26 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 139727893669776 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=778224 CPUtime=41.56 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 171693 0 0 0 4124 32 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5439842 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=778224 CPUtime=41.8 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 182091 0 0 0 4151 29 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5480300 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=984 CPUtime=41.81 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 191596 0 0 0 4162 19 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5165028 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=3472328296227679313 CPUtime=41.89 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 238683 0 0 0 4148 41 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5455674 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=280283123286256 CPUtime=41.87 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 181246 0 0 0 4168 19 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 139727893669812 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=778224 CPUtime=41.56 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 165066 0 0 0 4125 31 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5009195 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=-7023579799431922829 CPUtime=41.84 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 246035 0 0 0 4159 25 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 5452239 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 343.27 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

[startup+102.301 s]
/proc/loadavg: 7.61 8.05 8.49 9/200 27001
/proc/meminfo: memFree=30662136/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=751.89 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 1959274 0 0 0 74917 272 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=778224 CPUtime=92.95 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 196662 0 0 0 9267 28 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 5453958 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=778224 CPUtime=92.31 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 196044 0 0 0 9197 34 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 139727902694208 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=984 CPUtime=92.83 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 210035 0 0 0 9252 31 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5069297 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=778224 CPUtime=92.96 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 214771 0 0 0 9275 21 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5453944 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=1724 CPUtime=92.85 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 280676 0 0 0 9240 45 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5443025 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=2020 CPUtime=93.03 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 210229 0 0 0 9282 21 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5443093 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=1420 CPUtime=92.74 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 189573 0 0 0 9241 33 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5480282 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=3624 CPUtime=93.01 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 287705 0 0 0 9273 28 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 5446250 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0

################
# More data... #
################

/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359549 0 0 0 224557 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 139727893675423 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=778224 CPUtime=2247.68 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352051 0 0 0 224716 52 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5446302 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=778224 CPUtime=2251.11 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 465037 0 0 0 225042 69 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5455682 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=778224 CPUtime=2252.36 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358059 0 0 0 225194 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5446650 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=3624 CPUtime=2237.17 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 330850 0 0 0 223663 54 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 139727902694282 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=778224 CPUtime=2252.45 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 472714 0 0 0 225195 50 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 139727893672794 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 17995.9 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

[startup+2322.3 s]
/proc/loadavg: 8.42 8.20 8.24 9/202 27194
/proc/meminfo: memFree=30664908/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=18474.9 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 3194970 0 0 0 1847028 466 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=778224 CPUtime=2311.22 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 344114 0 0 0 231078 44 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 5164796 0 0 4096 8405026 0 0 0 -1 3 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=778224 CPUtime=2308.66 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 337626 0 0 0 230795 71 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5193383 0 0 4096 8405026 0 0 0 -1 1 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=778224 CPUtime=2306.07 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359616 0 0 0 230556 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5446311 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=778224 CPUtime=2306.78 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352188 0 0 0 230626 52 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5443112 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=778224 CPUtime=2311.11 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 465410 0 0 0 231042 69 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5443135 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=778224 CPUtime=2312.33 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358166 0 0 0 231191 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5451634 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=778224 CPUtime=2297.16 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 331312 0 0 0 229661 55 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5439818 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=778224 CPUtime=2312.43 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 472959 0 0 0 231192 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 5068958 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 18474.9 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

[startup+2382.3 s]
/proc/loadavg: 8.76 8.34 8.29 9/201 27197
/proc/meminfo: memFree=30664748/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=18954 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 3196391 0 0 0 1894931 467 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=1408 CPUtime=2371.2 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 344236 0 0 0 237076 44 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 139727893673540 0 0 4096 8405026 0 0 0 -1 3 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=778224 CPUtime=2368.65 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 337722 0 0 0 236794 71 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5072397 0 0 4096 8405026 0 0 0 -1 1 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=778224 CPUtime=2366.06 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359678 0 0 0 236555 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5165031 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=778224 CPUtime=2365.89 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352227 0 0 0 236537 52 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 139727893669795 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=778224 CPUtime=2371.09 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 465770 0 0 0 237040 69 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5443096 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=778224 CPUtime=2372.32 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358225 0 0 0 237190 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5069704 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=778224 CPUtime=2357.15 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 331734 0 0 0 235660 55 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5446240 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=0 CPUtime=2372.41 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 473220 0 0 0 237190 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 139727893672790 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 18954 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

[startup+2442.3 s]
/proc/loadavg: 8.35 8.31 8.28 9/201 27200
/proc/meminfo: memFree=30665404/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=19433 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 3198254 0 0 0 1942832 468 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=778224 CPUtime=2431.2 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 344401 0 0 0 243075 45 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 5453954 0 0 4096 8405026 0 0 0 -1 3 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=778224 CPUtime=2428.65 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 337884 0 0 0 242793 72 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5455685 0 0 4096 8405026 0 0 0 -1 1 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=778224 CPUtime=2426.05 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359817 0 0 0 242554 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5443060 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=0 CPUtime=2424.99 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352354 0 0 0 242447 52 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5451564 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=778224 CPUtime=2431.09 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 466175 0 0 0 243039 70 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5451658 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=778224 CPUtime=2432.31 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358343 0 0 0 243189 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5009142 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=778224 CPUtime=2417.15 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 332198 0 0 0 241659 56 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5451658 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=778224 CPUtime=2432.4 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 473503 0 0 0 243189 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 5446206 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 19433 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

[startup+2502.3 s]
/proc/loadavg: 8.13 8.25 8.27 9/202 27205
/proc/meminfo: memFree=30664896/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=19912 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 3198889 0 0 0 1990733 469 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=6935054825532540783 CPUtime=2491.18 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 344502 0 0 0 249073 45 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 139727893672790 0 0 4096 8405026 0 0 0 -1 3 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=12052 CPUtime=2488.64 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 337992 0 0 0 248792 72 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=778224 CPUtime=2486.04 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359876 0 0 0 248553 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5446280 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=778224 CPUtime=2484.08 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352375 0 0 0 248355 53 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 139727893669795 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=778224 CPUtime=2491.08 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 466216 0 0 0 249038 70 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5454208 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=778224 CPUtime=2492.31 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358452 0 0 0 249189 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 139727902694222 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=778224 CPUtime=2477.14 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 332300 0 0 0 247658 56 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 5068955 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=778224 CPUtime=2492.38 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 473597 0 0 0 249187 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 139727902694232 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 19912 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.09 8.24 8.26 9/201 27205
/proc/meminfo: memFree=30665712/32770688 swapFree=66927776/67108860
[pid=26986] ppid=26983 vsize=1186592 memory=778224 CPUtime=20053.4 cores=0-7
/proc/26986/stat : 26986 (cosoco) S 26983 26986 26718 0 -1 1077944320 3200139 0 0 0 2004871 469 0 0 20 0 9 0 559899632 1215070208 194556 33554432000 4194304 6211132 140733817778816 140733817777072 139727908790007 0 0 4096 8405026 18446744073709551615 0 0 17 1 0 0 0 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
/proc/26986/statm: 296648 194556 857 493 0 289953 0
[pid=26986/tid=26988] ppid=26983 vsize=1186592 memory=1398722017469774279 CPUtime=2508.87 cores=0-7
/proc/26986/task/26988/stat : 26988 (cosoco) R 26983 26986 26718 0 -1 4202560 344603 0 0 0 250842 45 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727885646520 5451448 0 0 4096 8405026 0 0 0 -1 3 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26989] ppid=26983 vsize=1186592 memory=1656 CPUtime=2506.35 cores=0-7
/proc/26986/task/26989/stat : 26989 (cosoco) R 26983 26986 26718 0 -1 4202560 338046 0 0 0 250563 72 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727877254416 5443128 0 0 4096 8405026 0 0 0 -1 1 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26990] ppid=26983 vsize=1186592 memory=1724 CPUtime=2503.75 cores=0-7
/proc/26986/task/26990/stat : 26990 (cosoco) R 26983 26986 26718 0 -1 4202560 359937 0 0 0 250324 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727868861112 5446292 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26991] ppid=26983 vsize=1186592 memory=1964 CPUtime=2501.53 cores=0-7
/proc/26986/task/26991/stat : 26991 (cosoco) R 26983 26986 26718 0 -1 4202560 352396 0 0 0 250100 53 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727860469064 5480314 0 0 4096 8405026 0 0 0 -1 7 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26992] ppid=26983 vsize=1186592 memory=4872558044660077418 CPUtime=2508.79 cores=0-7
/proc/26986/task/26992/stat : 26992 (cosoco) R 26983 26986 26718 0 -1 4202560 466542 0 0 0 250809 70 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727852076360 5456330 0 0 4096 8405026 0 0 0 -1 6 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26993] ppid=26983 vsize=1186592 memory=12052 CPUtime=2510.01 cores=0-7
/proc/26986/task/26993/stat : 26993 (cosoco) R 26983 26986 26718 0 -1 4202560 358512 0 0 0 250959 42 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727843683000 5442996 0 0 4096 8405026 0 0 0 -1 2 0 0 1 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26994] ppid=26983 vsize=1186592 memory=984 CPUtime=2494.85 cores=0-7
/proc/26986/task/26994/stat : 26994 (cosoco) R 26983 26986 26718 0 -1 4202560 332705 0 0 0 249429 56 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727835290952 139727893669792 0 0 4096 8405026 0 0 0 -1 0 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
[pid=26986/tid=26995] ppid=26983 vsize=1186592 memory=6935054825532540783 CPUtime=2510.08 cores=0-7
/proc/26986/task/26995/stat : 26995 (cosoco) R 26983 26986 26718 0 -1 4202560 473819 0 0 0 250957 51 0 0 20 0 9 0 559900543 1215070208 194556 33554432000 4194304 6211132 140733817778816 139727826898248 5072462 0 0 4096 8405026 0 0 0 -1 5 0 0 2 0 0 8312316 8317760 23785472 140733817783313 140733817783405 140733817783405 140733817786318 0
Current children cumulated CPU time: 20053.4 s
Current children cumulated vsize: 1186592 KiB
Current children cumulated memory: 778224 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.03 s]
# the end of solver process 26986 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=20048.8 s, system=4.70278 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.03
CPU time (s): 20053.5
CPU user time (s): 20048.8
CPU system time (s): 4.70278
CPU usage (%): 795.766
Max. virtual memory (cumulated for all children) (KiB): 1193784
Max. memory (cumulated for all children) (KiB): 782796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20048.8
system time used= 4.70278
maximum resident set size= 782796
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3200190
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33805
involuntary context switches= 176518


# summary of solver processes directly reported to runsolver:
#   pid: 26986
#   total CPU time (s): 20053.5
#   total CPU user time (s): 20048.8
#   total CPU system time (s): 4.70278

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 14.1326 second user time and 22.8796 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-31 18:42:36
IDJOB=4409777
IDBENCH=139748
IDSOLVER=2877
FILE ID=node120/4409777-1569838936
RUNJOBID= node120-1325353310-26745
PBS_JOBID= 21705961
Free space on /tmp= 61844 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/ChessboardColoration/ChessboardColoration-int-s2/ChessboardColoration-int-11-13.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409777-1569838936/watcher-4409777-1569838936 -o /tmp/evaluation-result-4409777-1569838936/solver-4409777-1569838936 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node120-1325353310-26745 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409777-1569838936.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b332b46b2d271d96c2352c0c61c10556
RANDOM SEED=493739883

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        31436396 kB
MemAvailable:   31794156 kB
Buffers:          224768 kB
Cached:           462192 kB
SwapCached:        68828 kB
Active:           330348 kB
Inactive:         430392 kB
Active(anon):      25216 kB
Inactive(anon):   129512 kB
Active(file):     305132 kB
Inactive(file):   300880 kB
Unevictable:      107736 kB
Mlocked:          107736 kB
SwapTotal:      67108860 kB
SwapFree:       66927776 kB
Dirty:              2804 kB
Writeback:             0 kB
AnonPages:        153704 kB
Mapped:            28096 kB
Shmem:             72460 kB
Slab:             165012 kB
SReclaimable:     135168 kB
SUnreclaim:        29844 kB
KernelStack:        3728 kB
PageTables:         4808 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     547452 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    108544 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61840 MiB
End job on node120 at 2011-12-31 19:24:36