Trace number 3482298

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 328.29 325.702

General information on the benchmark

Name/OPT-SMALLINT-LIN/heinz/
normalized-iis-bupa-cov.opb
MD5SUM7fb5c1a630b78d8604b800edf1958e29
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark36
Best CPU time to get the best result obtained on this benchmark1797.05
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables341
Total number of constraints4803
Number of constraints which are clauses4803
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint7
Maximum length of a constraint8
Number of terms in the objective function 341
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 341
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 341
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.30/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.30/0.49	c INFO: solving HOME/instance-3482298-1307578905.opb
0.40/0.55	c INFO: parsing took 0.06 s
0.48/0.66	c INFO: features took 0.11 CPU seconds
0.48/0.69	c INFO: running sat4j-pb-v20101225@0 for 45 with 1799 remaining (b = 0.88)
47.53/46.50	c INFO: running pbct-0.1.2-linear@0 for 45 with 1752 remaining (b = 0.39)
130.40/129.06	c INFO: running clasp-1.3.7@0 for 45 with 1705 remaining (b = 0.20)
176.43/174.90	c INFO: running wbo1.4a@0 for 45 with 1659 remaining (b = 0.10)
225.37/223.56	c INFO: running scip-2.0.1-spx@0 for 45 with 1612 remaining (b = 0.04)
276.45/274.30	c INFO: running scip-2.0.1-clp@0 for 45 with 1563 remaining (b = 0.02)
327.57/325.29	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1512 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482298-1307578905/watcher-3482298-1307578905 -o /tmp/evaluation-result-3482298-1307578905/solver-3482298-1307578905 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482298-1307578905.opb -seed 17868000 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.46 2.19 1.97 2/810 25537
/proc/meminfo: memFree=10574448/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=16396 CPUtime=0 cores=1,3,5,7
/proc/25537/stat : 25537 (python) R 25535 25537 23102 0 -1 4202496 1085 0 0 0 0 0 0 0 20 0 1 0 869487680 16789504 956 33554432000 4194304 5683644 140734836236768 18446744073709551615 5210636 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/25537/statm: 4099 956 390 364 0 586 0

[startup+0.118384 s]
/proc/loadavg: 2.46 2.19 1.97 2/810 25537
/proc/meminfo: memFree=10574448/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=96124 CPUtime=0.09 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 3243 931 1 0 7 2 0 0 18 0 1 0 869487680 98430976 2483 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/25537/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 96124

[startup+0.201146 s]
/proc/loadavg: 2.46 2.19 1.97 2/810 25537
/proc/meminfo: memFree=10574448/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=123736 CPUtime=0.15 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 5356 931 1 0 11 4 0 0 17 0 1 0 869487680 126705664 3743 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/25537/statm: 30934 3743 987 364 0 2766 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123736

[startup+0.300789 s]
/proc/loadavg: 2.46 2.19 1.97 2/810 25537
/proc/meminfo: memFree=10574448/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=184592 CPUtime=0.23 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 6342 931 1 0 17 6 0 0 17 0 1 0 869487680 189022208 4645 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 0
/proc/25537/statm: 46148 4645 1251 364 0 3654 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 184592

[startup+0.70066 s]
/proc/loadavg: 2.46 2.19 1.97 2/810 25537
/proc/meminfo: memFree=10574448/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=294404 CPUtime=0.58 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 10033 931 1 0 48 10 0 0 19 0 2 0 869487680 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25537/statm: 73601 7440 1870 364 0 8488 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 294404

[startup+1.50153 s]
/proc/loadavg: 2.46 2.19 1.97 5/832 25563
/proc/meminfo: memFree=10502980/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=294404 CPUtime=0.58 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 10033 931 1 0 48 10 0 0 19 0 2 0 869487680 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25537/statm: 73601 7440 1870 364 0 8488 0
[pid=25543] ppid=25537 vsize=284160 CPUtime=0 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25537 25537 23102 0 -1 4202560 767 0 0 0 0 0 0 0 15 0 1 0 869487749 290979840 5918 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476715023 0 0 16781312 33554946 434319720175370240 0 0 17 1 0 0 0
/proc/25543/statm: 71040 5918 352 364 0 5927 0
[pid=25545] ppid=25543 vsize=8536836 CPUtime=1.34 cores=1,3,5,7
/proc/25545/stat : 25545 (java) S 25543 25545 25545 0 -1 4202496 15598 0 1 0 131 3 0 0 19 0 19 0 869487749 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25545/statm: 2134209 13453 2252 9 0 2124950 0
[pid=25545/tid=25546] ppid=25543 vsize=8536836 CPUtime=0.75 cores=1,3,5,7
/proc/25545/task/25546/stat : 25546 (java) R 25543 25545 25545 0 -1 4202560 9596 0 1 0 74 1 0 0 19 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 46912505329156 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=25545/tid=25547] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25547/stat : 25547 (java) S 25543 25545 25545 0 -1 4202560 176 0 0 0 0 0 0 0 16 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25548] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25548/stat : 25548 (java) S 25543 25545 25545 0 -1 4202560 185 0 0 0 0 0 0 0 16 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 1 0 0 0
[pid=25545/tid=25549] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25549/stat : 25549 (java) S 25543 25545 25545 0 -1 4202560 80 0 0 0 0 0 0 0 16 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25550] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25550/stat : 25550 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25551] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25551/stat : 25551 (java) S 25543 25545 25545 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25552] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25552/stat : 25552 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25553] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25553/stat : 25553 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25554] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25554/stat : 25554 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487750 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25555] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25555/stat : 25555 (java) S 25543 25545 25545 0 -1 4202560 445 0 0 0 0 0 0 0 18 0 19 0 869487751 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 0 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25556] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25556/stat : 25556 (java) S 25543 25545 25545 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869487752 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25557] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25557/stat : 25557 (java) S 25543 25545 25545 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869487752 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25558] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25558/stat : 25558 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869487754 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488518577 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25559] ppid=25543 vsize=8536836 CPUtime=0.33 cores=1,3,5,7
/proc/25545/task/25559/stat : 25559 (java) S 25543 25545 25545 0 -1 4202560 2020 0 0 0 33 0 0 0 15 0 19 0 869487754 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25560] ppid=25543 vsize=8536836 CPUtime=0.22 cores=1,3,5,7
/proc/25545/task/25560/stat : 25560 (java) S 25543 25545 25545 0 -1 4202560 1712 0 0 0 22 0 0 0 23 0 19 0 869487754 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25561] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25561/stat : 25561 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869487754 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25562] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25562/stat : 25562 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487754 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446604468280423424 0 0 -1 1 0 0 0
[pid=25545/tid=25563] ppid=25543 vsize=8536836 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25563/stat : 25563 (java) S 25543 25545 25545 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869487784 8741720064 13453 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25537/tid=25544] ppid=25535 vsize=294404 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25544/stat : 25544 (python) S 25535 25537 23102 0 -1 4202560 28 931 0 0 0 0 0 0 19 0 2 0 869487749 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.92
Current children cumulated vsize (KiB) 9115400

[startup+3.10124 s]
/proc/loadavg: 2.46 2.19 1.97 3/832 25563
/proc/meminfo: memFree=10487108/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=294404 CPUtime=0.58 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 10033 931 1 0 48 10 0 0 19 0 2 0 869487680 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25537/statm: 73601 7440 1870 364 0 8488 0
[pid=25543] ppid=25537 vsize=284160 CPUtime=0 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25537 25537 23102 0 -1 4202560 769 0 0 0 0 0 0 0 15 0 1 0 869487749 290979840 5918 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476715023 0 0 16781312 33554946 1588619187729727488 0 0 17 1 0 0 0
/proc/25543/statm: 71040 5918 352 364 0 5927 0
[pid=25545] ppid=25543 vsize=8536512 CPUtime=3 cores=1,3,5,7
/proc/25545/stat : 25545 (java) S 25543 25545 25545 0 -1 4202496 16725 0 1 0 297 3 0 0 19 0 19 0 869487749 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25545/statm: 2134128 14424 2252 9 0 2124869 0
[pid=25545/tid=25546] ppid=25543 vsize=8536512 CPUtime=2.3 cores=1,3,5,7
/proc/25545/task/25546/stat : 25546 (java) R 25543 25545 25545 0 -1 4202560 9599 0 1 0 229 1 0 0 22 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 46912505366624 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25545/tid=25547] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25547/stat : 25547 (java) S 25543 25545 25545 0 -1 4202560 192 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 1 0 0 0
[pid=25545/tid=25548] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25548/stat : 25548 (java) S 25543 25545 25545 0 -1 4202560 351 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25549] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25549/stat : 25549 (java) S 25543 25545 25545 0 -1 4202560 232 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 1 0 0 0
[pid=25545/tid=25550] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25550/stat : 25550 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25551] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25551/stat : 25551 (java) S 25543 25545 25545 0 -1 4202560 109 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25552] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25552/stat : 25552 (java) S 25543 25545 25545 0 -1 4202560 18 0 0 0 0 0 0 0 16 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 1 0 0 0
[pid=25545/tid=25553] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25553/stat : 25553 (java) S 25543 25545 25545 0 -1 4202560 16 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25554] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25554/stat : 25554 (java) S 25543 25545 25545 0 -1 4202560 121 0 0 0 0 0 0 0 16 0 19 0 869487750 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25555] ppid=25543 vsize=8536512 CPUtime=0.05 cores=1,3,5,7
/proc/25545/task/25555/stat : 25555 (java) S 25543 25545 25545 0 -1 4202560 887 0 0 0 5 0 0 0 16 0 19 0 869487751 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 0 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25556] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25556/stat : 25556 (java) S 25543 25545 25545 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869487752 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25557] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25557/stat : 25557 (java) S 25543 25545 25545 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869487752 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25558] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25558/stat : 25558 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869487754 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488518577 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25559] ppid=25543 vsize=8536512 CPUtime=0.36 cores=1,3,5,7
/proc/25545/task/25559/stat : 25559 (java) S 25543 25545 25545 0 -1 4202560 2108 0 0 0 36 0 0 0 15 0 19 0 869487754 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25560] ppid=25543 vsize=8536512 CPUtime=0.23 cores=1,3,5,7
/proc/25545/task/25560/stat : 25560 (java) S 25543 25545 25545 0 -1 4202560 1713 0 0 0 23 0 0 0 15 0 19 0 869487754 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25561] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25561/stat : 25561 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869487754 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25562] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25562/stat : 25562 (java) S 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 19 0 869487754 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25545/tid=25563] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25563/stat : 25563 (java) S 25543 25545 25545 0 -1 4202560 7 0 0 0 0 0 0 0 19 0 19 0 869487784 8741388288 14424 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446604468280423424 0 0 -1 5 0 0 0
[pid=25537/tid=25544] ppid=25535 vsize=294404 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25544/stat : 25544 (python) S 25535 25537 23102 0 -1 4202560 28 931 0 0 0 0 0 0 19 0 2 0 869487749 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.58
Current children cumulated vsize (KiB) 9115076

[startup+6.30162 s]
/proc/loadavg: 2.42 2.18 1.97 3/832 25563
/proc/meminfo: memFree=10464052/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=294404 CPUtime=0.58 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 10033 931 1 0 48 10 0 0 19 0 2 0 869487680 301469696 7440 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/25537/statm: 73601 7440 1870 364 0 8488 0
[pid=25543] ppid=25537 vsize=284160 CPUtime=0.02 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25537 25537 23102 0 -1 4202560 909 0 0 0 1 1 0 0 15 0 1 0 869487749 290979840 5942 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476715023 0 0 16781312 33554946 4294934790 0 0 17 1 0 0 0
/proc/25543/statm: 71040 5942 376 364 0 5927 0
[pid=25545] ppid=25543 vsize=8536512 CPUtime=6.24 cores=1,3,5,7
/proc/25545/stat : 25545 (java) S 25543 25545 25545 0 -1 4202496 17406 0 1 0 621 3 0 0 19 0 19 0 869487749 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25545/statm: 2134128 15064 2252 9 0 2124869 0
[pid=25545/tid=25546] ppid=25543 vsize=8536512 CPUtime=5.38 cores=1,3,5,7
/proc/25545/task/25546/stat : 25546 (java) R 25543 25545 25545 0 -1 4202560 9608 0 1 0 537 1 0 0 25 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 46912505722555 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=25545/tid=25547] ppid=25543 vsize=8536512 CPUtime=0.01 cores=1,3,5,7
/proc/25545/task/25547/stat : 25547 (java) S 25543 25545 25545 0 -1 4202560 231 0 0 0 1 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25548] ppid=25543 vsize=8536512 CPUtime=0.01 cores=1,3,5,7
/proc/25545/task/25548/stat : 25548 (java) S 25543 25545 25545 0 -1 4202560 370 0 0 0 1 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25549] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25549/stat : 25549 (java) S 25543 25545 25545 0 -1 4202560 251 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 3 0 0 0
[pid=25545/tid=25550] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25550/stat : 25550 (java) S 25543 25545 25545 0 -1 4202560 2 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25551] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25551/stat : 25551 (java) S 25543 25545 25545 0 -1 4202560 135 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25552] ppid=25543 vsize=8536512 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25552/stat : 25552 (java) S 25543 25545 25545 0 -1 4202560 33 0 0 0 0 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 3 0 0 0
[pid=25545/tid=25553] ppid=25543 vsize=8536512 CPUtime=0.01 cores=1,3,5,7
/proc/25545/task/25553/stat : 25553 (java) S 25543 25545 25545 0 -1 4202560 18 0 0 0 1 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0
[pid=25545/tid=25554] ppid=25543 vsize=8536512 CPUtime=0.01 cores=1,3,5,7
/proc/25545/task/25554/stat : 25554 (java) S 25543 25545 25545 0 -1 4202560 122 0 0 0 1 0 0 0 15 0 19 0 869487750 8741388288 15064 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446604468280423424 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=25537/tid=25612] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25612/stat : 25612 (python) S 25535 25537 23102 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 8 0 869520210 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 328.29
Current children cumulated vsize (KiB) 19964260

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+325.602 s]
/proc/loadavg: 1.05 1.60 1.79 3/854 25630
/proc/meminfo: memFree=10938988/32950928 swapFree=67056572/67111528
[pid=25537] ppid=25535 vsize=356444 CPUtime=0.74 cores=1,3,5,7
/proc/25537/stat : 25537 (python) S 25535 25537 23102 0 -1 4202496 15498 931 1 0 63 11 0 0 19 0 8 0 869487680 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/25537/statm: 89111 7603 1883 364 0 23980 0
[pid=25543] ppid=25537 vsize=294404 CPUtime=0.28 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25537 25537 23102 0 -1 4202560 1094 0 0 0 13 15 0 0 16 0 2 0 869487749 301469696 5978 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25543/statm: 73601 5978 407 364 0 8488 0
[pid=25545] ppid=25543 vsize=8536576 CPUtime=46.65 cores=1,3,5,7
/proc/25545/stat : 25545 (java) T 25543 25545 25545 0 -1 4202496 17807 0 1 0 4659 6 0 0 18 0 19 0 869487749 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/25545/statm: 2134144 15303 2253 9 0 2124885 0
[pid=25545/tid=25546] ppid=25543 vsize=8536576 CPUtime=44.19 cores=1,3,5,7
/proc/25545/task/25546/stat : 25546 (java) T 25543 25545 25545 0 -1 4202560 9696 0 1 0 4418 1 0 0 25 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25545/tid=25547] ppid=25543 vsize=8536576 CPUtime=0.08 cores=1,3,5,7
/proc/25545/task/25547/stat : 25547 (java) T 25543 25545 25545 0 -1 4202560 233 0 0 0 8 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239476648247 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25545/tid=25548] ppid=25543 vsize=8536576 CPUtime=0.08 cores=1,3,5,7
/proc/25545/task/25548/stat : 25548 (java) T 25543 25545 25545 0 -1 4202560 375 0 0 0 8 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239476648247 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25545/tid=25549] ppid=25543 vsize=8536576 CPUtime=0.07 cores=1,3,5,7
/proc/25545/task/25549/stat : 25549 (java) T 25543 25545 25545 0 -1 4202560 254 0 0 0 7 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 47555961316514 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25545/tid=25550] ppid=25543 vsize=8536576 CPUtime=0.06 cores=1,3,5,7
/proc/25545/task/25550/stat : 25550 (java) T 25543 25545 25545 0 -1 4202560 7 0 0 0 6 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239476648247 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25545/tid=25551] ppid=25543 vsize=8536576 CPUtime=0.06 cores=1,3,5,7
/proc/25545/task/25551/stat : 25551 (java) T 25543 25545 25545 0 -1 4202560 138 0 0 0 6 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25552] ppid=25543 vsize=8536576 CPUtime=0.06 cores=1,3,5,7
/proc/25545/task/25552/stat : 25552 (java) T 25543 25545 25545 0 -1 4202560 38 0 0 0 6 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25553] ppid=25543 vsize=8536576 CPUtime=0.06 cores=1,3,5,7
/proc/25545/task/25553/stat : 25553 (java) T 25543 25545 25545 0 -1 4202560 37 0 0 0 6 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239476648247 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25545/tid=25554] ppid=25543 vsize=8536576 CPUtime=0.05 cores=1,3,5,7
/proc/25545/task/25554/stat : 25554 (java) T 25543 25545 25545 0 -1 4202560 146 0 0 0 5 0 0 0 15 0 19 0 869487750 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25555] ppid=25543 vsize=8536576 CPUtime=1.22 cores=1,3,5,7
/proc/25545/task/25555/stat : 25555 (java) T 25543 25545 25545 0 -1 4202560 1594 0 0 0 121 1 0 0 15 0 19 0 869487751 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 0 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=25545/tid=25556] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25556/stat : 25556 (java) T 25543 25545 25545 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869487752 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25557] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25557/stat : 25557 (java) T 25543 25545 25545 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869487752 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25558] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25558/stat : 25558 (java) T 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487754 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488518577 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25559] ppid=25543 vsize=8536576 CPUtime=0.39 cores=1,3,5,7
/proc/25545/task/25559/stat : 25559 (java) T 25543 25545 25545 0 -1 4202560 2196 0 0 0 38 1 0 0 15 0 19 0 869487754 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25560] ppid=25543 vsize=8536576 CPUtime=0.23 cores=1,3,5,7
/proc/25545/task/25560/stat : 25560 (java) T 25543 25545 25545 0 -1 4202560 1713 0 0 0 23 0 0 0 15 0 19 0 869487754 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25561] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25561/stat : 25561 (java) T 25543 25545 25545 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869487754 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488510873 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25545/tid=25562] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25562/stat : 25562 (java) T 25543 25545 25545 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869487754 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=25545/tid=25563] ppid=25543 vsize=8536576 CPUtime=0 cores=1,3,5,7
/proc/25545/task/25563/stat : 25563 (java) T 25543 25545 25545 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869487784 8741453824 15303 33554432000 1073741824 1073778376 140736338964064 18446744073709551615 239488511488 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=25543/tid=25565] ppid=25537 vsize=294404 CPUtime=0 cores=1,3,5,7
/proc/25543/task/25565/stat : 25565 (python) S 25537 25537 23102 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869492328 301469696 5978 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604460409768832 0 0 -1 7 0 0 0
[pid=25566] ppid=25537 vsize=294416 CPUtime=0.42 cores=1,3,5,7
/proc/25566/stat : 25566 (python) S 25537 25537 23102 0 -1 4202560 1112 0 0 0 19 23 0 0 19 0 2 0 869492330 301481984 5968 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25566/statm: 73604 5968 397 364 0 8488 0
[pid=25568] ppid=25566 vsize=21772 CPUtime=82.52 cores=1,3,5,7
/proc/25568/stat : 25568 (pbct-0.1.2-linu) T 25566 25568 25568 0 -1 4202496 5277 0 0 0 4724 3528 0 0 25 0 1 0 869492331 22294528 5013 33554432000 134512640 136422188 4293727632 18446744073709551615 135874785 0 0 16781312 16387 18446744071562691360 0 0 17 3 0 0 0
/proc/25568/statm: 5443 5013 237 467 0 4974 0
[pid=25566/tid=25571] ppid=25537 vsize=294416 CPUtime=0 cores=1,3,5,7
/proc/25566/task/25571/stat : 25571 (python) S 25537 25537 23102 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 869500584 301481984 5968 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604457854035072 0 0 -1 7 0 0 0
[pid=25572] ppid=25537 vsize=305176 CPUtime=0.23 cores=1,3,5,7
/proc/25572/stat : 25572 (python) S 25537 25537 23102 0 -1 4202560 1100 0 0 0 10 13 0 0 17 0 2 0 869500587 312500224 6098 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25572/statm: 76294 6098 397 364 0 11175 0
[pid=25574] ppid=25572 vsize=3652 CPUtime=45.8 cores=1,3,5,7
/proc/25574/stat : 25574 (clasp-1.3.7-x86) T 25572 25574 25574 0 -1 4202496 932 0 0 0 4580 0 0 0 25 0 1 0 869500587 3739648 664 33554432000 134512640 136139019 4288358192 18446744073709551615 134876562 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/25574/statm: 913 664 187 398 0 513 0
[pid=25572/tid=25594] ppid=25537 vsize=305176 CPUtime=0 cores=1,3,5,7
/proc/25572/task/25594/stat : 25594 (python) S 25537 25537 23102 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869505168 312500224 6098 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604456683152384 0 0 -1 7 0 0 0
[pid=25595] ppid=25537 vsize=315432 CPUtime=0.26 cores=1,3,5,7
/proc/25595/stat : 25595 (python) S 25537 25537 23102 0 -1 4202560 1177 0 0 0 12 14 0 0 16 0 2 0 869505170 323002368 6108 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25595/statm: 78858 6108 403 364 0 13736 0
[pid=25597] ppid=25595 vsize=132744 CPUtime=48.62 cores=1,3,5,7
/proc/25597/stat : 25597 (wbo1.4a) T 25595 25597 25597 0 -1 4202496 33031 0 0 0 4772 90 0 0 25 0 1 0 869505170 135929856 32689 33554432000 134512640 135751879 4292661536 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/25597/statm: 33186 32689 146 303 0 32881 0
[pid=25595/tid=25600] ppid=25537 vsize=315432 CPUtime=0 cores=1,3,5,7
/proc/25595/task/25600/stat : 25600 (python) S 25537 25537 23102 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869510034 323002368 6108 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604455695667456 0 0 -1 7 0 0 0
[pid=25601] ppid=25537 vsize=325688 CPUtime=0.27 cores=1,3,5,7
/proc/25601/stat : 25601 (python) S 25537 25537 23102 0 -1 4202560 1174 0 0 0 12 15 0 0 16 0 2 0 869510037 333504512 6112 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25601/statm: 81422 6112 403 364 0 16297 0
[pid=25603] ppid=25601 vsize=85900 CPUtime=50.7 cores=1,3,5,7
/proc/25603/stat : 25603 (scip-2.0.1.linu) T 25601 25603 25603 0 -1 4202496 23677 0 0 0 4894 176 0 0 25 0 1 0 869510037 87961600 18955 33554432000 4194304 13684479 140734584337680 18446744073709551615 7268195 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/25603/statm: 21475 18955 801 2317 0 19153 0
[pid=25601/tid=25605] ppid=25537 vsize=325688 CPUtime=0 cores=1,3,5,7
/proc/25601/task/25605/stat : 25605 (python) S 25537 25537 23102 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869515108 333504512 6112 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604460173566336 0 0 -1 7 0 0 0
[pid=25606] ppid=25537 vsize=335944 CPUtime=0.27 cores=1,3,5,7
/proc/25606/stat : 25606 (python) S 25537 25537 23102 0 -1 4202560 1154 0 0 0 11 16 0 0 16 0 2 0 869515110 344006656 6110 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488521675 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/25606/statm: 83986 6110 397 364 0 18858 0
[pid=25608] ppid=25606 vsize=73216 CPUtime=50.95 cores=1,3,5,7
/proc/25608/stat : 25608 (scip-2.0.1.linu) T 25606 25608 25608 0 -1 4202496 35583 0 0 0 5046 49 0 0 25 0 1 0 869515111 74973184 14103 33554432000 4194304 15243407 140733696154992 18446744073709551615 8113827 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/25608/statm: 18304 14103 918 2698 0 15599 0
[pid=25606/tid=25610] ppid=25537 vsize=335944 CPUtime=0 cores=1,3,5,7
/proc/25606/task/25610/stat : 25610 (python) S 25537 25537 23102 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869520207 344006656 6110 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554946 18446604468280425216 0 0 -1 7 0 0 0
[pid=25611] ppid=25537 vsize=346200 CPUtime=0 cores=1,3,5,7
/proc/25611/stat : 25611 (python) S 25537 25537 23102 0 -1 4202560 819 0 0 0 0 0 0 0 16 0 1 0 869520210 354508800 6065 33554432000 4194304 5683644 140734836236768 18446744073709551615 239476715078 0 0 16781312 33554946 377852483759767552 0 0 17 3 0 0 0
/proc/25611/statm: 86550 6065 349 364 0 21419 0
[pid=25613] ppid=25611 vsize=8536696 CPUtime=0.58 cores=1,3,5,7
/proc/25613/stat : 25613 (java) S 25611 25613 25613 0 -1 4202496 12344 0 1 0 57 1 0 0 17 0 18 0 869520210 8741576704 10960 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488497637 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/25613/statm: 2134174 10961 2202 9 0 2124915 0
[pid=25613/tid=25614] ppid=25611 vsize=8536696 CPUtime=0.32 cores=1,3,5,7
/proc/25613/task/25614/stat : 25614 (java) R 25611 25613 25613 0 -1 4202560 8479 0 1 0 31 1 0 0 21 0 18 0 869520211 8741576704 11173 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 46912505550468 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=25613/tid=25615] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25615/stat : 25615 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 18 0 869520212 8741576704 11175 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25616] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25616/stat : 25616 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11177 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25617] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25617/stat : 25617 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11179 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25618] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25618/stat : 25618 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11180 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25619] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25619/stat : 25619 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11182 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25620] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25620/stat : 25620 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11184 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25621] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25621/stat : 25621 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11186 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25622] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25622/stat : 25622 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520212 8741576704 11188 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 3 0 0 0
[pid=25613/tid=25623] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25623/stat : 25623 (java) S 25611 25613 25613 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 18 0 869520213 8741576704 11189 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488511488 0 0 0 16800975 18446604462575971200 0 0 -1 7 0 0 0
[pid=25613/tid=25624] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25624/stat : 25624 (java) S 25611 25613 25613 0 -1 4202560 16 0 0 0 0 0 0 0 21 0 18 0 869520213 8741576704 11191 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 7 0 0 0
[pid=25613/tid=25625] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25625/stat : 25625 (java) S 25611 25613 25613 0 -1 4202560 7 0 0 0 0 0 0 0 22 0 18 0 869520213 8741576704 11193 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 7 0 0 0
[pid=25613/tid=25626] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25626/stat : 25626 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 18 0 869520215 8741576704 11195 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488518577 0 4 0 16800975 18446604462575971200 0 0 -1 7 0 0 0
[pid=25613/tid=25627] ppid=25611 vsize=8536696 CPUtime=0.12 cores=1,3,5,7
/proc/25613/task/25627/stat : 25627 (java) S 25611 25613 25613 0 -1 4202560 1111 0 0 0 12 0 0 0 18 0 18 0 869520215 8741576704 11196 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 5 0 0 0
[pid=25613/tid=25628] ppid=25611 vsize=8536696 CPUtime=0.13 cores=1,3,5,7
/proc/25613/task/25628/stat : 25628 (java) S 25611 25613 25613 0 -1 4202560 1573 0 0 0 13 0 0 0 19 0 18 0 869520216 8741576704 11198 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 5 0 0 0
[pid=25613/tid=25629] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25629/stat : 25629 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869520216 8741576704 11200 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488510873 0 4 0 16800975 18446604462575971200 0 0 -1 7 0 0 0
[pid=25613/tid=25630] ppid=25611 vsize=8536696 CPUtime=0 cores=1,3,5,7
/proc/25613/task/25630/stat : 25630 (java) S 25611 25613 25613 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869520216 8741576704 11202 33554432000 1073741824 1073778376 140734861793456 18446744073709551615 239488511488 0 4 0 16800975 18446604462575971200 0 0 -1 5 0 0 0
[pid=25537/tid=25544] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25544/stat : 25544 (python) S 25535 25537 23102 0 -1 4202560 28 931 0 0 0 0 0 0 19 0 8 0 869487749 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 5 0 0 0
[pid=25537/tid=25567] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25567/stat : 25567 (python) S 25535 25537 23102 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 8 0 869492331 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 5 0 0 0
[pid=25537/tid=25573] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25573/stat : 25573 (python) S 25535 25537 23102 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 8 0 869500587 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 5 0 0 0
[pid=25537/tid=25596] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25596/stat : 25596 (python) S 25535 25537 23102 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 8 0 869505170 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 3 0 0 0
[pid=25537/tid=25602] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25602/stat : 25602 (python) S 25535 25537 23102 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 8 0 869510037 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 1 0 0 0
[pid=25537/tid=25607] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25607/stat : 25607 (python) S 25535 25537 23102 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 8 0 869515111 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 7 0 0 0
[pid=25537/tid=25612] ppid=25535 vsize=356444 CPUtime=0 cores=1,3,5,7
/proc/25537/task/25612/stat : 25612 (python) S 25535 25537 23102 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 8 0 869520210 364998656 7603 33554432000 4194304 5683644 140734836236768 18446744073709551615 239488518577 0 0 16781312 33554434 18446604460144817344 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 328.29
Current children cumulated vsize (KiB) 19964260

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25537 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=633903
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=115982
# CPU time returned by wait4() is 0.749885
# while last known CPU time is 328.29
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 325.702
CPU time (s): 328.29
CPU user time (s): 288.72
CPU system time (s): 39.57
CPU usage (%): 100.795
Max. virtual memory (cumulated for all children) (KiB): 19964260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.633903
system time used= 0.115982
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16434
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1017
involuntary context switches= 28

runsolver used 2.27265 second user time and 5.81912 second system time

The end

Launcher Data 

Begin job on node148 at 2011-06-09 02:21:46
IDJOB=3482298
IDBENCH=89845
IDSOLVER=1970
FILE ID=node148/3482298-1307578905
RUNJOBID= node148-1307576353-23121
PBS_JOBID= 13547651
Free space on /tmp= 73516 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-iis-bupa-cov.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482298-1307578905/watcher-3482298-1307578905 -o /tmp/evaluation-result-3482298-1307578905/solver-3482298-1307578905 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3482298-1307578905.opb -seed 17868000 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7fb5c1a630b78d8604b800edf1958e29
RANDOM SEED=17868000

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      10574604 kB
Buffers:        196720 kB
Cached:         889588 kB
SwapCached:       8984 kB
Active:       21829928 kB
Inactive:       238448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      10574604 kB
SwapTotal:    67111528 kB
SwapFree:     67056572 kB
Dirty:          103492 kB
Writeback:           0 kB
AnonPages:    20979732 kB
Mapped:         123356 kB
Slab:           139980 kB
PageTables:      92196 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 189888520 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node148 at 2011-06-09 02:27:14