Trace number 3321785

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9457.74 1190.31

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S926861876-013-UNKNOWN.cnf
MD5SUMaa5d2fab702f701bf63e2d26e76ab2b3
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.67	c INFO: solving HOME/instance-3321785-1304367246.cnf
0.37/0.67	c INFO: computing task features
0.55/0.84	c INFO: computed variable-clause graph statistics
0.55/0.85	c INFO: computed clause balance statistics
1.45/1.75	c INFO: computed variable balance statistics
1.85/2.12	c INFO: computed small-clause counts
1.85/2.12	c INFO: computed Horn-clause counts
1.85/2.15	c INFO: computed variable graph statistics
1.85/2.15	c INFO: collected features for HOME/instance-3321785-1304367246.cnf in 1.47 s
1.85/2.19	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.95/2.22	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.95/2.26	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
2.05/2.30	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.05/2.34	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.05/2.38	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.14/2.42	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.14/2.46	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
781.09/100.69	c INFO: running adaptg2wsat2009++@0 for 97 with 39900 remaining (b = 0.02)
788.23/101.55	c INFO: running FH@0 for 97 with 39899 remaining (b = 0.02)
796.16/102.50	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
796.16/102.58	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
796.83/102.68	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
797.37/102.74	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.01)
799.42/103.22	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
814.32/104.87	c INFO: running hybridGM3@0 for 194 with 39895 remaining (b = 0.02)
1581.01/200.97	c INFO: running TNM@0 for 1552 with 39799 remaining (b = 0.19)
1588.15/201.83	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1596.91/202.93	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1599.33/203.23	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2355.74/298.11	c INFO: running hybridGM3@97 for 97 with 39702 remaining (b = 0.01)
2364.51/299.23	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2368.41/299.76	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2372.43/300.22	c INFO: running adaptg2wsat2009++@98 for 97 with 39700 remaining (b = 0.01)
2373.96/300.43	c INFO: running hybridGM3@100 for 97 with 39700 remaining (b = 0.01)
2374.75/300.50	c INFO: running hybridGM3@0 for 194 with 39700 remaining (b = 0.02)
2387.46/302.12	c INFO: running hybridGM3@0 for 194 with 39698 remaining (b = 0.02)
3123.94/394.50	c INFO: running hybridGM3@294 for 97 with 39606 remaining (b = 0.01)
3139.87/396.51	c INFO: running TNM@0 for 1552 with 39604 remaining (b = 0.15)
3162.25/399.40	c INFO: running hybridGM3@293 for 97 with 39601 remaining (b = 0.01)
3175.69/401.04	c INFO: running adaptg2wsat2009++@0 for 97 with 39599 remaining (b = 0.01)
3181.26/401.72	c INFO: running adaptg2wsat2009++@99 for 97 with 39599 remaining (b = 0.01)
3921.62/494.67	c INFO: running FH@0 for 291 with 39506 remaining (b = 0.03)
3930.37/495.79	c INFO: running gnovelty+2@0 for 97 with 39504 remaining (b = 0.01)
3940.71/497.06	c INFO: running hybridGM3@99 for 97 with 39503 remaining (b = 0.01)
3943.90/497.40	c INFO: running hybridGM3@394 for 97 with 39503 remaining (b = 0.01)
3945.50/497.68	c INFO: running hybridGM3@95 for 97 with 39503 remaining (b = 0.01)
3956.62/499.01	c INFO: running hybridGM3@390 for 97 with 39501 remaining (b = 0.01)
4730.55/596.14	c INFO: running iPAWS@0 for 97 with 39404 remaining (b = 0.01)
4734.02/596.70	c INFO: running adaptg2wsat2009++@292 for 291 with 39404 remaining (b = 0.02)
4739.26/597.30	c INFO: running FH@100 for 291 with 39403 remaining (b = 0.02)
4748.84/598.43	c INFO: running iPAWS@0 for 97 with 39402 remaining (b = 0.01)
4752.29/598.99	c INFO: running hybridGM3@192 for 97 with 39401 remaining (b = 0.01)
5528.88/696.45	c INFO: running hybridGM3@0 for 194 with 39304 remaining (b = 0.02)
5547.18/698.74	c INFO: running TNM@0 for 1552 with 39302 remaining (b = 0.11)
5559.89/700.30	c INFO: running hybridGM3@292 for 97 with 39300 remaining (b = 0.01)
6228.58/784.37	c INFO: running adaptg2wsat2009++@99 for 97 with 39216 remaining (b = 0.01)
6318.42/795.62	c INFO: running FH@0 for 97 with 39205 remaining (b = 0.01)
7003.81/881.75	c INFO: running gnovelty+2@0 for 97 with 39119 remaining (b = 0.01)
7041.19/886.42	c INFO: running adaptg2wsat2009++@388 for 194 with 39114 remaining (b = 0.01)
7093.74/893.05	c INFO: running hybridGM3@0 for 194 with 39107 remaining (b = 0.01)
7094.56/893.16	c INFO: running hybridGM3@99 for 97 with 39107 remaining (b = 0.01)
7116.79/895.95	c INFO: running NCVWr@0 for 485 with 39104 remaining (b = 0.03)
7802.88/982.15	c INFO: running FH@201 for 194 with 39018 remaining (b = 0.01)
7900.82/994.48	c INFO: running hybridGM3@0 for 194 with 39006 remaining (b = 0.01)
8613.08/1083.96	c INFO: running adaptg2wsat2009++@682 for 97 with 38916 remaining (b = 0.01)
8658.41/1089.66	c INFO: running iPAWS@0 for 97 with 38911 remaining (b = 0.01)
9342.37/1175.70	c INFO: running FH@302 for 97 with 38825 remaining (b = 0.01)
9371.01/1179.28	c INFO: running adaptg2wsat2009++@878 for 97 with 38821 remaining (b = 0.01)
9456.81/1190.01	c INFO: running hybridGM3@0 for 194 with 38810 remaining (b = 0.01)
9457.74/1190.29	c INFO: running FH@99 for 291 with 38810 remaining (b = 0.02)
9457.74/1190.29	Traceback (most recent call last):
9457.74/1190.29	  File "HOME/solve", line 33, in <module>
9457.74/1190.29	    plac.call(main)
9457.74/1190.29	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
9457.74/1190.29	    cmd, result = parser_from(obj).consume(arglist)
9457.74/1190.29	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
9457.74/1190.29	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
9457.74/1190.29	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
9457.74/1190.29	    (_, answer, _) = solver(input_path, budget, cores)
9457.74/1190.29	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
9457.74/1190.29	    solver.go(max_cost * borg.defaults.machine_speed)
9457.74/1190.29	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
9457.74/1190.29	    self._process.start()
9457.74/1190.29	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
9457.74/1190.29	    assert self._popen is None, 'cannot start a process twice'
9457.74/1190.29	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321785-1304367246/watcher-3321785-1304367246 -o /tmp/evaluation-result-3321785-1304367246/solver-3321785-1304367246 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321785-1304367246.cnf -seed 2129846060 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 1.18 0.68 2/265 5635
/proc/meminfo: memFree=27314088/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=15184 CPUtime=0 cores=0-7
/proc/5635/stat : 5635 (python) R 5633 5635 5551 0 -1 4202496 725 0 0 0 0 0 0 0 25 0 1 0 548323234 15548416 615 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970548224 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5635/statm: 3796 615 321 364 0 283 0

[startup+0.087205 s]
/proc/loadavg: 2.08 1.18 0.68 2/265 5635
/proc/meminfo: memFree=27314088/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=54536 CPUtime=0.05 cores=0-7
/proc/5635/stat : 5635 (python) R 5633 5635 5551 0 -1 4202496 2054 0 0 0 4 1 0 0 25 0 1 0 548323234 55844864 1811 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970593415 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5635/statm: 13634 1811 492 364 0 1284 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 54536

[startup+0.100194 s]
/proc/loadavg: 2.08 1.18 0.68 2/265 5635
/proc/meminfo: memFree=27314088/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=85620 CPUtime=0.05 cores=0-7
/proc/5635/stat : 5635 (python) R 5633 5635 5551 0 -1 4202496 2631 0 0 0 4 1 0 0 25 0 1 0 548323234 87674880 2348 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970548224 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5635/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.300181 s]
/proc/loadavg: 2.08 1.18 0.68 2/265 5635
/proc/meminfo: memFree=27314088/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=135752 CPUtime=0.19 cores=0-7
/proc/5635/stat : 5635 (python) S 5633 5635 5551 0 -1 4202496 5961 937 1 0 14 5 0 0 17 0 1 0 548323234 139010048 4152 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970546181 0 2147483391 16781312 2 18446744071699109054 0 0 17 4 0 0 0
/proc/5635/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.701102 s]
/proc/loadavg: 2.08 1.18 0.68 2/265 5635
/proc/meminfo: memFree=27314088/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=279712 CPUtime=0.45 cores=0-7
/proc/5635/stat : 5635 (python) R 5633 5635 5551 0 -1 4202496 9579 937 1 0 34 11 0 0 16 0 1 0 548323234 286425088 7263 33554432000 4194304 5683644 140737221038064 18446744073709551615 4570201 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5635/statm: 69928 7263 1761 364 0 5852 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 279712

[startup+1.50095 s]
/proc/loadavg: 2.08 1.18 0.68 2/266 5640
/proc/meminfo: memFree=27285560/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=285636 CPUtime=1.25 cores=0-7
/proc/5635/stat : 5635 (python) R 5633 5635 5551 0 -1 4202496 12500 937 1 0 114 11 0 0 17 0 1 0 548323234 292491264 8794 33554432000 4194304 5683644 140737221038064 18446744073709551615 47055854650373 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/5635/statm: 71409 8794 1826 364 0 7333 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 285636

[startup+3.10064 s]
/proc/loadavg: 2.08 1.18 0.68 2/266 5640
/proc/meminfo: memFree=27285184/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=427848 CPUtime=2.21 cores=0-7
/proc/5635/stat : 5635 (python) S 5633 5635 5551 0 -1 4202496 18916 937 1 0 208 13 0 0 25 0 9 0 548323234 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5635/statm: 106962 7564 1891 364 0 42859 0
Current children cumulated CPU time (s) 2.21
Current children cumulated vsize (KiB) 427848
heavy processes:

[startup+6.30109 s]
/proc/loadavg: 2.55 1.29 0.72 9/290 5664
/proc/meminfo: memFree=27225068/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=427848 CPUtime=2.21 cores=0-7
/proc/5635/stat : 5635 (python) S 5633 5635 5551 0 -1 4202496 18916 937 1 0 208 13 0 0 25 0 9 0 548323234 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5635/statm: 106962 7564 1891 364 0 42859 0
[pid=5641] ppid=5635 vsize=280760 CPUtime=0 cores=0-7
/proc/5641/stat : 5641 (python) S 5635 5635 5551 0 -1 4202560 901 0 0 0 0 0 0 0 18 0 1 0 548323453 287498240 6000 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570255 0 0 16781312 514 4955164109390708995 0 0 17 1 0 0 0
/proc/5641/statm: 70190 6000 377 364 0 6108 0
[pid=5643] ppid=5641 vsize=1019708 CPUtime=3.96 cores=0-7
/proc/5643/stat : 5643 (gnovelty+2) R 5641 5643 5643 0 -1 4202496 952 0 0 0 396 0 0 0 25 0 1 0 548323453 1044180992 690 33554432000 134512640 135663704 4290052720 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/5643/statm: 254927 690 113 282 0 254643 0
[pid=5644] ppid=5635 vsize=291084 CPUtime=0 cores=0-7
/proc/5644/stat : 5644 (python) S 5635 5635 5551 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 548323456 298070016 5999 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 8401363679206932738 0 0 17 1 0 0 0
/proc/5644/statm: 72771 5999 372 364 0 8686 0
[pid=5646] ppid=5644 vsize=1019708 CPUtime=4.06 cores=0-7
/proc/5646/stat : 5646 (gnovelty+2) R 5644 5646 5646 0 -1 4202496 951 0 0 0 406 0 0 0 25 0 1 0 548323457 1044180992 690 33554432000 134512640 135663704 4287514144 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5646/statm: 254927 690 113 282 0 254643 0
[pid=5647] ppid=5635 vsize=366808 CPUtime=0 cores=0-7
/proc/5647/stat : 5647 (python) S 5635 5635 5551 0 -1 4202560 911 0 0 0 0 0 0 0 18 0 1 0 548323460 375611392 6021 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 8401359830916235524 0 0 17 7 0 0 0
/proc/5647/statm: 91702 6021 371 364 0 27614 0
[pid=5649] ppid=5647 vsize=420220 CPUtime=4.02 cores=0-7
/proc/5649/stat : 5649 (adaptg2wsat2009) R 5647 5649 5649 0 -1 4202496 1667 0 0 0 402 0 0 0 25 0 1 0 548323461 430305280 1399 33554432000 134512640 135107411 4292286592 18446744073709551615 134531848 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5649/statm: 105055 1399 59 146 0 103931 0
[pid=5650] ppid=5635 vsize=377132 CPUtime=0.03 cores=0-7
/proc/5650/stat : 5650 (python) S 5635 5635 5551 0 -1 4202560 749 0 0 0 2 1 0 0 18 0 1 0 548323464 386183168 6003 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 7444504889041846529 0 0 17 4 0 0 0
/proc/5650/statm: 94283 6003 349 364 0 30192 0
[pid=5652] ppid=5650 vsize=419820 CPUtime=3.93 cores=0-7
/proc/5652/stat : 5652 (adaptg2wsat2009) R 5650 5652 5652 0 -1 4202496 1437 0 0 0 393 0 0 0 25 0 1 0 548323464 429895680 1172 33554432000 134512640 135107411 4293510656 18446744073709551615 134523257 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5652/statm: 104955 1172 49 146 0 103831 0
[pid=5653] ppid=5635 vsize=387320 CPUtime=0 cores=0-7
/proc/5653/stat : 5653 (python) S 5635 5635 5551 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 548323468 396615680 6007 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 1078410079788564739 0 0 17 6 0 0 0
/proc/5653/statm: 96830 6007 349 364 0 32736 0
[pid=5655] ppid=5653 vsize=419820 CPUtime=2.84 cores=0-7
/proc/5655/stat : 5655 (adaptg2wsat2009) R 5653 5655 5655 0 -1 4202496 1440 0 0 0 275 9 0 0 25 0 1 0 548323468 429895680 1172 33554432000 134512640 135107411 4294261808 18446744073709551615 134523310 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/5655/statm: 104955 1172 49 146 0 103831 0
[pid=5656] ppid=5635 vsize=398184 CPUtime=0 cores=0-7
/proc/5656/stat : 5656 (python) S 5635 5635 5551 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 548323472 407740416 6011 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 4955160261100011778 0 0 17 0 0 0 0
/proc/5656/statm: 99546 6011 349 364 0 35449 0
[pid=5658] ppid=5656 vsize=1019708 CPUtime=3.88 cores=0-7
/proc/5658/stat : 5658 (gnovelty+2) R 5656 5658 5658 0 -1 4202496 954 0 0 0 388 0 0 0 25 0 1 0 548323473 1044180992 690 33554432000 134512640 135663704 4293686096 18446744073709551615 134545598 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5658/statm: 254927 690 113 282 0 254643 0
[pid=5659] ppid=5635 vsize=407900 CPUtime=0 cores=0-7
/proc/5659/stat : 5659 (python) S 5635 5635 5551 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 548323476 417689600 6015 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 11159333841221419265 0 0 17 0 0 0 0
/proc/5659/statm: 101975 6015 349 364 0 37875 0
[pid=5661] ppid=5659 vsize=247956 CPUtime=3.78 cores=0-7
/proc/5661/stat : 5661 (FH) R 5659 5661 5661 0 -1 4202496 1250 0 0 0 378 0 0 0 25 0 1 0 548323477 253906944 987 33554432000 134512640 134936988 4289524336 18446744073709551615 134523434 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5661/statm: 61989 987 37 104 0 61493 0
[pid=5662] ppid=5635 vsize=418224 CPUtime=0 cores=0-7
/proc/5662/stat : 5662 (python) S 5635 5635 5551 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 1 0 548323480 428261376 6025 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 11159326144640024835 0 0 17 6 0 0 0
/proc/5662/statm: 104556 6025 355 364 0 40453 0
[pid=5664] ppid=5662 vsize=419820 CPUtime=3.82 cores=0-7
/proc/5664/stat : 5664 (adaptg2wsat2009) R 5662 5664 5664 0 -1 4202496 1443 0 0 0 382 0 0 0 25 0 1 0 548323481 429895680 1172 33554432000 134512640 135107411 4291100016 18446744073709551615 134523424 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5664/statm: 104955 1172 49 146 0 103831 0
[pid=5635/tid=5642] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5642/stat : 5642 (python) S 5633 5635 5551 0 -1 4202560 27 937 0 0 0 0 0 0 19 0 9 0 548323453 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5645] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5645/stat : 5645 (python) S 5633 5635 5551 0 -1 4202560 20 937 0 0 0 0 0 0 17 0 9 0 548323457 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 3 0 0 0
[pid=5635/tid=5648] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5648/stat : 5648 (python) S 5633 5635 5551 0 -1 4202560 20 937 0 0 0 0 0 0 20 0 9 0 548323460 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5651] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5651/stat : 5651 (python) S 5633 5635 5551 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 9 0 548323464 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5654] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5654/stat : 5654 (python) S 5633 5635 5551 0 -1 4202560 23 937 0 0 0 0 0 0 22 0 9 0 548323468 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 4 0 0 0
[pid=5635/tid=5657] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5657/stat : 5657 (python) S 5633 5635 5551 0 -1 4202560 25 937 0 0 0 0 0 0 24 0 9 0 548323472 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5660] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5660/stat : 5660 (python) S 5633 5635 5551 0 -1 4202560 26 937 0 0 0 0 0 0 25 0 9 0 548323476 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5663] ppid=5633 vsize=427848 CPUtime=0 cores=0-7
/proc/5635/task/5663/stat : 5663 (python) S 5633 5635 5551 0 -1 4202560 89 937 0 0 0 0 0 0 25 0 9 0 548323481 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 32.53
Current children cumulated vsize (KiB) 8342020

[startup+12.701 s]
/proc/loadavg: 3.31 1.47 0.78 9/290 5664
/proc/meminfo: memFree=27218680/32951132 swapFree=67111364/67111528
[pid=5635] ppid=5633 vsize=427848 CPUtime=2.21 cores=0-7
/proc/5635/stat : 5635 (python) S 5633 5635 5551 0 -1 4202496 18916 937 1 0 208 13 0 0 25 0 9 0 548323234 438116352 7564 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5635/statm: 106962 7564 1891 364 0 42859 0
[pid=5641] ppid=5635 vsize=280760 CPUtime=0.11 cores=0-7
/proc/5641/stat : 5641 (python) S 5635 5635 5551 0 -1 4202560 904 0 0 0 5 6 0 0 18 0 1 0 548323453 287498240 6001 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570255 0 0 16781312 514 608707229322805507 0 0 17 7 0 0 0
/proc/5641/statm: 70190 6001 378 364 0 6108 0
[pid=5643] ppid=5641 vsize=1019708 CPUtime=10.34 cores=0-7
/proc/5643/stat : 5643 (gnovelty+2) R 5641 5643 5643 0 -1 4202496 952 0 0 0 1034 0 0 0 25 0 1 0 548323453 1044180992 690 33554432000 134512640 135663704 4290052720 18446744073709551615 134525316 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/5643/statm: 254927 690 113 282 0 254643 0
[pid=5644] ppid=5635 vsize=291084 CPUtime=0.02 cores=0-7
/proc/5644/stat : 5644 (python) S 5635 5635 5551 0 -1 4202560 905 0 0 0 1 1 0 0 18 0 1 0 548323456 298070016 5999 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805506 0 0 17 2 0 0 0
/proc/5644/statm: 72771 5999 372 364 0 8686 0
[pid=5646] ppid=5644 vsize=1019708 CPUtime=10.46 cores=0-7
/proc/5646/stat : 5646 (gnovelty+2) R 5644 5646 5646 0 -1 4202496 951 0 0 0 1046 0 0 0 25 0 1 0 548323457 1044180992 690 33554432000 134512640 135663704 4287514144 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/5646/statm: 254927 690 113 282 0 254643 0
[pid=5647] ppid=5635 vsize=366808 CPUtime=0.02 cores=0-7
/proc/5647/stat : 5647 (python) S 5635 5635 5551 0 -1 4202560 914 0 0 0 1 1 0 0 18 0 1 0 548323460 375611392 6022 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805508 0 0 17 7 0 0 0
/proc/5647/statm: 91702 6022 372 364 0 27614 0
[pid=5649] ppid=5647 vsize=420220 CPUtime=10.42 cores=0-7
/proc/5649/stat : 5649 (adaptg2wsat2009) R 5647 5649 5649 0 -1 4202496 1667 0 0 0 1042 0 0 0 25 0 1 0 548323461 430305280 1399 33554432000 134512640 135107411 4292286592 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5649/statm: 105055 1399 59 146 0 103931 0
[pid=5650] ppid=5635 vsize=377132 CPUtime=0.95 cores=0-7
/proc/5650/stat : 5650 (python) S 5635 5635 5551 0 -1 4202560 905 0 0 0 47 48 0 0 18 0 1 0 548323464 386183168 6026 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 7444504889041846529 0 0 17 4 0 0 0
/proc/5650/statm: 94283 6026 372 364 0 30192 0
[pid=5652] ppid=5650 vsize=420220 CPUtime=8.38 cores=0-7
/proc/5652/stat : 5652 (adaptg2wsat2009) R 5650 5652 5652 0 -1 4202496 1665 0 0 0 827 11 0 0 25 0 1 0 548323464 430305280 1400 33554432000 134512640 135107411 4293510656 18446744073709551615 134532110 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5652/statm: 105055 1400 59 146 0 103931 0
[pid=5653] ppid=5635 vsize=387320 CPUtime=0.02 cores=0-7
/proc/5653/stat : 5653 (python) S 5635 5635 5551 0 -1 4202560 915 0 0 0 1 1 0 0 18 0 1 0 548323468 396615680 6030 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805507 0 0 17 6 0 0 0
/proc/5653/statm: 96830 6030 372 364 0 32736 0
[pid=5655] ppid=5653 vsize=420220 CPUtime=7.8 cores=0-7
/proc/5655/stat : 5655 (adaptg2wsat2009) R 5653 5655 5655 0 -1 4202496 1667 0 0 0 771 9 0 0 25 0 1 0 548323468 430305280 1399 33554432000 134512640 135107411 4294261808 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5655/statm: 105055 1399 59 146 0 103931 0
[pid=5656] ppid=5635 vsize=398184 CPUtime=0.02 cores=0-7
/proc/5656/stat : 5656 (python) S 5635 5635 5551 0 -1 4202560 945 0 0 0 1 1 0 0 18 0 1 0 548323472 407740416 6034 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805506 0 0 17 0 0 0 0
/proc/5656/statm: 99546 6034 372 364 0 35449 0
[pid=5658] ppid=5656 vsize=1019708 CPUtime=9.55 cores=0-7
/proc/5658/stat : 5658 (gnovelty+2) R 5656 5658 5658 0 -1 4202496 954 0 0 0 950 5 0 0 25 0 1 0 548323473 1044180992 690 33554432000 134512640 135663704 4293686096 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5658/statm: 254927 690 113 282 0 254643 0
[pid=5659] ppid=5635 vsize=407900 CPUtime=0 cores=0-7
/proc/5659/stat : 5659 (python) S 5635 5635 5551 0 -1 4202560 963 0 0 0 0 0 0 0 18 0 1 0 548323476 417689600 6038 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 11159333841221419265 0 0 17 0 0 0 0

################
# More data... #
################

[pid=5734] ppid=5635 vsize=561936 CPUtime=0.21 cores=0-7
/proc/5734/stat : 5734 (python) S 5635 5635 5551 0 -1 4202560 1173 0 0 0 9 12 0 0 19 0 2 0 548372813 575422464 6625 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5734/statm: 140484 6625 407 364 0 76339 0
[pid=5736] ppid=5734 vsize=1019708 CPUtime=99.95 cores=0-7
/proc/5736/stat : 5736 (gnovelty+2) T 5734 5736 5736 0 -1 4202496 967 0 0 0 9993 2 0 0 25 0 1 0 548372814 1044180992 690 33554432000 134512640 135663704 4287669808 18446744073709551615 134525278 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/5736/statm: 254927 690 113 282 0 254643 0
[pid=5734/tid=5742] ppid=5635 vsize=561936 CPUtime=0 cores=0-7
/proc/5734/task/5742/stat : 5742 (python) S 5635 5635 5551 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 548382840 575422464 6625 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604461126996288 0 0 -1 0 0 0 0
[pid=5743] ppid=5635 vsize=572192 CPUtime=0.22 cores=0-7
/proc/5743/stat : 5743 (python) S 5635 5635 5551 0 -1 4202560 1180 0 0 0 12 10 0 0 19 0 2 0 548382848 585924608 6662 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 143048 6662 407 364 0 78900 0
[pid=5745] ppid=5743 vsize=335996 CPUtime=100.16 cores=0-7
/proc/5745/stat : 5745 (iPAWS) T 5743 5745 5745 0 -1 4202496 1813 0 0 0 10016 0 0 0 25 0 1 0 548382848 344059904 1534 33554432000 134512640 135114423 4288905040 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5745/statm: 83999 1534 59 147 0 83851 0
[pid=5743/tid=5752] ppid=5635 vsize=572192 CPUtime=0 cores=0-7
/proc/5743/task/5752/stat : 5752 (python) S 5635 5635 5551 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548392870 585924608 6662 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604470919857152 0 0 -1 1 0 0 0
[pid=5746] ppid=5635 vsize=582448 CPUtime=0.22 cores=0-7
/proc/5746/stat : 5746 (python) S 5635 5635 5551 0 -1 4202560 1192 0 0 0 11 11 0 0 19 0 2 0 548383077 596426752 6667 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5746/statm: 145612 6667 406 364 0 81461 0
[pid=5748] ppid=5746 vsize=335996 CPUtime=99.76 cores=0-7
/proc/5748/stat : 5748 (iPAWS) T 5746 5748 5748 0 -1 4202496 1819 0 0 0 9976 0 0 0 25 0 1 0 548383077 344059904 1537 33554432000 134512640 135114423 4288730560 18446744073709551615 134515649 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/5748/statm: 83999 1537 59 147 0 83851 0
[pid=5746/tid=5756] ppid=5635 vsize=582448 CPUtime=0 cores=0-7
/proc/5746/task/5756/stat : 5756 (python) S 5635 5635 5551 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548393098 596426752 6667 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604471092503808 0 0 -1 0 0 0 0
[pid=5753] ppid=5635 vsize=593248 CPUtime=0.69 cores=0-7
/proc/5753/stat : 5753 (python) S 5635 5635 5551 0 -1 4202560 1326 0 0 0 37 32 0 0 18 0 2 0 548392879 607485952 6642 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5753/statm: 148312 6642 401 364 0 84158 0
[pid=5755] ppid=5753 vsize=268424 CPUtime=297.05 cores=0-7
/proc/5755/stat : 5755 (hybridGM3) T 5753 5755 5755 0 -1 4202496 5413 0 0 0 29702 3 0 0 25 0 1 0 548392880 274866176 5127 33554432000 134512640 135204385 4294022288 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5755/statm: 67106 5127 63 169 0 66936 0
[pid=5753/tid=5771] ppid=5635 vsize=593248 CPUtime=0 cores=0-7
/proc/5753/task/5771/stat : 5771 (python) S 5635 5635 5551 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 548412539 607485952 6642 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604471124310784 0 0 -1 0 0 0 0
[pid=5757] ppid=5635 vsize=602960 CPUtime=1.14 cores=0-7
/proc/5757/stat : 5757 (python) S 5635 5635 5551 0 -1 4202560 974 0 0 0 60 54 0 0 18 0 1 0 548393108 617431040 6616 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805511 0 0 17 1 0 0 0
/proc/5757/statm: 150740 6616 373 364 0 86583 0
[pid=5759] ppid=5757 vsize=458344 CPUtime=475.95 cores=0-7
/proc/5759/stat : 5759 (TNM) R 5757 5759 5759 0 -1 4202496 1518 0 0 0 47593 2 0 0 25 0 1 0 548393108 469344256 1239 33554432000 134512640 135008748 4289070096 18446744073709551615 134529430 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5759/statm: 114586 1239 46 122 0 113486 0
[pid=5762] ppid=5635 vsize=613216 CPUtime=0.23 cores=0-7
/proc/5762/stat : 5762 (python) S 5635 5635 5551 0 -1 4202560 1199 0 0 0 11 12 0 0 19 0 2 0 548402796 627933184 6765 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5762/statm: 153304 6765 400 364 0 89144 0
[pid=5764] ppid=5762 vsize=249872 CPUtime=98.96 cores=0-7
/proc/5764/stat : 5764 (FH) T 5762 5764 5764 0 -1 4202496 1548 0 0 0 9896 0 0 0 25 0 1 0 548402797 255868928 1263 33554432000 134512640 134936988 4289821824 18446744073709551615 134554064 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5764/statm: 62468 1263 41 104 0 61972 0
[pid=5762/tid=5775] ppid=5635 vsize=613216 CPUtime=0 cores=0-7
/proc/5762/task/5775/stat : 5775 (python) S 5635 5635 5551 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 548412819 627933184 6765 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604455588668736 0 0 -1 1 0 0 0
[pid=5768] ppid=5635 vsize=623472 CPUtime=0.23 cores=0-7
/proc/5768/stat : 5768 (python) S 5635 5635 5551 0 -1 4202560 1204 0 0 0 13 10 0 0 19 0 2 0 548411409 638435328 6730 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5768/statm: 155868 6730 401 364 0 91705 0
[pid=5770] ppid=5768 vsize=1019708 CPUtime=100.12 cores=0-7
/proc/5770/stat : 5770 (gnovelty+2) T 5768 5770 5770 0 -1 4202496 971 0 0 0 10012 0 0 0 25 0 1 0 548411411 1044180992 689 33554432000 134512640 135663704 4291962112 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/5770/statm: 254927 689 113 282 0 254643 0
[pid=5768/tid=5781] ppid=5635 vsize=623472 CPUtime=0 cores=0-7
/proc/5768/task/5781/stat : 5781 (python) S 5635 5635 5551 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 548421439 638435328 6730 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604471161840640 0 0 -1 4 0 0 0
[pid=5772] ppid=5635 vsize=633728 CPUtime=0.46 cores=0-7
/proc/5772/stat : 5772 (python) S 5635 5635 5551 0 -1 4202560 1245 0 0 0 27 19 0 0 19 0 2 0 548412539 648937472 6719 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5772/statm: 158432 6719 406 364 0 94266 0
[pid=5774] ppid=5772 vsize=268428 CPUtime=195.54 cores=0-7
/proc/5774/stat : 5774 (hybridGM3) T 5772 5774 5774 0 -1 4202496 5416 0 0 0 19551 3 0 0 25 0 1 0 548412539 274870272 5127 33554432000 134512640 135204385 4289509344 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/5774/statm: 67107 5127 63 169 0 66937 0
[pid=5772/tid=5788] ppid=5635 vsize=633728 CPUtime=0 cores=0-7
/proc/5772/task/5788/stat : 5788 (python) S 5635 5635 5551 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 548432190 648937472 6719 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604471113781440 0 0 -1 1 0 0 0
[pid=5776] ppid=5635 vsize=643984 CPUtime=0.69 cores=0-7
/proc/5776/stat : 5776 (python) S 5635 5635 5551 0 -1 4202560 1039 0 0 0 37 32 0 0 18 0 1 0 548412829 659439616 6869 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805510 0 0 17 5 0 0 0
/proc/5776/statm: 160996 6869 379 364 0 96827 0
[pid=5778] ppid=5776 vsize=419780 CPUtime=292.55 cores=0-7
/proc/5778/stat : 5778 (NCVWr) R 5776 5778 5778 0 -1 4202496 1564 0 0 0 29255 0 0 0 25 0 1 0 548412830 429854720 1282 33554432000 134512640 135113558 4287470208 18446744073709551615 134533479 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/5778/statm: 104945 1282 58 147 0 103820 0
[pid=5783] ppid=5635 vsize=654240 CPUtime=0.46 cores=0-7
/proc/5783/stat : 5783 (python) S 5635 5635 5551 0 -1 4202560 1048 0 0 0 22 24 0 0 18 0 1 0 548422682 669941760 6880 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 608707229322805508 0 0 17 5 0 0 0
/proc/5783/statm: 163560 6880 378 364 0 99388 0
[pid=5785] ppid=5783 vsize=268420 CPUtime=190.35 cores=0-7
/proc/5785/stat : 5785 (hybridGM3) R 5783 5785 5785 0 -1 4202496 5415 0 0 0 19034 1 0 0 25 0 1 0 548422683 274862080 5125 33554432000 134512640 135204385 4291476736 18446744073709551615 134537795 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5785/statm: 67105 5125 63 169 0 66935 0
[pid=5789] ppid=5635 vsize=664496 CPUtime=0.23 cores=0-7
/proc/5789/stat : 5789 (python) S 5635 5635 5551 0 -1 4202560 1263 0 0 0 11 12 0 0 19 0 2 0 548432200 680443904 6920 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5789/statm: 166124 6920 406 364 0 101949 0
[pid=5791] ppid=5789 vsize=335996 CPUtime=98.52 cores=0-7
/proc/5791/stat : 5791 (iPAWS) T 5789 5791 5791 0 -1 4202496 1823 0 0 0 9852 0 0 0 25 0 1 0 548432201 344059904 1535 33554432000 134512640 135114423 4294653680 18446744073709551615 134517031 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/5791/statm: 83999 1535 59 147 0 83851 0
[pid=5789/tid=5795] ppid=5635 vsize=664496 CPUtime=0 cores=0-7
/proc/5789/task/5795/stat : 5795 (python) S 5635 5635 5551 0 -1 4202560 105 0 0 0 0 0 0 0 19 0 2 0 548442224 680443904 6920 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 514 18446604459190802304 0 0 -1 5 0 0 0
[pid=5796] ppid=5635 vsize=674752 CPUtime=0 cores=0-7
/proc/5796/stat : 5796 (python) S 5635 5635 5551 0 -1 4202560 944 0 0 0 0 0 0 0 19 0 1 0 548442235 690946048 6781 33554432000 4194304 5683644 140737221038064 18446744073709551615 242970570310 0 0 16781312 514 12420566861890977791 0 0 17 0 0 0 0
/proc/5796/statm: 168688 6781 350 364 0 104510 0
[pid=5798] ppid=5796 vsize=268420 CPUtime=0.08 cores=0-7
/proc/5798/stat : 5798 (hybridGM3) R 5796 5798 5798 0 -1 4202496 5418 0 0 0 8 0 0 0 21 0 1 0 548442237 274862080 5126 33554432000 134512640 135204385 4288328896 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5798/statm: 67105 5126 63 169 0 66935 0
[pid=5635/tid=5642] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5642/stat : 5642 (python) S 5633 5635 5551 0 -1 4202560 27 937 0 0 0 0 0 0 19 0 34 0 548323453 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5645] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5645/stat : 5645 (python) S 5633 5635 5551 0 -1 4202560 20 937 0 0 0 0 0 0 17 0 34 0 548323457 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 3 0 0 0
[pid=5635/tid=5648] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5648/stat : 5648 (python) S 5633 5635 5551 0 -1 4202560 24 937 0 0 0 0 0 0 18 0 34 0 548323460 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5651] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5651/stat : 5651 (python) S 5633 5635 5551 0 -1 4202560 30 937 0 0 0 0 0 0 18 0 34 0 548323464 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5654] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5654/stat : 5654 (python) S 5633 5635 5551 0 -1 4202560 27 937 0 0 0 0 0 0 18 0 34 0 548323468 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 4 0 0 0
[pid=5635/tid=5657] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5657/stat : 5657 (python) S 5633 5635 5551 0 -1 4202560 25 937 0 0 0 0 0 0 24 0 34 0 548323472 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5660] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5660/stat : 5660 (python) S 5633 5635 5551 0 -1 4202560 34 937 0 0 0 0 0 0 18 0 34 0 548323476 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5663] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5663/stat : 5663 (python) S 5633 5635 5551 0 -1 4202560 116 937 0 0 0 0 0 0 18 0 34 0 548323481 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 6 0 0 0
[pid=5635/tid=5670] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5670/stat : 5670 (python) S 5633 5635 5551 0 -1 4202560 40 937 0 0 0 0 0 0 18 0 34 0 548333304 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5674] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5674/stat : 5674 (python) S 5633 5635 5551 0 -1 4202560 120 937 0 0 0 0 0 0 18 0 34 0 548333390 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5678] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5678/stat : 5678 (python) S 5633 5635 5551 0 -1 4202560 56 937 0 0 0 0 0 0 15 0 34 0 548333485 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5682] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5682/stat : 5682 (python) S 5633 5635 5551 0 -1 4202560 37 937 0 0 0 0 0 0 21 0 34 0 548333492 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5687] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5687/stat : 5687 (python) S 5633 5635 5551 0 -1 4202560 33 937 0 0 0 0 0 0 18 0 34 0 548333502 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5690] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5690/stat : 5690 (python) S 5633 5635 5551 0 -1 4202560 34 937 0 0 0 0 0 0 18 0 34 0 548333508 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5694] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5694/stat : 5694 (python) S 5633 5635 5551 0 -1 4202560 35 937 0 0 0 0 0 0 18 0 34 0 548333556 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5698] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5698/stat : 5698 (python) S 5633 5635 5551 0 -1 4202560 36 937 0 0 0 0 0 0 18 0 34 0 548333722 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5704] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5704/stat : 5704 (python) S 5633 5635 5551 0 -1 4202560 23 937 0 0 0 0 0 0 20 0 34 0 548343331 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5708] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5708/stat : 5708 (python) S 5633 5635 5551 0 -1 4202560 127 937 0 0 0 0 0 0 20 0 34 0 548343417 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5720] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5720/stat : 5720 (python) S 5633 5635 5551 0 -1 4202560 56 937 0 0 0 0 0 0 18 0 34 0 548353284 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5724] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5724/stat : 5724 (python) S 5633 5635 5551 0 -1 4202560 50 937 0 0 0 0 0 0 18 0 34 0 548353446 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5730] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5730/stat : 5730 (python) S 5633 5635 5551 0 -1 4202560 37 937 0 0 0 0 0 0 20 0 34 0 548362886 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5735] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5735/stat : 5735 (python) S 5633 5635 5551 0 -1 4202560 45 937 0 0 0 0 0 0 19 0 34 0 548372813 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5744] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5744/stat : 5744 (python) S 5633 5635 5551 0 -1 4202560 43 937 0 0 0 0 0 0 20 0 34 0 548382848 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5747] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5747/stat : 5747 (python) S 5633 5635 5551 0 -1 4202560 41 937 0 0 0 0 0 0 20 0 34 0 548383077 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5754] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5754/stat : 5754 (python) S 5633 5635 5551 0 -1 4202560 38 937 0 0 0 0 0 0 18 0 34 0 548392879 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5758] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5758/stat : 5758 (python) S 5633 5635 5551 0 -1 4202560 145 937 0 0 0 0 0 0 20 0 34 0 548393108 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5763] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5763/stat : 5763 (python) S 5633 5635 5551 0 -1 4202560 39 937 0 0 0 0 0 0 20 0 34 0 548402796 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5769] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5769/stat : 5769 (python) S 5633 5635 5551 0 -1 4202560 35 937 0 0 0 0 0 0 19 0 34 0 548411409 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5773] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5773/stat : 5773 (python) S 5633 5635 5551 0 -1 4202560 38 937 0 0 0 0 0 0 19 0 34 0 548412539 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5777] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5777/stat : 5777 (python) S 5633 5635 5551 0 -1 4202560 40 937 0 0 0 0 0 0 20 0 34 0 548412830 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 5 0 0 0
[pid=5635/tid=5784] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5784/stat : 5784 (python) S 5633 5635 5551 0 -1 4202560 41 937 0 0 0 0 0 0 20 0 34 0 548422683 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5790] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5790/stat : 5790 (python) S 5633 5635 5551 0 -1 4202560 38 937 0 0 0 0 0 0 20 0 34 0 548432201 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 0 0 0 0
[pid=5635/tid=5797] ppid=5633 vsize=684996 CPUtime=0 cores=0-7
/proc/5635/task/5797/stat : 5797 (python) S 5633 5635 5551 0 -1 4202560 45 937 0 0 0 0 0 0 19 0 34 0 548442235 701435904 8377 33554432000 4194304 5683644 140737221038064 18446744073709551615 242982373809 0 0 16781312 2 18446604453781080896 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9457.74
Current children cumulated vsize (KiB) 32540004

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5635 and gives
#  childrusage.ru_utime.tv_sec=2558
#  childrusage.ru_utime.tv_usec=310077
#  childrusage.ru_stime.tv_sec=11
#  childrusage.ru_stime.tv_usec=409265
# CPU time returned by wait4() is 2569.72
# while last known CPU time is 9457.74
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1190.31
CPU time (s): 9457.74
CPU user time (s): 9445.93
CPU system time (s): 11.81
CPU usage (%): 794.564
Max. virtual memory (cumulated for all children) (KiB): 32540004

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2558.31
system time used= 11.4093
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 137084
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14877
involuntary context switches= 21319

runsolver used 11.8722 second user time and 26.589 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-02 22:14:06
IDJOB=3321785
IDBENCH=82563
IDSOLVER=1712
FILE ID=node128/3321785-1304367246
RUNJOBID= node128-1304366466-5565
PBS_JOBID= 13181743
Free space on /tmp= 67896 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S926861876-013-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321785-1304367246/watcher-3321785-1304367246 -o /tmp/evaluation-result-3321785-1304367246/solver-3321785-1304367246 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321785-1304367246.cnf -seed 2129846060 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= aa5d2fab702f701bf63e2d26e76ab2b3
RANDOM SEED=2129846060

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      27314244 kB
Buffers:        527128 kB
Cached:        2201188 kB
SwapCached:          0 kB
Active:        2980312 kB
Inactive:      2213992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      27314244 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           32652 kB
Writeback:           0 kB
AnonPages:     2467320 kB
Mapped:          24616 kB
Slab:           361048 kB
PageTables:      19932 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 45387636 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 67864 MiB
End job on node128 at 2011-05-02 22:33:58