Trace number 2697384

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.74 778.027

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/
normalized-cache.inv10.ucl--soft-33-100-0.wbo
MD5SUM61ba6fab23f29dcc6973b97e5631370e
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark0.172973
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables8937
Total number of constraints26319
Number of soft constraints17731
Number of constraints which are clauses26047
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints272
Minimum length of a constraint1
Maximum length of a constraint9
Top cost 903676
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 903675
Biggest number in a constraint 17
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 62
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.02	c pb_cplex 1.0 - 20100701
0.00/0.02	c Parsing wbo file format. File HOME/instance-2697384-1278055324.wbo.
0.00/0.02	c Instance file HOME/instance-2697384-1278055324.wbo
0.00/0.02	c File size is 836065 bytes.
63.00/63.84	c Highest Coefficient sum: 62
63.00/63.84	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
63.05/64.45	c ============================[ Problem Statistics ]=============================
63.05/64.45	c |                                                                             |
63.05/64.45	c |  Parsing time:          63.07        s                                      |
63.05/64.45	c |  Number Variables:      26668                                               |
63.05/64.45	c |  Number Constraints:    26320                                               |
63.05/64.45	c ===============================================================================
1800.67/777.91	c Remaining time 1736.93 sec.
1800.67/777.91	c 
1800.67/777.91	c *** INTERRUPTED ***
1800.67/777.91	s UNKNOWN
1800.67/777.91	c Total CPU time              : 1797.96 s
1800.67/777.91	c Memory used           : 654.44 MB
1800.67/777.91	c CPU time              : 1797.96 s
1800.67/777.91	c 
1800.67/777.91	c *** INTERRUPTED ***

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697384-1278055324/watcher-2697384-1278055324 -o /tmp/evaluation-result-2697384-1278055324/solver-2697384-1278055324 -C 1800 -W 2000 -M 3800 run HOME/instance-2697384-1278055324.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.55 7.52 3.71 11/186 32735
/proc/meminfo: memFree=31247940/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=24036 CPUtime=0
/proc/32735/stat : 32735 (runsolver) R 32733 32735 32226 0 -1 4202560 81 0 0 0 0 0 0 0 25 0 1 0 179124207 24612864 106 4089446400 4194304 4302564 140735278560368 18446744073709551615 260905214967 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/32735/statm: 6009 106 69 27 0 2647 0

[startup+0.072104 s]
/proc/loadavg: 9.55 7.52 3.71 11/186 32735
/proc/meminfo: memFree=31247940/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.105099 s]
/proc/loadavg: 9.55 7.52 3.71 11/186 32735
/proc/meminfo: memFree=31247940/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301062 s]
/proc/loadavg: 9.55 7.52 3.71 11/186 32735
/proc/meminfo: memFree=31247940/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700994 s]
/proc/loadavg: 9.55 7.52 3.71 11/186 32735
/proc/meminfo: memFree=31247940/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50084 s]
/proc/loadavg: 9.51 7.54 3.74 8/188 32737
/proc/meminfo: memFree=31246796/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=14792 CPUtime=0.81
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 704 0 0 0 81 0 0 0 25 0 1 0 179124208 15147008 657 4089446400 134512640 146736320 4293714240 18446744073709551615 140684746 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/32737/statm: 3698 657 307 2985 0 427 0
Current children cumulated CPU time (s) 0.81
Current children cumulated vsize (KiB) 23492

[startup+3.12255 s]
/proc/loadavg: 9.51 7.54 3.74 6/188 32737
/proc/meminfo: memFree=31246176/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=15608 CPUtime=2.32
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 926 0 0 0 232 0 0 0 25 0 1 0 179124208 15982592 879 4089446400 134512640 146736320 4293714240 18446744073709551615 140714084 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 3902 879 323 2985 0 631 0
Current children cumulated CPU time (s) 2.32
Current children cumulated vsize (KiB) 24308
heavy processes:

[startup+6.30096 s]
/proc/loadavg: 9.47 7.57 3.77 3/188 32737
/proc/meminfo: memFree=31245060/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=16648 CPUtime=5.5
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 1227 0 0 0 550 0 0 0 25 0 1 0 179124208 17047552 1180 4089446400 134512640 146736320 4293714240 18446744073709551615 134814122 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 4162 1180 344 2985 0 891 0
Current children cumulated CPU time (s) 5.5
Current children cumulated vsize (KiB) 25348

[startup+12.7008 s]
/proc/loadavg: 9.35 7.57 3.79 3/188 32737
/proc/meminfo: memFree=31243196/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=18380 CPUtime=11.9
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 1681 0 0 0 1190 0 0 0 25 0 1 0 179124208 18821120 1601 4089446400 134512640 146736320 4293714240 18446744073709551615 140660136 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 4595 1601 372 2985 0 1324 0
Current children cumulated CPU time (s) 11.9
Current children cumulated vsize (KiB) 27080

[startup+25.5005 s]
/proc/loadavg: 8.29 7.41 3.77 3/181 363
/proc/meminfo: memFree=31291472/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=20588 CPUtime=24.7
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 2236 0 0 0 2470 0 0 0 25 0 1 0 179124208 21082112 2156 4089446400 134512640 146736320 4293714240 18446744073709551615 134814121 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 5147 2156 411 2985 0 1876 0
Current children cumulated CPU time (s) 24.7
Current children cumulated vsize (KiB) 29288

[startup+51.1008 s]
/proc/loadavg: 5.81 6.89 3.72 3/181 363
/proc/meminfo: memFree=31249132/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=23712 CPUtime=50.3
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 3110 0 0 0 5030 0 0 0 25 0 1 0 179124208 24281088 2965 4089446400 134512640 146736320 4293714240 18446744073709551615 140683317 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 5928 2965 466 2985 0 2657 0
Current children cumulated CPU time (s) 50.3
Current children cumulated vsize (KiB) 32412

[startup+102.306 s]
/proc/loadavg: 5.95 6.74 3.83 11/188 414
/proc/meminfo: memFree=30947772/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=557904 CPUtime=225.5
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 560982 0 0 0 22454 96 0 0 20 0 8 0 179124208 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 135526891 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 139476 85811 1162 2985 0 136018 0
[pid=32737/tid=372] ppid=32735 vsize=557904 CPUtime=19.48
/proc/32737/task/372/stat : 372 (pb_cplex) R 32735 32735 32226 0 -1 4202560 67876 0 0 0 1935 13 0 0 25 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 144580332 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=373] ppid=32735 vsize=557904 CPUtime=19.9
/proc/32737/task/373/stat : 373 (pb_cplex) R 32735 32735 32226 0 -1 4202560 63926 0 0 0 1979 11 0 0 18 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 135854189 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=374] ppid=32735 vsize=557904 CPUtime=18.23
/proc/32737/task/374/stat : 374 (pb_cplex) R 32735 32735 32226 0 -1 4202560 38669 0 0 0 1815 8 0 0 19 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 135450603 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=375] ppid=32735 vsize=557904 CPUtime=20.28
/proc/32737/task/375/stat : 375 (pb_cplex) R 32735 32735 32226 0 -1 4202560 50345 0 0 0 2020 8 0 0 20 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 135964351 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=376] ppid=32735 vsize=557904 CPUtime=18.95
/proc/32737/task/376/stat : 376 (pb_cplex) R 32735 32735 32226 0 -1 4202560 47651 0 0 0 1887 8 0 0 25 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 135857530 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=377] ppid=32735 vsize=557904 CPUtime=19.04
/proc/32737/task/377/stat : 377 (pb_cplex) R 32735 32735 32226 0 -1 4202560 51761 0 0 0 1896 8 0 0 16 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 136400465 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=378] ppid=32735 vsize=557904 CPUtime=20.33
/proc/32737/task/378/stat : 378 (pb_cplex) R 32735 32735 32226 0 -1 4202560 47520 0 0 0 2024 9 0 0 18 0 8 0 179131578 571293696 85811 4089446400 134512640 146736320 4293714240 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 225.5
Current children cumulated vsize (KiB) 566604

[startup+162.3 s]
/proc/loadavg: 3.61 5.94 3.74 3/181 443
/proc/meminfo: memFree=31051236/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=328796 CPUtime=315.3
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 702085 0 0 0 31402 128 0 0 25 0 1 0 179124208 336687104 61611 4089446400 134512640 146736320 4293714240 18446744073709551615 136008050 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/32737/statm: 82199 61611 1085 2985 0 78741 0
Current children cumulated CPU time (s) 315.3
Current children cumulated vsize (KiB) 337496

[startup+222.301 s]
/proc/loadavg: 4.17 5.60 3.75 11/188 532
/proc/meminfo: memFree=31009180/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=328796 CPUtime=374.68
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 702085 0 0 0 37340 128 0 0 25 0 1 0 179124208 336687104 61611 4089446400 134512640 146736320 4293714240 18446744073709551615 136384895 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/32737/statm: 82199 61611 1085 2985 0 78741 0
Current children cumulated CPU time (s) 374.68
Current children cumulated vsize (KiB) 337496

[startup+282.312 s]
/proc/loadavg: 5.55 5.70 3.90 10/188 533
/proc/meminfo: memFree=31008116/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=328796 CPUtime=424.93
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 702085 0 0 0 42364 129 0 0 25 0 1 0 179124208 336687104 61611 4089446400 134512640 146736320 4293714240 18446744073709551615 136008047 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/32737/statm: 82199 61611 1085 2985 0 78741 0
Current children cumulated CPU time (s) 424.93
Current children cumulated vsize (KiB) 337496

[startup+342.304 s]
/proc/loadavg: 6.00 5.82 4.05 3/188 535
/proc/meminfo: memFree=31008188/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=328796 CPUtime=472.26
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 702085 0 0 0 47096 130 0 0 25 0 1 0 179124208 336687104 61611 4089446400 134512640 146736320 4293714240 18446744073709551615 136403103 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/32737/statm: 82199 61611 1085 2985 0 78741 0
Current children cumulated CPU time (s) 472.26

################
# More data... #
################

[pid=32737] ppid=32735 vsize=561980 CPUtime=786.79
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 850387 0 0 0 78517 162 0 0 25 0 8 0 179124208 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136008385 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/32737/statm: 140495 98920 1082 2985 0 137037 0
[pid=32737/tid=620] ppid=32735 vsize=561980 CPUtime=23.49
/proc/32737/task/620/stat : 620 (pb_cplex) R 32735 32735 32226 0 -1 4202560 3590 0 0 0 2348 1 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136000480 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=561980 CPUtime=22.55
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 5345 0 0 0 2254 1 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136007670 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=561980 CPUtime=23.13
/proc/32737/task/622/stat : 622 (pb_cplex) R 32735 32735 32226 0 -1 4202560 7087 0 0 0 2312 1 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 139042977 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=561980 CPUtime=23.32
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 6935 0 0 0 2330 2 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136007083 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=561980 CPUtime=23.48
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 6252 0 0 0 2346 2 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136007313 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=561980 CPUtime=22.93
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 6276 0 0 0 2292 1 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136017755 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=561980 CPUtime=23.58
/proc/32737/task/626/stat : 626 (pb_cplex) R 32735 32735 32226 0 -1 4202560 6738 0 0 0 2357 1 0 0 25 0 8 0 179168002 575467520 98920 4089446400 134512640 146736320 4293714240 18446744073709551615 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 786.79
Current children cumulated vsize (KiB) 570680

[startup+582.301 s]
/proc/loadavg: 9.95 7.51 5.09 7/195 644
/proc/meminfo: memFree=30851340/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=562776 CPUtime=1102.24
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 934794 0 0 0 110038 186 0 0 25 0 8 0 179124208 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 136007030 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/32737/statm: 140694 99822 1082 2985 0 137236 0
[pid=32737/tid=620] ppid=32735 vsize=562776 CPUtime=50.63
/proc/32737/task/620/stat : 620 (pb_cplex) S 32735 32735 32226 0 -1 4202560 12941 0 0 0 5060 3 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 144580073 0 2 4096 16387 18446604452930359552 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=562776 CPUtime=63.77
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 18556 0 0 0 6372 5 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 136006938 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=562776 CPUtime=65.37
/proc/32737/task/622/stat : 622 (pb_cplex) S 32735 32735 32226 0 -1 4202560 16503 0 0 0 6533 4 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 144580073 0 2 4096 16387 18446604452930359552 0 0 -1 7 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=562776 CPUtime=66.51
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 14297 0 0 0 6646 5 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 139023058 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=562776 CPUtime=64.55
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 17577 0 0 0 6450 5 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 136007030 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=562776 CPUtime=66.4
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 18245 0 0 0 6635 5 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 135983309 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=562776 CPUtime=59.02
/proc/32737/task/626/stat : 626 (pb_cplex) S 32735 32735 32226 0 -1 4202560 18600 0 0 0 5898 4 0 0 25 0 8 0 179168002 576282624 99822 4089446400 134512640 146736320 4293714240 18446744073709551615 144580073 0 2 4096 16387 18446604452930359552 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1102.24
Current children cumulated vsize (KiB) 571476

[startup+642.301 s]
/proc/loadavg: 10.24 8.01 5.41 17/195 646
/proc/meminfo: memFree=30785920/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=671108 CPUtime=1249.27
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 990019 0 0 0 124722 205 0 0 23 0 8 0 179124208 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 139044505 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 167777 116006 1114 2985 0 164319 0
[pid=32737/tid=620] ppid=32735 vsize=671108 CPUtime=53.23
/proc/32737/task/620/stat : 620 (pb_cplex) R 32735 32735 32226 0 -1 4202560 17856 0 0 0 5319 4 0 0 23 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=671108 CPUtime=81.67
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 24963 0 0 0 8160 7 0 0 23 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 136007643 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=671108 CPUtime=69.22
/proc/32737/task/622/stat : 622 (pb_cplex) R 32735 32735 32226 0 -1 4202560 22595 0 0 0 6917 5 0 0 25 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 136007053 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=671108 CPUtime=98.37
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 25175 0 0 0 9828 9 0 0 25 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 136474979 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=671108 CPUtime=97.19
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 22785 0 0 0 9712 7 0 0 25 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=671108 CPUtime=92.38
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 24069 0 0 0 9230 8 0 0 22 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 139044505 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=671108 CPUtime=61.79
/proc/32737/task/626/stat : 626 (pb_cplex) R 32735 32735 32226 0 -1 4202560 21194 0 0 0 6173 6 0 0 23 0 8 0 179168002 687214592 116006 4089446400 134512640 146736320 4293714240 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1249.27
Current children cumulated vsize (KiB) 679808

[startup+702.301 s]
/proc/loadavg: 14.38 9.60 6.12 12/195 648
/proc/meminfo: memFree=30788992/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=664716 CPUtime=1327.77
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 1033363 0 0 0 132555 222 0 0 25 0 8 0 179124208 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136007627 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 166179 115080 1087 2985 0 162721 0
[pid=32737/tid=620] ppid=32735 vsize=664716 CPUtime=63.76
/proc/32737/task/620/stat : 620 (pb_cplex) R 32735 32735 32226 0 -1 4202560 25469 0 0 0 6370 6 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136007039 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=664716 CPUtime=89.44
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 31676 0 0 0 8935 9 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 139044505 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=664716 CPUtime=79.38
/proc/32737/task/622/stat : 622 (pb_cplex) R 32735 32735 32226 0 -1 4202560 30899 0 0 0 7930 8 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136007371 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=664716 CPUtime=108.23
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 29107 0 0 0 10813 10 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136384857 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=664716 CPUtime=106.66
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 22794 0 0 0 10658 8 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136001974 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=664716 CPUtime=104.24
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 33256 0 0 0 10414 10 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 136007605 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=664716 CPUtime=70.96
/proc/32737/task/626/stat : 626 (pb_cplex) R 32735 32735 32226 0 -1 4202560 21224 0 0 0 7086 10 0 0 25 0 8 0 179168002 680669184 115080 4089446400 134512640 146736320 4293714240 18446744073709551615 139028298 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1327.77
Current children cumulated vsize (KiB) 673416

[startup+762.301 s]
/proc/loadavg: 12.01 9.73 6.37 13/195 649
/proc/meminfo: memFree=30785568/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=692676 CPUtime=1699.17
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 1250258 0 0 0 169652 265 0 0 25 0 8 0 179124208 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136403117 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 173169 120688 1082 2985 0 169711 0
[pid=32737/tid=620] ppid=32735 vsize=692676 CPUtime=110.32
/proc/32737/task/620/stat : 620 (pb_cplex) R 32735 32735 32226 0 -1 4202560 70656 0 0 0 11017 15 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=692676 CPUtime=135.87
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 70623 0 0 0 13571 16 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=692676 CPUtime=125.82
/proc/32737/task/622/stat : 622 (pb_cplex) R 32735 32735 32226 0 -1 4202560 68938 0 0 0 12566 16 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 139028294 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=692676 CPUtime=153.97
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 44919 0 0 0 15384 13 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136403129 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=692676 CPUtime=153.14
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 22797 0 0 0 15305 9 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136017489 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=692676 CPUtime=150.73
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 72849 0 0 0 15056 17 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136007284 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=692676 CPUtime=117.65
/proc/32737/task/626/stat : 626 (pb_cplex) R 32735 32735 32226 0 -1 4202560 21301 0 0 0 11754 11 0 0 25 0 8 0 179168002 709300224 120688 4089446400 134512640 146736320 4293714240 18446744073709551615 136008167 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1699.17
Current children cumulated vsize (KiB) 701376



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+777.901 s]
/proc/loadavg: 11.42 9.71 6.42 11/195 650
/proc/meminfo: memFree=30784900/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) S 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=670140 CPUtime=1800.67
/proc/32737/stat : 32737 (pb_cplex) R 32735 32735 32226 0 -1 4202496 1295207 0 0 0 179792 275 0 0 25 0 8 0 179124208 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 136400463 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 167535 116599 1082 2985 0 164077 0
[pid=32737/tid=620] ppid=32735 vsize=670140 CPUtime=123.07
/proc/32737/task/620/stat : 620 (pb_cplex) R 32735 32735 32226 0 -1 4202560 77862 0 0 0 12290 17 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 136384852 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=32737/tid=621] ppid=32735 vsize=670140 CPUtime=148.6
/proc/32737/task/621/stat : 621 (pb_cplex) R 32735 32735 32226 0 -1 4202560 79691 0 0 0 14842 18 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 139044585 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=32737/tid=622] ppid=32735 vsize=670140 CPUtime=138.59
/proc/32737/task/622/stat : 622 (pb_cplex) R 32735 32735 32226 0 -1 4202560 68940 0 0 0 13843 16 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 136001929 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=32737/tid=623] ppid=32735 vsize=670140 CPUtime=166.37
/proc/32737/task/623/stat : 623 (pb_cplex) R 32735 32735 32226 0 -1 4202560 49194 0 0 0 16623 14 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 139042901 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=32737/tid=624] ppid=32735 vsize=670140 CPUtime=165.84
/proc/32737/task/624/stat : 624 (pb_cplex) R 32735 32735 32226 0 -1 4202560 22797 0 0 0 16575 9 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 139044505 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=32737/tid=625] ppid=32735 vsize=670140 CPUtime=163.47
/proc/32737/task/625/stat : 625 (pb_cplex) R 32735 32735 32226 0 -1 4202560 77466 0 0 0 16328 19 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 136004384 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=32737/tid=626] ppid=32735 vsize=670140 CPUtime=130.36
/proc/32737/task/626/stat : 626 (pb_cplex) R 32735 32735 32226 0 -1 4202560 21304 0 0 0 13025 11 0 0 25 0 8 0 179168002 686223360 116599 4089446400 134512640 146736320 4293714240 18446744073709551615 136007270 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.67
Current children cumulated vsize (KiB) 678840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+778.024 s]
/proc/loadavg: 11.42 9.71 6.42 11/195 650
/proc/meminfo: memFree=30784900/32950928 swapFree=67111528/67111528
[pid=32735] ppid=32733 vsize=8700 CPUtime=0
/proc/32735/stat : 32735 (run) R 32733 32735 32226 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 179124207 8908800 249 4089446400 4194304 4922060 140737425332736 18446744073709551615 260905213061 256 65536 4100 65538 0 0 0 17 1 0 0 0
/proc/32735/statm: 2175 249 208 178 0 68 0
[pid=32737] ppid=32735 vsize=0 CPUtime=1800.73
/proc/32737/stat : 32737 (pb_cplex) Z 32735 32735 32226 0 -1 4202524 1295209 0 0 0 179796 277 0 0 25 0 1 0 179124208 0 0 4089446400 0 0 0 0 0 0 16384 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/32737/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.73
Current children cumulated vsize (KiB) 8700

Child ended because it received signal 15 (SIGTERM)
Real time (s): 778.027
CPU time (s): 1800.74
CPU user time (s): 1797.96
CPU system time (s): 2.77658
CPU usage (%): 231.45
Max. virtual memory (cumulated for all children) (KiB): 725284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1797.96
system time used= 2.77658
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1295574
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9290
involuntary context switches= 148976

runsolver used 1.2908 second user time and 2.89456 second system time

The end

Launcher Data

Begin job on node116 at 2010-07-02 09:22:05
IDJOB=2697384
IDBENCH=79002
IDSOLVER=1210
FILE ID=node116/2697384-1278055324
PBS_JOBID= 11198949
Free space on /tmp= 74172 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/normalized-cache.inv10.ucl--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697384-1278055324/watcher-2697384-1278055324 -o /tmp/evaluation-result-2697384-1278055324/solver-2697384-1278055324 -C 1800 -W 2000 -M 3800  run HOME/instance-2697384-1278055324.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 61ba6fab23f29dcc6973b97e5631370e
RANDOM SEED=484587818

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5381.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31248220 kB
Buffers:        218096 kB
Cached:        1215268 kB
SwapCached:          0 kB
Active:         673620 kB
Inactive:       882172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31248220 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           17104 kB
Writeback:           0 kB
AnonPages:      122216 kB
Mapped:          19272 kB
Slab:            82208 kB
PageTables:       4944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   346876 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74156 MiB
End job on node116 at 2010-07-02 09:35:05