Trace number 2697655

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.29 744.317

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/
normalized-j605_1-unsat--soft-33-100-0.wbo
MD5SUM45ee7d19535e08aa25eac21bd6c9cde2
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark2.09968
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables9272
Total number of constraints29174
Number of soft constraints19508
Number of constraints which are clauses28874
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints300
Minimum length of a constraint1
Maximum length of a constraint35
Top cost 985166
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 985165
Biggest number in a constraint 18
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 231
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697655-1278055472.wbo.
0.00/0.00	c Instance file HOME/instance-2697655-1278055472.wbo
0.00/0.00	c File size is 933094 bytes.
75.69/82.96	c Highest Coefficient sum: 231
75.69/82.96	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
75.78/83.01	c ============================[ Problem Statistics ]=============================
75.78/83.01	c |                                                                             |
75.78/83.01	c |  Parsing time:          75.78        s                                      |
75.78/83.01	c |  Number Variables:      28780                                               |
75.78/83.01	c |  Number Constraints:    29175                                               |
75.78/83.01	c ===============================================================================
1800.29/744.31	c Remaining time 1724.22 sec.
1800.29/744.31	c 
1800.29/744.31	c *** INTERRUPTED ***
1800.29/744.31	s UNKNOWN
1800.29/744.31	c Total CPU time              : 1796.73 s
1800.29/744.31	c Memory used           : 517.48 MB
1800.29/744.31	c CPU time              : 1796.73 s
1800.29/744.31	c 
1800.29/744.31	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697655-1278055472/watcher-2697655-1278055472 -o /tmp/evaluation-result-2697655-1278055472/solver-2697655-1278055472 -C 1800 -W 2000 -M 3800 run HOME/instance-2697655-1278055472.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.17 7.75 4.36 4/179 23896
/proc/meminfo: memFree=30794316/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0

[startup+0.010864 s]
/proc/loadavg: 7.17 7.75 4.36 4/179 23896
/proc/meminfo: memFree=30794316/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101853 s]
/proc/loadavg: 7.17 7.75 4.36 4/179 23896
/proc/meminfo: memFree=30794316/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300813 s]
/proc/loadavg: 7.17 7.75 4.36 4/179 23896
/proc/meminfo: memFree=30794316/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700732 s]
/proc/loadavg: 7.17 7.75 4.36 4/179 23896
/proc/meminfo: memFree=30794316/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50062 s]
/proc/loadavg: 7.17 7.75 4.36 3/181 23898
/proc/meminfo: memFree=30791572/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=15788 CPUtime=1.49
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 950 0 0 0 149 0 0 0 25 0 1 0 146842075 16166912 903 4089446400 134512640 146736320 4291895664 18446744073709551615 140681199 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/23897/statm: 3947 903 314 2985 0 653 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 24488

[startup+3.10031 s]
/proc/loadavg: 7.17 7.75 4.36 3/181 23898
/proc/meminfo: memFree=30791076/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=16616 CPUtime=3.09
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1151 0 0 0 309 0 0 0 25 0 1 0 146842075 17014784 1104 4089446400 134512640 146736320 4291895664 18446744073709551615 140528645 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/23897/statm: 4154 1104 326 2985 0 860 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 25316

[startup+6.30066 s]
/proc/loadavg: 6.76 7.65 4.34 3/181 23898
/proc/meminfo: memFree=30789756/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=17492 CPUtime=6.29
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1359 0 0 0 629 0 0 0 25 0 1 0 146842075 17911808 1312 4089446400 134512640 146736320 4291895664 18446744073709551615 134814122 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/23897/statm: 4373 1312 343 2985 0 1079 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 26192

[startup+12.7004 s]
/proc/loadavg: 6.38 7.56 4.33 3/181 23898
/proc/meminfo: memFree=30787912/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=18740 CPUtime=12.69
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1754 0 0 0 1269 0 0 0 25 0 1 0 146842075 19189760 1674 4089446400 134512640 146736320 4291895664 18446744073709551615 140528748 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/23897/statm: 4685 1674 367 2985 0 1391 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 27440

[startup+25.5008 s]
/proc/loadavg: 5.41 7.29 4.29 3/181 23898
/proc/meminfo: memFree=30784776/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=20608 CPUtime=25.49
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 2225 0 0 0 2549 0 0 0 25 0 1 0 146842075 21102592 2145 4089446400 134512640 146736320 4291895664 18446744073709551615 134814122 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/23897/statm: 5152 2145 402 2985 0 1858 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 29308

[startup+51.1006 s]
/proc/loadavg: 5.74 7.19 4.34 9/188 23963
/proc/meminfo: memFree=30706628/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=23428 CPUtime=46.06
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 2953 0 0 0 4606 0 0 0 25 0 1 0 146842075 23990272 2808 4089446400 134512640 146736320 4291895664 18446744073709551615 134814122 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/23897/statm: 5857 2808 446 2985 0 2563 0
Current children cumulated CPU time (s) 46.06
Current children cumulated vsize (KiB) 32128

[startup+102.306 s]
/proc/loadavg: 6.15 7.05 4.44 11/188 23984
/proc/meminfo: memFree=30677696/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=104444 CPUtime=87.54
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 53784 0 0 0 8744 10 0 0 25 0 1 0 146842075 106950656 16919 4089446400 134512640 146736320 4291895664 18446744073709551615 136017769 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/23897/statm: 26111 16919 1052 2985 0 22653 0
Current children cumulated CPU time (s) 87.54
Current children cumulated vsize (KiB) 113144

[startup+162.301 s]
/proc/loadavg: 7.65 7.30 4.68 11/195 24063
/proc/meminfo: memFree=30456740/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=488996 CPUtime=145.61
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 195046 0 0 0 14531 30 0 0 18 0 8 0 146842075 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136475782 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/23897/statm: 122249 72073 1124 2985 0 118791 0
[pid=23897/tid=24036] ppid=23896 vsize=488996 CPUtime=1.08
/proc/23897/task/24036/stat : 24036 (pb_cplex) R 23896 23896 23089 0 -1 4202560 6590 0 0 0 107 1 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136008170 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24037] ppid=23896 vsize=488996 CPUtime=0.92
/proc/23897/task/24037/stat : 24037 (pb_cplex) R 23896 23896 23089 0 -1 4202560 4886 0 0 0 92 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136007094 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23897/tid=24038] ppid=23896 vsize=488996 CPUtime=0.78
/proc/23897/task/24038/stat : 24038 (pb_cplex) R 23896 23896 23089 0 -1 4202560 6959 0 0 0 78 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136006293 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23897/tid=24039] ppid=23896 vsize=488996 CPUtime=1.08
/proc/23897/task/24039/stat : 24039 (pb_cplex) R 23896 23896 23089 0 -1 4202560 5037 0 0 0 108 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136007284 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23897/tid=24040] ppid=23896 vsize=488996 CPUtime=1.06
/proc/23897/task/24040/stat : 24040 (pb_cplex) R 23896 23896 23089 0 -1 4202560 4904 0 0 0 106 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136385265 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24041] ppid=23896 vsize=488996 CPUtime=1.06
/proc/23897/task/24041/stat : 24041 (pb_cplex) R 23896 23896 23089 0 -1 4202560 5195 0 0 0 106 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 136008047 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23897/tid=24042] ppid=23896 vsize=488996 CPUtime=1.08
/proc/23897/task/24042/stat : 24042 (pb_cplex) R 23896 23896 23089 0 -1 4202560 5183 0 0 0 108 0 0 0 18 0 8 0 146857562 500731904 72073 4089446400 134512640 146736320 4291895664 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 145.61
Current children cumulated vsize (KiB) 497696

[startup+222.301 s]
/proc/loadavg: 11.76 8.54 5.27 15/195 24086
/proc/meminfo: memFree=30400152/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=533404 CPUtime=264.53
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 390507 0 0 0 26379 74 0 0 25 0 8 0 146842075 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 136400750 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/23897/statm: 133351 83906 1124 2985 0 129893 0
[pid=23897/tid=24036] ppid=23896 vsize=533404 CPUtime=20.84
/proc/23897/task/24036/stat : 24036 (pb_cplex) R 23896 23896 23089 0 -1 4202560 38904 0 0 0 2078 6 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 136006275 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24037] ppid=23896 vsize=533404 CPUtime=16.32
/proc/23897/task/24037/stat : 24037 (pb_cplex) R 23896 23896 23089 0 -1 4202560 33274 0 0 0 1625 7 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 135999693 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23897/tid=24038] ppid=23896 vsize=533404 CPUtime=13.26
/proc/23897/task/24038/stat : 24038 (pb_cplex) R 23896 23896 23089 0 -1 4202560 29280 0 0 0 1320 6 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 135468697 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23897/tid=24039] ppid=23896 vsize=533404 CPUtime=15.91
/proc/23897/task/24039/stat : 24039 (pb_cplex) R 23896 23896 23089 0 -1 4202560 30097 0 0 0 1586 5 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 135526323 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23897/tid=24040] ppid=23896 vsize=533404 CPUtime=12.74
/proc/23897/task/24040/stat : 24040 (pb_cplex) R 23896 23896 23089 0 -1 4202560 20326 0 0 0 1270 4 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 135450575 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23897/tid=24041] ppid=23896 vsize=533404 CPUtime=17.36
/proc/23897/task/24041/stat : 24041 (pb_cplex) R 23896 23896 23089 0 -1 4202560 33887 0 0 0 1729 7 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 136413787 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24042] ppid=23896 vsize=533404 CPUtime=18.38
/proc/23897/task/24042/stat : 24042 (pb_cplex) R 23896 23896 23089 0 -1 4202560 30591 0 0 0 1832 6 0 0 25 0 8 0 146857562 546205696 83906 4089446400 134512640 146736320 4291895664 18446744073709551615 136001974 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 264.53
Current children cumulated vsize (KiB) 542104

[startup+282.301 s]
/proc/loadavg: 14.67 9.98 5.97 15/195 24088
/proc/meminfo: memFree=30396752/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=534548 CPUtime=345.68
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 452466 0 0 0 34474 94 0 0 25 0 8 0 146842075 547377152 84477 4089446400 134512640 146736320 4291895664 18446744073709551615 136003490 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/23897/statm: 133637 84477 1123 2985 0 130179 0

################
# More data... #
################

[pid=23897] ppid=23896 vsize=549512 CPUtime=764.03
/proc/23897/stat : 23897 (pb_cplex) S 23896 23896 23089 0 -1 4202496 716036 0 0 0 76241 162 0 0 25 0 8 0 146842075 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/23897/statm: 137378 86433 1122 2985 0 133920 0
[pid=23897/tid=24036] ppid=23896 vsize=549512 CPUtime=78.51
/proc/23897/task/24036/stat : 24036 (pb_cplex) S 23896 23896 23089 0 -1 4202560 75749 0 0 0 7837 14 0 0 18 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 7 0 0 0
[pid=23897/tid=24037] ppid=23896 vsize=549512 CPUtime=80.45
/proc/23897/task/24037/stat : 24037 (pb_cplex) S 23896 23896 23089 0 -1 4202560 80344 0 0 0 8024 21 0 0 15 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 6 0 0 0
[pid=23897/tid=24038] ppid=23896 vsize=549512 CPUtime=61.33
/proc/23897/task/24038/stat : 24038 (pb_cplex) S 23896 23896 23089 0 -1 4202560 73459 0 0 0 6117 16 0 0 18 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 7 0 0 0
[pid=23897/tid=24039] ppid=23896 vsize=549512 CPUtime=80.2
/proc/23897/task/24039/stat : 24039 (pb_cplex) R 23896 23896 23089 0 -1 4202560 87003 0 0 0 8004 16 0 0 25 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24040] ppid=23896 vsize=549512 CPUtime=77.49
/proc/23897/task/24040/stat : 24040 (pb_cplex) S 23896 23896 23089 0 -1 4202560 27621 0 0 0 7739 10 0 0 25 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 2 0 0 0
[pid=23897/tid=24041] ppid=23896 vsize=549512 CPUtime=84.36
/proc/23897/task/24041/stat : 24041 (pb_cplex) S 23896 23896 23089 0 -1 4202560 104438 0 0 0 8415 21 0 0 25 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 3 0 0 0
[pid=23897/tid=24042] ppid=23896 vsize=549512 CPUtime=86.62
/proc/23897/task/24042/stat : 24042 (pb_cplex) R 23896 23896 23089 0 -1 4202560 46443 0 0 0 8644 18 0 0 25 0 8 0 146857562 562700288 86433 4089446400 134512640 146736320 4291895664 18446744073709551615 139042876 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 764.03
Current children cumulated vsize (KiB) 558212

[startup+462.301 s]
/proc/loadavg: 11.47 10.83 7.03 18/195 24179
/proc/meminfo: memFree=30404936/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=539040 CPUtime=1039.65
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 929334 0 0 0 103758 207 0 0 18 0 8 0 146842075 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136007284 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23897/statm: 134760 86377 1122 2985 0 131302 0
[pid=23897/tid=24036] ppid=23896 vsize=539040 CPUtime=109.41
/proc/23897/task/24036/stat : 24036 (pb_cplex) R 23896 23896 23089 0 -1 4202560 98476 0 0 0 10922 19 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 135526028 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24037] ppid=23896 vsize=539040 CPUtime=119.3
/proc/23897/task/24037/stat : 24037 (pb_cplex) R 23896 23896 23089 0 -1 4202560 105075 0 0 0 11904 26 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136400460 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24038] ppid=23896 vsize=539040 CPUtime=96.07
/proc/23897/task/24038/stat : 24038 (pb_cplex) R 23896 23896 23089 0 -1 4202560 104181 0 0 0 9585 22 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23897/tid=24039] ppid=23896 vsize=539040 CPUtime=127.93
/proc/23897/task/24039/stat : 24039 (pb_cplex) R 23896 23896 23089 0 -1 4202560 130329 0 0 0 12767 26 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136008673 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23897/tid=24040] ppid=23896 vsize=539040 CPUtime=108.18
/proc/23897/task/24040/stat : 24040 (pb_cplex) R 23896 23896 23089 0 -1 4202560 32119 0 0 0 10807 11 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136007284 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23897/tid=24041] ppid=23896 vsize=539040 CPUtime=116.12
/proc/23897/task/24041/stat : 24041 (pb_cplex) R 23896 23896 23089 0 -1 4202560 138981 0 0 0 11584 28 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23897/tid=24042] ppid=23896 vsize=539040 CPUtime=118.39
/proc/23897/task/24042/stat : 24042 (pb_cplex) R 23896 23896 23089 0 -1 4202560 66330 0 0 0 11818 21 0 0 18 0 8 0 146857562 551976960 86377 4089446400 134512640 146736320 4291895664 18446744073709551615 136006931 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1039.65
Current children cumulated vsize (KiB) 547740

[startup+522.301 s]
/proc/loadavg: 12.27 11.25 7.41 15/195 24181
/proc/meminfo: memFree=30398044/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=544476 CPUtime=1183.15
/proc/23897/stat : 23897 (pb_cplex) S 23896 23896 23089 0 -1 4202496 1098649 0 0 0 118073 242 0 0 25 0 8 0 146842075 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/23897/statm: 136119 87131 1113 2985 0 132661 0
[pid=23897/tid=24036] ppid=23896 vsize=544476 CPUtime=128.33
/proc/23897/task/24036/stat : 24036 (pb_cplex) S 23896 23896 23089 0 -1 4202560 107777 0 0 0 12812 21 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 3 0 0 0
[pid=23897/tid=24037] ppid=23896 vsize=544476 CPUtime=138.77
/proc/23897/task/24037/stat : 24037 (pb_cplex) R 23896 23896 23089 0 -1 4202560 119784 0 0 0 13848 29 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 136388611 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23897/tid=24038] ppid=23896 vsize=544476 CPUtime=114.51
/proc/23897/task/24038/stat : 24038 (pb_cplex) R 23896 23896 23089 0 -1 4202560 116481 0 0 0 11427 24 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 135854509 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=23897/tid=24039] ppid=23896 vsize=544476 CPUtime=146.93
/proc/23897/task/24039/stat : 24039 (pb_cplex) R 23896 23896 23089 0 -1 4202560 157408 0 0 0 14660 33 0 0 18 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23897/tid=24040] ppid=23896 vsize=544476 CPUtime=127.64
/proc/23897/task/24040/stat : 24040 (pb_cplex) S 23896 23896 23089 0 -1 4202560 35263 0 0 0 12751 13 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 144580073 0 2 4096 16387 18446604471108060416 0 0 -1 3 0 0 0
[pid=23897/tid=24041] ppid=23896 vsize=544476 CPUtime=135.38
/proc/23897/task/24041/stat : 24041 (pb_cplex) R 23896 23896 23089 0 -1 4202560 184184 0 0 0 13501 37 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 136007629 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24042] ppid=23896 vsize=544476 CPUtime=137.37
/proc/23897/task/24042/stat : 24042 (pb_cplex) R 23896 23896 23089 0 -1 4202560 75496 0 0 0 13713 24 0 0 25 0 8 0 146857562 557543424 87131 4089446400 134512640 146736320 4291895664 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1183.15
Current children cumulated vsize (KiB) 553176

[startup+582.301 s]
/proc/loadavg: 8.69 10.47 7.39 10/188 24183
/proc/meminfo: memFree=30539620/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=283080 CPUtime=1273.29
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1223854 0 0 0 127053 276 0 0 25 0 1 0 146842075 289873920 51904 4089446400 134512640 146736320 4291895664 18446744073709551615 136403117 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/23897/statm: 70770 51904 1083 2985 0 67312 0
Current children cumulated CPU time (s) 1273.29
Current children cumulated vsize (KiB) 291780

[startup+642.34 s]
/proc/loadavg: 6.25 9.45 7.23 9/188 24184
/proc/meminfo: memFree=30536680/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=283080 CPUtime=1325.19
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1224081 0 0 0 132241 278 0 0 25 0 1 0 146842075 289873920 52131 4089446400 134512640 146736320 4291895664 18446744073709551615 136476113 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/23897/statm: 70770 52131 1083 2985 0 67312 0
Current children cumulated CPU time (s) 1325.19
Current children cumulated vsize (KiB) 291780

[startup+702.301 s]
/proc/loadavg: 6.41 8.92 7.18 9/179 24220
/proc/meminfo: memFree=30440048/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=523772 CPUtime=1493.91
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1423095 0 0 0 149065 326 0 0 25 0 8 0 146842075 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 136008157 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/23897/statm: 130943 95446 1078 2985 0 127485 0
[pid=23897/tid=24210] ppid=23896 vsize=523772 CPUtime=19.36
/proc/23897/task/24210/stat : 24210 (pb_cplex) R 23896 23896 23089 0 -1 4202560 23840 0 0 0 1931 5 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23897/tid=24211] ppid=23896 vsize=523772 CPUtime=15.06
/proc/23897/task/24211/stat : 24211 (pb_cplex) R 23896 23896 23089 0 -1 4202560 24663 0 0 0 1501 5 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 135999265 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23897/tid=24212] ppid=23896 vsize=523772 CPUtime=16.56
/proc/23897/task/24212/stat : 24212 (pb_cplex) R 23896 23896 23089 0 -1 4202560 26473 0 0 0 1650 6 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 136007213 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24213] ppid=23896 vsize=523772 CPUtime=19.85
/proc/23897/task/24213/stat : 24213 (pb_cplex) R 23896 23896 23089 0 -1 4202560 26429 0 0 0 1979 6 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 139046546 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=23897/tid=24214] ppid=23896 vsize=523772 CPUtime=17.03
/proc/23897/task/24214/stat : 24214 (pb_cplex) R 23896 23896 23089 0 -1 4202560 17686 0 0 0 1699 4 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 136007605 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23897/tid=24215] ppid=23896 vsize=523772 CPUtime=15.13
/proc/23897/task/24215/stat : 24215 (pb_cplex) R 23896 23896 23089 0 -1 4202560 22316 0 0 0 1509 4 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 136384857 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24216] ppid=23896 vsize=523772 CPUtime=18.28
/proc/23897/task/24216/stat : 24216 (pb_cplex) R 23896 23896 23089 0 -1 4202560 23744 0 0 0 1823 5 0 0 25 0 8 0 146909953 536342528 95446 4089446400 134512640 146736320 4291895664 18446744073709551615 135854186 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1493.91
Current children cumulated vsize (KiB) 532472



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+744.301 s]
/proc/loadavg: 6.78 8.70 7.18 9/179 24222
/proc/meminfo: memFree=30432184/32950928 swapFree=67111528/67111528
[pid=23896] ppid=23894 vsize=8700 CPUtime=0
/proc/23896/stat : 23896 (run) S 23894 23896 23089 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146842075 8908800 249 4089446400 4194304 4922060 140737386185072 18446744073709551615 254500510853 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/23896/statm: 2175 249 208 178 0 68 0
[pid=23897] ppid=23896 vsize=529900 CPUtime=1800.29
/proc/23897/stat : 23897 (pb_cplex) R 23896 23896 23089 0 -1 4202496 1574258 0 0 0 179668 361 0 0 25 0 8 0 146842075 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136008242 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/23897/statm: 132475 97350 1075 2985 0 129017 0
[pid=23897/tid=24210] ppid=23896 vsize=529900 CPUtime=57.25
/proc/23897/task/24210/stat : 24210 (pb_cplex) R 23896 23896 23089 0 -1 4202560 54695 0 0 0 5714 11 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136413871 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=23897/tid=24211] ppid=23896 vsize=529900 CPUtime=54.61
/proc/23897/task/24211/stat : 24211 (pb_cplex) R 23896 23896 23089 0 -1 4202560 35301 0 0 0 5453 8 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136413855 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=23897/tid=24212] ppid=23896 vsize=529900 CPUtime=54.89
/proc/23897/task/24212/stat : 24212 (pb_cplex) R 23896 23896 23089 0 -1 4202560 32222 0 0 0 5481 8 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 135999693 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=23897/tid=24213] ppid=23896 vsize=529900 CPUtime=58.46
/proc/23897/task/24213/stat : 24213 (pb_cplex) R 23896 23896 23089 0 -1 4202560 60553 0 0 0 5833 13 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136400530 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=23897/tid=24214] ppid=23896 vsize=529900 CPUtime=53.28
/proc/23897/task/24214/stat : 24214 (pb_cplex) R 23896 23896 23089 0 -1 4202560 30054 0 0 0 5320 8 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=23897/tid=24215] ppid=23896 vsize=529900 CPUtime=52
/proc/23897/task/24215/stat : 24215 (pb_cplex) R 23896 23896 23089 0 -1 4202560 49480 0 0 0 5189 11 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 136006074 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=23897/tid=24216] ppid=23896 vsize=529900 CPUtime=60.15
/proc/23897/task/24216/stat : 24216 (pb_cplex) R 23896 23896 23089 0 -1 4202560 27534 0 0 0 6008 7 0 0 25 0 8 0 146909953 542617600 97350 4089446400 134512640 146736320 4291895664 18446744073709551615 139042902 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.29
Current children cumulated vsize (KiB) 538600

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23896 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.29
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 744.317
CPU time (s): 1800.29
CPU user time (s): 1796.68
CPU system time (s): 3.61
CPU usage (%): 241.871
Max. virtual memory (cumulated for all children) (KiB): 579856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.3228 second user time and 2.78558 second system time

The end

Launcher Data 

Begin job on node149 at 2010-07-02 09:24:32
IDJOB=2697655
IDBENCH=79098
IDSOLVER=1210
FILE ID=node149/2697655-1278055472
PBS_JOBID= 11198883
Free space on /tmp= 74004 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/normalized-j605_1-unsat--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697655-1278055472/watcher-2697655-1278055472 -o /tmp/evaluation-result-2697655-1278055472/solver-2697655-1278055472 -C 1800 -W 2000 -M 3800  run HOME/instance-2697655-1278055472.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 45ee7d19535e08aa25eac21bd6c9cde2
RANDOM SEED=2004189561

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30794844 kB
Buffers:        226088 kB
Cached:        1705364 kB
SwapCached:          0 kB
Active:         697348 kB
Inactive:      1305112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30794844 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           34760 kB
Writeback:           0 kB
AnonPages:       71176 kB
Mapped:          16348 kB
Slab:            90568 kB
PageTables:       5040 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   214132 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74004 MiB
End job on node149 at 2010-07-02 09:36:56