Trace number 2697532

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.4 812.717

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/
normalized-ooo.rf10.ucl--soft-66-100-0.wbo
MD5SUM5805010aa07d3b134ea004b7ad815631
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark7.69083
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables18069
Total number of constraints52475
Number of soft constraints17765
Number of constraints which are clauses51555
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints920
Minimum length of a constraint1
Maximum length of a constraint11
Top cost 896785
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 896784
Biggest number in a constraint 39
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 132
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697532-1278055365.wbo.
0.00/0.00	c Instance file HOME/instance-2697532-1278055365.wbo
0.00/0.00	c File size is 1679058 bytes.
67.19/84.59	c Highest Coefficient sum: 132
67.19/84.59	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
67.25/84.64	c ============================[ Problem Statistics ]=============================
67.25/84.64	c |                                                                             |
67.25/84.64	c |  Parsing time:          67.24        s                                      |
67.25/84.64	c |  Number Variables:      35834                                               |
67.25/84.64	c |  Number Constraints:    52476                                               |
67.25/84.64	c ===============================================================================
1800.40/812.71	c Remaining time 1732.76 sec.
1800.40/812.71	c 
1800.40/812.71	c *** INTERRUPTED ***
1800.40/812.71	s UNKNOWN
1800.40/812.71	c Total CPU time              : 1796.84 s
1800.40/812.71	c Memory used           : 887.84 MB
1800.40/812.71	c CPU time              : 1796.84 s
1800.40/812.71	c 
1800.40/812.71	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697532-1278055365/watcher-2697532-1278055365 -o /tmp/evaluation-result-2697532-1278055365/solver-2697532-1278055365 -C 1800 -W 2000 -M 3800 run HOME/instance-2697532-1278055365.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.27 7.61 3.91 9/186 24391
/proc/meminfo: memFree=30211492/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0

[startup+0.0800721 s]
/proc/loadavg: 9.27 7.61 3.91 9/186 24391
/proc/meminfo: memFree=30211492/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.171056 s]
/proc/loadavg: 9.27 7.61 3.91 9/186 24391
/proc/meminfo: memFree=30211492/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.353685 s]
/proc/loadavg: 9.27 7.61 3.91 9/186 24391
/proc/meminfo: memFree=30211492/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701027 s]
/proc/loadavg: 9.27 7.61 3.91 9/186 24391
/proc/meminfo: memFree=30211492/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.56581 s]
/proc/loadavg: 9.17 7.62 3.93 3/188 24393
/proc/meminfo: memFree=30208748/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=16652 CPUtime=1.18
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1004 0 0 0 118 0 0 0 25 0 1 0 146832560 17051648 957 4089446400 134512640 146736320 4291218592 18446744073709551615 140528640 0 0 4096 16387 0 0 0 17 2 0 0 0
/proc/24392/statm: 4163 957 334 2985 0 687 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 25352

[startup+3.13753 s]
/proc/loadavg: 9.17 7.62 3.93 9/188 24393
/proc/meminfo: memFree=30207632/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=17728 CPUtime=2.63
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1302 0 0 0 263 0 0 0 25 0 1 0 146832560 18153472 1255 4089446400 134512640 146736320 4291218592 18446744073709551615 140647808 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/24392/statm: 4432 1255 359 2985 0 956 0
Current children cumulated CPU time (s) 2.63
Current children cumulated vsize (KiB) 26428

[startup+6.31897 s]
/proc/loadavg: 9.17 7.62 3.93 8/188 24393
/proc/meminfo: memFree=30204904/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=19300 CPUtime=5.02
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1716 0 0 0 502 0 0 0 25 0 1 0 146832560 19763200 1636 4089446400 134512640 146736320 4291218592 18446744073709551615 140528780 0 0 4096 16387 0 0 0 17 3 0 0 0
/proc/24392/statm: 4825 1636 388 2985 0 1349 0
Current children cumulated CPU time (s) 5.02
Current children cumulated vsize (KiB) 28000
heavy processes:

[startup+12.7009 s]
/proc/loadavg: 8.07 7.43 3.91 9/188 24393
/proc/meminfo: memFree=30203968/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=21364 CPUtime=9.98
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 2224 0 0 0 998 0 0 0 25 0 1 0 146832560 21876736 2144 4089446400 134512640 146736320 4291218592 18446744073709551615 140683260 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24392/statm: 5341 2144 431 2985 0 1865 0
Current children cumulated CPU time (s) 9.98
Current children cumulated vsize (KiB) 30064
heavy processes:

[startup+25.5007 s]
/proc/loadavg: 8.29 7.50 3.97 11/188 24393
/proc/meminfo: memFree=30201576/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=23744 CPUtime=17.07
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 2929 0 0 0 1705 2 0 0 25 0 1 0 146832560 24313856 2784 4089446400 134512640 146736320 4291218592 18446744073709551615 140679034 0 0 4096 16387 0 0 0 17 2 0 0 0
/proc/24392/statm: 5936 2784 476 2985 0 2460 0
Current children cumulated CPU time (s) 17.07
Current children cumulated vsize (KiB) 32444
heavy processes:

[startup+51.1011 s]
/proc/loadavg: 8.63 7.62 4.10 3/188 24395
/proc/meminfo: memFree=30198656/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=28236 CPUtime=38.26
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 4110 0 0 0 3823 3 0 0 25 0 1 0 146832560 28913664 3965 4089446400 134512640 146736320 4291218592 18446744073709551615 134814121 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24392/statm: 7059 3965 578 2985 0 3583 0
Current children cumulated CPU time (s) 38.26
Current children cumulated vsize (KiB) 36936
heavy processes:

[startup+102.306 s]
/proc/loadavg: 7.34 7.43 4.24 3/181 24423
/proc/meminfo: memFree=30160060/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=168968 CPUtime=83.87
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 145002 0 0 0 8363 24 0 0 25 0 1 0 146832560 173023232 26006 4089446400 134512640 146736320 4291218592 18446744073709551615 139044564 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/24392/statm: 42242 26006 1035 2985 0 38784 0
Current children cumulated CPU time (s) 83.87
Current children cumulated vsize (KiB) 177668

[startup+162.301 s]
/proc/loadavg: 4.52 6.55 4.13 3/188 24488
/proc/meminfo: memFree=30139668/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=170000 CPUtime=143.85
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 207007 0 0 0 14353 32 0 0 25 0 1 0 146832560 174080000 25687 4089446400 134512640 146736320 4291218592 18446744073709551615 136403109 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/24392/statm: 42500 25687 1029 2985 0 39042 0
Current children cumulated CPU time (s) 143.85
Current children cumulated vsize (KiB) 178700

[startup+222.301 s]
/proc/loadavg: 6.61 6.77 4.36 10/188 24511
/proc/meminfo: memFree=30109336/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=169912 CPUtime=202.01
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 280152 0 0 0 20159 42 0 0 25 0 1 0 146832560 173989888 25958 4089446400 134512640 146736320 4291218592 18446744073709551615 136403112 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/24392/statm: 42478 25958 1029 2985 0 39020 0
Current children cumulated CPU time (s) 202.01
Current children cumulated vsize (KiB) 178612

[startup+282.3 s]
/proc/loadavg: 5.24 6.44 4.40 11/188 24513
/proc/meminfo: memFree=30100524/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=174168 CPUtime=252.02
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 351416 0 0 0 25149 53 0 0 25 0 1 0 146832560 178348032 26724 4089446400 134512640 146736320 4291218592 18446744073709551615 139044550 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/24392/statm: 43542 26724 1029 2985 0 40084 0
Current children cumulated CPU time (s) 252.02
Current children cumulated vsize (KiB) 182868

[startup+342.301 s]
/proc/loadavg: 6.23 6.49 4.54 4/188 24556
/proc/meminfo: memFree=29733064/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=853352 CPUtime=359.1
/proc/24392/stat : 24392 (pb_cplex) S 24391 24391 23725 0 -1 4202496 739020 0 0 0 35786 124 0 0 25 0 8 0 146832560 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/24392/statm: 213338 133185 1229 2985 0 209880 0
[pid=24392/tid=24521] ppid=24391 vsize=853352 CPUtime=5.74
/proc/24392/task/24521/stat : 24521 (pb_cplex) S 24391 24391 23725 0 -1 4202560 14226 0 0 0 571 3 0 0 18 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 2 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=853352 CPUtime=7
/proc/24392/task/24522/stat : 24522 (pb_cplex) S 24391 24391 23725 0 -1 4202560 21167 0 0 0 697 3 0 0 18 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 5 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=853352 CPUtime=7.09
/proc/24392/task/24523/stat : 24523 (pb_cplex) S 24391 24391 23725 0 -1 4202560 20035 0 0 0 704 5 0 0 18 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 5 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=853352 CPUtime=16.1
/proc/24392/task/24524/stat : 24524 (pb_cplex) R 24391 24391 23725 0 -1 4202560 12732 0 0 0 1607 3 0 0 25 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 135450763 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=853352 CPUtime=6.68
/proc/24392/task/24525/stat : 24525 (pb_cplex) S 24391 24391 23725 0 -1 4202560 20607 0 0 0 664 4 0 0 25 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 3 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=853352 CPUtime=3.17
/proc/24392/task/24526/stat : 24526 (pb_cplex) S 24391 24391 23725 0 -1 4202560 15100 0 0 0 315 2 0 0 19 0 8 0 146863186 873832448 133185 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 1 0 0 0

################
# More data... #
################

/proc/24392/statm: 226974 148153 1189 2985 0 223516 0
[pid=24392/tid=24521] ppid=24391 vsize=907896 CPUtime=85.21
/proc/24392/task/24521/stat : 24521 (pb_cplex) S 24391 24391 23725 0 -1 4202560 63889 0 0 0 8496 25 0 0 18 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 5 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=907896 CPUtime=106.57
/proc/24392/task/24522/stat : 24522 (pb_cplex) R 24391 24391 23725 0 -1 4202560 93027 0 0 0 10639 18 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 136007191 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=907896 CPUtime=105.65
/proc/24392/task/24523/stat : 24523 (pb_cplex) R 24391 24391 23725 0 -1 4202560 85718 0 0 0 10544 21 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 136400570 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=907896 CPUtime=109.2
/proc/24392/task/24524/stat : 24524 (pb_cplex) S 24391 24391 23725 0 -1 4202560 118509 0 0 0 10893 27 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 6 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=907896 CPUtime=86.9
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 71699 0 0 0 8671 19 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 139044514 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=907896 CPUtime=100.85
/proc/24392/task/24526/stat : 24526 (pb_cplex) R 24391 24391 23725 0 -1 4202560 55107 0 0 0 10073 12 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 136007605 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=907896 CPUtime=103.64
/proc/24392/task/24527/stat : 24527 (pb_cplex) S 24391 24391 23725 0 -1 4202560 84407 0 0 0 10346 18 0 0 25 0 8 0 146863186 929685504 148153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1075.77
Current children cumulated vsize (KiB) 916596

[startup+642.348 s]
/proc/loadavg: 9.80 9.68 6.56 12/195 24616
/proc/meminfo: memFree=29620176/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=908772 CPUtime=1189.12
/proc/24392/stat : 24392 (pb_cplex) S 24391 24391 23725 0 -1 4202496 1400931 0 0 0 118629 283 0 0 25 0 8 0 146832560 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24392/statm: 227193 148443 1189 2985 0 223735 0
[pid=24392/tid=24521] ppid=24391 vsize=908772 CPUtime=85.21
/proc/24392/task/24521/stat : 24521 (pb_cplex) S 24391 24391 23725 0 -1 4202560 63889 0 0 0 8496 25 0 0 18 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 5 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=908772 CPUtime=140.54
/proc/24392/task/24522/stat : 24522 (pb_cplex) R 24391 24391 23725 0 -1 4202560 127765 0 0 0 14031 23 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=908772 CPUtime=125.69
/proc/24392/task/24523/stat : 24523 (pb_cplex) S 24391 24391 23725 0 -1 4202560 117467 0 0 0 12542 27 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 7 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=908772 CPUtime=109.2
/proc/24392/task/24524/stat : 24524 (pb_cplex) S 24391 24391 23725 0 -1 4202560 118509 0 0 0 10893 27 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 6 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=908772 CPUtime=118.17
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 94450 0 0 0 11793 24 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 136400474 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=908772 CPUtime=128.9
/proc/24392/task/24526/stat : 24526 (pb_cplex) R 24391 24391 23725 0 -1 4202560 94576 0 0 0 12871 19 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=908772 CPUtime=103.64
/proc/24392/task/24527/stat : 24527 (pb_cplex) S 24391 24391 23725 0 -1 4202560 84407 0 0 0 10346 18 0 0 25 0 8 0 146863186 930582528 148443 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1189.12
Current children cumulated vsize (KiB) 917472

[startup+702.347 s]
/proc/loadavg: 13.55 10.67 7.09 17/195 24624
/proc/meminfo: memFree=29613632/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=900296 CPUtime=1262.35
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1464543 0 0 0 125935 300 0 0 25 0 8 0 146832560 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136004898 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/24392/statm: 225074 148347 1189 2985 0 221616 0
[pid=24392/tid=24521] ppid=24391 vsize=900296 CPUtime=90.49
/proc/24392/task/24521/stat : 24521 (pb_cplex) R 24391 24391 23725 0 -1 4202560 68462 0 0 0 9022 27 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136007657 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=900296 CPUtime=156.78
/proc/24392/task/24522/stat : 24522 (pb_cplex) R 24391 24391 23725 0 -1 4202560 140752 0 0 0 15652 26 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136007313 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=900296 CPUtime=131.41
/proc/24392/task/24523/stat : 24523 (pb_cplex) R 24391 24391 23725 0 -1 4202560 120819 0 0 0 13114 27 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 138443535 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=900296 CPUtime=115.13
/proc/24392/task/24524/stat : 24524 (pb_cplex) R 24391 24391 23725 0 -1 4202560 124309 0 0 0 11483 30 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136006275 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=900296 CPUtime=140.48
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 124294 0 0 0 14018 30 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136007605 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=900296 CPUtime=134.38
/proc/24392/task/24526/stat : 24526 (pb_cplex) R 24391 24391 23725 0 -1 4202560 97912 0 0 0 13418 20 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136007612 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=900296 CPUtime=109.5
/proc/24392/task/24527/stat : 24527 (pb_cplex) R 24391 24391 23725 0 -1 4202560 87181 0 0 0 10931 19 0 0 25 0 8 0 146863186 921903104 148347 4089446400 134512640 146736320 4291218592 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1262.35
Current children cumulated vsize (KiB) 908996

[startup+762.307 s]
/proc/loadavg: 8.37 9.88 7.05 3/179 24648
/proc/meminfo: memFree=29688356/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=915348 CPUtime=1521.61
/proc/24392/stat : 24392 (pb_cplex) S 24391 24391 23725 0 -1 4202496 1630790 0 0 0 151831 330 0 0 25 0 8 0 146832560 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/24392/statm: 228837 149153 1191 2985 0 225379 0
[pid=24392/tid=24521] ppid=24391 vsize=915348 CPUtime=118.25
/proc/24392/task/24521/stat : 24521 (pb_cplex) S 24391 24391 23725 0 -1 4202560 85429 0 0 0 11795 30 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 0 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=915348 CPUtime=168.69
/proc/24392/task/24522/stat : 24522 (pb_cplex) S 24391 24391 23725 0 -1 4202560 151143 0 0 0 16840 29 0 0 18 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 7 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=915348 CPUtime=184.9
/proc/24392/task/24523/stat : 24523 (pb_cplex) R 24391 24391 23725 0 -1 4202560 165910 0 0 0 18455 35 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 136007626 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=915348 CPUtime=149.4
/proc/24392/task/24524/stat : 24524 (pb_cplex) S 24391 24391 23725 0 -1 4202560 143528 0 0 0 14907 33 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 5 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=915348 CPUtime=193.84
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 175155 0 0 0 19345 39 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 135999793 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=915348 CPUtime=164.94
/proc/24392/task/24526/stat : 24526 (pb_cplex) S 24391 24391 23725 0 -1 4202560 118483 0 0 0 16470 24 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 3 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=915348 CPUtime=129.95
/proc/24392/task/24527/stat : 24527 (pb_cplex) S 24391 24391 23725 0 -1 4202560 88826 0 0 0 12975 20 0 0 25 0 8 0 146863186 937316352 149153 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1521.61
Current children cumulated vsize (KiB) 924048



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+812.701 s]
/proc/loadavg: 6.84 9.18 6.95 6/179 24650
/proc/meminfo: memFree=29686952/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=909144 CPUtime=1800.4
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1784202 0 0 0 179681 359 0 0 25 0 8 0 146832560 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007053 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/24392/statm: 227286 149997 1188 2985 0 223828 0
[pid=24392/tid=24521] ppid=24391 vsize=909144 CPUtime=155.15
/proc/24392/task/24521/stat : 24521 (pb_cplex) R 24391 24391 23725 0 -1 4202560 104830 0 0 0 15482 33 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007213 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=909144 CPUtime=189.69
/proc/24392/task/24522/stat : 24522 (pb_cplex) S 24391 24391 23725 0 -1 4202560 165224 0 0 0 18937 32 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 1 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=909144 CPUtime=235.29
/proc/24392/task/24523/stat : 24523 (pb_cplex) R 24391 24391 23725 0 -1 4202560 200676 0 0 0 23487 42 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 135524926 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=909144 CPUtime=186.3
/proc/24392/task/24524/stat : 24524 (pb_cplex) R 24391 24391 23725 0 -1 4202560 158209 0 0 0 18594 36 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=909144 CPUtime=232.31
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 194746 0 0 0 23189 42 0 0 20 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007386 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=909144 CPUtime=190.43
/proc/24392/task/24526/stat : 24526 (pb_cplex) S 24391 24391 23725 0 -1 4202560 128956 0 0 0 19017 26 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 7 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=909144 CPUtime=162.69
/proc/24392/task/24527/stat : 24527 (pb_cplex) S 24391 24391 23725 0 -1 4202560 111195 0 0 0 16245 24 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.4
Current children cumulated vsize (KiB) 917844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+812.701 s]
/proc/loadavg: 6.84 9.18 6.95 6/179 24650
/proc/meminfo: memFree=29686952/32951124 swapFree=67111528/67111528
[pid=24391] ppid=24389 vsize=8700 CPUtime=0
/proc/24391/stat : 24391 (run) S 24389 24391 23725 0 -1 4202496 366 0 0 0 0 0 0 0 20 0 1 0 146832559 8908800 249 4089446400 4194304 4922060 140734425576512 18446744073709551615 228244167813 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/24391/statm: 2175 249 208 178 0 68 0
[pid=24392] ppid=24391 vsize=909144 CPUtime=1800.4
/proc/24392/stat : 24392 (pb_cplex) R 24391 24391 23725 0 -1 4202496 1784202 0 0 0 179681 359 0 0 25 0 8 0 146832560 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007053 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/24392/statm: 227286 149997 1188 2985 0 223828 0
[pid=24392/tid=24521] ppid=24391 vsize=909144 CPUtime=155.15
/proc/24392/task/24521/stat : 24521 (pb_cplex) R 24391 24391 23725 0 -1 4202560 104830 0 0 0 15482 33 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007213 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24392/tid=24522] ppid=24391 vsize=909144 CPUtime=189.69
/proc/24392/task/24522/stat : 24522 (pb_cplex) S 24391 24391 23725 0 -1 4202560 165224 0 0 0 18937 32 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 1 0 0 0
[pid=24392/tid=24523] ppid=24391 vsize=909144 CPUtime=235.29
/proc/24392/task/24523/stat : 24523 (pb_cplex) R 24391 24391 23725 0 -1 4202560 200676 0 0 0 23487 42 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 135524926 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24392/tid=24524] ppid=24391 vsize=909144 CPUtime=186.3
/proc/24392/task/24524/stat : 24524 (pb_cplex) R 24391 24391 23725 0 -1 4202560 158209 0 0 0 18594 36 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24392/tid=24525] ppid=24391 vsize=909144 CPUtime=232.31
/proc/24392/task/24525/stat : 24525 (pb_cplex) R 24391 24391 23725 0 -1 4202560 194746 0 0 0 23189 42 0 0 20 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 136007386 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24392/tid=24526] ppid=24391 vsize=909144 CPUtime=190.43
/proc/24392/task/24526/stat : 24526 (pb_cplex) S 24391 24391 23725 0 -1 4202560 128956 0 0 0 19017 26 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 7 0 0 0
[pid=24392/tid=24527] ppid=24391 vsize=909144 CPUtime=162.69
/proc/24392/task/24527/stat : 24527 (pb_cplex) S 24391 24391 23725 0 -1 4202560 111195 0 0 0 16245 24 0 0 25 0 8 0 146863186 930963456 149997 4089446400 134512640 146736320 4291218592 18446744073709551615 144580073 0 2 4096 16387 18446604453972111680 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.4
Current children cumulated vsize (KiB) 917844

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24391 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 1800.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 812.717
CPU time (s): 1800.4
CPU user time (s): 1796.81
CPU system time (s): 3.59
CPU usage (%): 221.528
Max. virtual memory (cumulated for all children) (KiB): 932772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 366
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.50077 second user time and 3.03454 second system time

The end

Launcher Data 

Begin job on node136 at 2010-07-02 09:22:46
IDJOB=2697532
IDBENCH=79062
IDSOLVER=1210
FILE ID=node136/2697532-1278055365
PBS_JOBID= 11198910
Free space on /tmp= 74120 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/normalized-ooo.rf10.ucl--soft-66-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697532-1278055365/watcher-2697532-1278055365 -o /tmp/evaluation-result-2697532-1278055365/solver-2697532-1278055365 -C 1800 -W 2000 -M 3800  run HOME/instance-2697532-1278055365.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 5805010aa07d3b134ea004b7ad815631
RANDOM SEED=1561724974

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30211896 kB
Buffers:        220868 kB
Cached:        2246712 kB
SwapCached:          0 kB
Active:        1139212 kB
Inactive:      1446560 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30211896 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           18304 kB
Writeback:           0 kB
AnonPages:      118116 kB
Mapped:          19092 kB
Slab:            87096 kB
PageTables:       5308 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   340744 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74120 MiB
End job on node136 at 2010-07-02 09:36:21