Trace number 2697386

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.49 533.825

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/
normalized-dlx1c.rwmem.ucl--soft-66-100-0.wbo
MD5SUM912ca607d723e7995f4e9e6209c25e32
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark0.282956
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables9051
Total number of constraints25833
Number of soft constraints8852
Number of constraints which are clauses24941
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints892
Minimum length of a constraint1
Maximum length of a constraint11
Top cost 443736
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 443735
Biggest number in a constraint 33
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 126
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.06	c pb_cplex 1.0 - 20100701
0.00/0.06	c Parsing wbo file format. File HOME/instance-2697386-1278055328.wbo.
0.00/0.06	c Instance file HOME/instance-2697386-1278055328.wbo
0.00/0.06	c File size is 828721 bytes.
16.34/21.65	c Highest Coefficient sum: 126
16.34/21.65	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
16.34/21.65	c ============================[ Problem Statistics ]=============================
16.34/21.65	c |                                                                             |
16.34/21.65	c |  Parsing time:          16.33        s                                      |
16.34/21.65	c |  Number Variables:      17903                                               |
16.34/21.65	c |  Number Constraints:    25834                                               |
16.34/21.65	c ===============================================================================
1800.49/533.81	c Remaining time 1783.67 sec.
1800.49/533.81	c 
1800.49/533.81	c *** INTERRUPTED ***
1800.49/533.81	s UNKNOWN
1800.49/533.81	c Total CPU time              : 1793.55 s
1800.49/533.81	c Memory used           : 545.42 MB
1800.49/533.81	c CPU time              : 1793.55 s
1800.49/533.81	c 
1800.49/533.81	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697386-1278055328/watcher-2697386-1278055328 -o /tmp/evaluation-result-2697386-1278055328/solver-2697386-1278055328 -C 1800 -W 2000 -M 3800 run HOME/instance-2697386-1278055328.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.03 7.09 3.52 4/186 21093
/proc/meminfo: memFree=31275716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0

[startup+0.213637 s]
/proc/loadavg: 9.03 7.09 3.52 4/186 21093
/proc/meminfo: memFree=31275716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.30862 s]
/proc/loadavg: 9.03 7.09 3.52 4/186 21093
/proc/meminfo: memFree=31275716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.441497 s]
/proc/loadavg: 9.03 7.09 3.52 4/186 21093
/proc/meminfo: memFree=31275716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.737549 s]
/proc/loadavg: 9.03 7.09 3.52 4/186 21093
/proc/meminfo: memFree=31275716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50051 s]
/proc/loadavg: 9.03 7.09 3.52 10/188 21095
/proc/meminfo: memFree=31273716/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=15128 CPUtime=0.65
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 840 0 0 0 65 0 0 0 25 0 1 0 146828905 15491072 794 4089446400 134512640 146736320 4287773648 18446744073709551615 140653489 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21094/statm: 3782 794 322 2985 0 513 0
Current children cumulated CPU time (s) 0.65
Current children cumulated vsize (KiB) 23828

[startup+3.1012 s]
/proc/loadavg: 9.03 7.09 3.52 10/188 21095
/proc/meminfo: memFree=31272600/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=16492 CPUtime=1.85
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 1168 0 0 0 184 1 0 0 25 0 1 0 146828905 16887808 1122 4089446400 134512640 146736320 4287773648 18446744073709551615 140647813 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/21094/statm: 4123 1122 347 2985 0 854 0
Current children cumulated CPU time (s) 1.85
Current children cumulated vsize (KiB) 25192
heavy processes:

[startup+6.32561 s]
/proc/loadavg: 9.11 7.14 3.56 3/188 21095
/proc/meminfo: memFree=31270988/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=18528 CPUtime=4.98
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 1707 0 0 0 497 1 0 0 25 0 1 0 146828905 18972672 1628 4089446400 134512640 146736320 4287773648 18446744073709551615 140587360 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/21094/statm: 4632 1628 387 2985 0 1363 0
Current children cumulated CPU time (s) 4.98
Current children cumulated vsize (KiB) 27228
heavy processes:

[startup+12.7005 s]
/proc/loadavg: 8.94 7.14 3.57 3/188 21095
/proc/meminfo: memFree=31268516/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=20504 CPUtime=10.07
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 2222 0 0 0 1006 1 0 0 25 0 1 0 146828905 20996096 2143 4089446400 134512640 146736320 4287773648 18446744073709551615 140681168 0 0 4096 16387 0 0 0 17 5 0 0 0
/proc/21094/statm: 5126 2143 431 2985 0 1857 0
Current children cumulated CPU time (s) 10.07
Current children cumulated vsize (KiB) 29204
heavy processes:

[startup+25.5065 s]
/proc/loadavg: 8.57 7.14 3.63 7/188 21095
/proc/meminfo: memFree=31221272/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=92124 CPUtime=19.11
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 54265 0 0 0 1902 9 0 0 25 0 1 0 146828905 94334976 14483 4089446400 134512640 146736320 4287773648 18446744073709551615 139043566 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/21094/statm: 23031 14483 1040 2985 0 19573 0
Current children cumulated CPU time (s) 19.11
Current children cumulated vsize (KiB) 100824
heavy processes:

[startup+51.1011 s]
/proc/loadavg: 7.93 7.11 3.72 3/188 21131
/proc/meminfo: memFree=31020492/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=485104 CPUtime=69.43
/proc/21094/stat : 21094 (pb_cplex) S 21093 21093 20664 0 -1 4202496 317491 0 0 0 6885 58 0 0 19 0 8 0 146828905 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21094/statm: 121276 72728 1073 2985 0 117818 0
[pid=21094/tid=21125] ppid=21093 vsize=485104 CPUtime=3.7
/proc/21094/task/21125/stat : 21125 (pb_cplex) S 21093 21093 20664 0 -1 4202560 19078 0 0 0 366 4 0 0 18 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 3 0 0 0
[pid=21094/tid=21126] ppid=21093 vsize=485104 CPUtime=6.18
/proc/21094/task/21126/stat : 21126 (pb_cplex) R 21093 21093 20664 0 -1 4202560 30062 0 0 0 613 5 0 0 25 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144797937 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21094/tid=21127] ppid=21093 vsize=485104 CPUtime=3.32
/proc/21094/task/21127/stat : 21127 (pb_cplex) S 21093 21093 20664 0 -1 4202560 16141 0 0 0 329 3 0 0 19 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 2 0 0 0
[pid=21094/tid=21128] ppid=21093 vsize=485104 CPUtime=3.45
/proc/21094/task/21128/stat : 21128 (pb_cplex) S 21093 21093 20664 0 -1 4202560 20582 0 0 0 341 4 0 0 18 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 4 0 0 0
[pid=21094/tid=21129] ppid=21093 vsize=485104 CPUtime=3.67
/proc/21094/task/21129/stat : 21129 (pb_cplex) S 21093 21093 20664 0 -1 4202560 16606 0 0 0 364 3 0 0 18 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 7 0 0 0
[pid=21094/tid=21130] ppid=21093 vsize=485104 CPUtime=4.26
/proc/21094/task/21130/stat : 21130 (pb_cplex) S 21093 21093 20664 0 -1 4202560 19242 0 0 0 422 4 0 0 22 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 3 0 0 0
[pid=21094/tid=21131] ppid=21093 vsize=485104 CPUtime=4.01
/proc/21094/task/21131/stat : 21131 (pb_cplex) S 21093 21093 20664 0 -1 4202560 18280 0 0 0 398 3 0 0 23 0 8 0 146833237 496746496 72728 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 69.43
Current children cumulated vsize (KiB) 493804

[startup+102.3 s]
/proc/loadavg: 7.36 7.06 3.87 3/188 21140
/proc/meminfo: memFree=31015072/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=283472 CPUtime=200.5
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 587192 0 0 0 19936 114 0 0 25 0 1 0 146828905 290275328 50808 4089446400 134512640 146736320 4287773648 18446744073709551615 136384854 0 0 4096 16387 0 0 0 17 2 0 0 0
/proc/21094/statm: 70868 50808 1082 2985 0 67410 0
Current children cumulated CPU time (s) 200.5
Current children cumulated vsize (KiB) 292172

[startup+162.301 s]
/proc/loadavg: 5.66 6.60 3.91 3/195 21170
/proc/meminfo: memFree=30875872/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=506488 CPUtime=347.8
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 842966 0 0 0 34612 168 0 0 18 0 8 0 146828905 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 136007053 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21094/statm: 126622 93915 1086 2985 0 123164 0
[pid=21094/tid=21150] ppid=21093 vsize=506488 CPUtime=18.51
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 16316 0 0 0 1847 4 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 136405618 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=506488 CPUtime=15.11
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 26154 0 0 0 1506 5 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 136007289 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=506488 CPUtime=13.16
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 27579 0 0 0 1311 5 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 136007605 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=506488 CPUtime=8.57
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 29354 0 0 0 853 4 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 135454093 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=506488 CPUtime=10.25
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 28480 0 0 0 1020 5 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 139044552 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=506488 CPUtime=13.46
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 33889 0 0 0 1338 8 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 136007371 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=506488 CPUtime=12.07
/proc/21094/task/21156/stat : 21156 (pb_cplex) R 21093 21093 20664 0 -1 4202560 33874 0 0 0 1200 7 0 0 18 0 8 0 146842477 518643712 93915 4089446400 134512640 146736320 4287773648 18446744073709551615 137083827 0 2 4096 16387 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 347.8
Current children cumulated vsize (KiB) 515188

[startup+222.301 s]
/proc/loadavg: 9.10 7.43 4.36 12/195 21172
/proc/meminfo: memFree=30785876/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=529348 CPUtime=533.58
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 1134047 0 0 0 53134 224 0 0 25 0 8 0 146828905 542052352 101339 4089446400 134512640 146736320 4287773648 18446744073709551615 136400460 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21094/statm: 132337 101339 1083 2985 0 128879 0
[pid=21094/tid=21150] ppid=21093 vsize=529348 CPUtime=42.85
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 47796 0 0 0 4274 11 0 0 25 0 8 0 146842477 542052352 101339 4089446400 134512640 146736320 4287773648 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=529348 CPUtime=43.88
/proc/21094/task/21151/stat : 21151 (pb_cplex) S 21093 21093 20664 0 -1 4202560 90741 0 0 0 4372 16 0 0 22 0 8 0 146842477 542052352 101339 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 3 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=529348 CPUtime=40.79
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 49388 0 0 0 4070 9 0 0 25 0 8 0 146842477 542052352 101339 4089446400 134512640 146736320 4287773648 18446744073709551615 136400420 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=529348 CPUtime=29.97
/proc/21094/task/21153/stat : 21153 (pb_cplex) S 21093 21093 20664 0 -1 4202560 74505 0 0 0 2984 13 0 0 21 0 8 0 146842477 542052352 101339 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/21094/statm: 135882 106626 1083 2985 0 132424 0
[pid=21094/tid=21150] ppid=21093 vsize=543528 CPUtime=96.4
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 159745 0 0 0 9604 36 0 0 20 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 137369836 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=543528 CPUtime=99.99
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 178625 0 0 0 9963 36 0 0 20 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=543528 CPUtime=108.99
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 124064 0 0 0 10873 26 0 0 20 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 136400742 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=543528 CPUtime=87.15
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 189805 0 0 0 8679 36 0 0 22 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 136388555 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=543528 CPUtime=83.88
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 183479 0 0 0 8351 37 0 0 25 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=543528 CPUtime=94.6
/proc/21094/task/21155/stat : 21155 (pb_cplex) S 21093 21093 20664 0 -1 4202560 159675 0 0 0 9428 32 0 0 19 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 1 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=543528 CPUtime=92.97
/proc/21094/task/21156/stat : 21156 (pb_cplex) S 21093 21093 20664 0 -1 4202560 186373 0 0 0 9257 40 0 0 19 0 8 0 146842477 556572672 106626 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1003.21
Current children cumulated vsize (KiB) 552228

[startup+402.301 s]
/proc/loadavg: 11.15 9.23 5.60 11/195 21176
/proc/meminfo: memFree=30735736/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=549052 CPUtime=1282.08
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 2400647 0 0 0 127712 496 0 0 20 0 8 0 146828905 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 138439232 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21094/statm: 137263 107610 1080 2985 0 133805 0
[pid=21094/tid=21150] ppid=21093 vsize=549052 CPUtime=131.52
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 236200 0 0 0 13099 53 0 0 19 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=549052 CPUtime=132.98
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 248305 0 0 0 13248 50 0 0 19 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 135963991 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=549052 CPUtime=141.85
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 183904 0 0 0 14147 38 0 0 19 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 136006861 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=549052 CPUtime=126.64
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 226068 0 0 0 12618 46 0 0 19 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 135845851 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=549052 CPUtime=117.51
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 254539 0 0 0 11699 52 0 0 17 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 139042902 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=549052 CPUtime=129.16
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 243665 0 0 0 12868 48 0 0 25 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 135999573 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=549052 CPUtime=126.68
/proc/21094/task/21156/stat : 21156 (pb_cplex) R 21093 21093 20664 0 -1 4202560 215867 0 0 0 12620 48 0 0 19 0 8 0 146842477 562229248 107610 4089446400 134512640 146736320 4287773648 18446744073709551615 135982680 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1282.08
Current children cumulated vsize (KiB) 557752

[startup+462.307 s]
/proc/loadavg: 10.67 9.46 5.91 13/195 21178
/proc/meminfo: memFree=30715524/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=555664 CPUtime=1524.62
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 2807580 0 0 0 151879 583 0 0 24 0 8 0 146828905 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 136007616 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21094/statm: 138916 109144 1081 2985 0 135458 0
[pid=21094/tid=21150] ppid=21093 vsize=555664 CPUtime=161.37
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 264488 0 0 0 16076 61 0 0 25 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 136004384 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=555664 CPUtime=166.69
/proc/21094/task/21151/stat : 21151 (pb_cplex) S 21093 21093 20664 0 -1 4202560 306294 0 0 0 16608 61 0 0 25 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 1 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=555664 CPUtime=172.05
/proc/21094/task/21152/stat : 21152 (pb_cplex) S 21093 21093 20664 0 -1 4202560 214752 0 0 0 17161 44 0 0 23 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 4 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=555664 CPUtime=156.4
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 290970 0 0 0 15580 60 0 0 25 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 136403114 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=555664 CPUtime=147.03
/proc/21094/task/21154/stat : 21154 (pb_cplex) S 21093 21093 20664 0 -1 4202560 320301 0 0 0 14637 66 0 0 25 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 1 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=555664 CPUtime=161.38
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 300994 0 0 0 16078 60 0 0 23 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=555664 CPUtime=154.07
/proc/21094/task/21156/stat : 21156 (pb_cplex) S 21093 21093 20664 0 -1 4202560 242966 0 0 0 15351 56 0 0 21 0 8 0 146842477 568999936 109144 4089446400 134512640 146736320 4287773648 18446744073709551615 144580073 0 2 4096 16387 18446604453908577280 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1524.62
Current children cumulated vsize (KiB) 564364

[startup+522.3 s]
/proc/loadavg: 11.39 9.92 6.29 17/195 21180
/proc/meminfo: memFree=30713608/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=562328 CPUtime=1759.89
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 3259237 0 0 0 175312 677 0 0 21 0 8 0 146828905 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 136004384 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21094/statm: 140582 110065 1080 2985 0 137124 0
[pid=21094/tid=21150] ppid=21093 vsize=562328 CPUtime=190.6
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 323097 0 0 0 18987 73 0 0 21 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 139044581 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=562328 CPUtime=195.07
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 387678 0 0 0 19431 76 0 0 18 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 136006886 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=562328 CPUtime=199.05
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 278733 0 0 0 19848 57 0 0 18 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 135453231 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=562328 CPUtime=185.21
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 336929 0 0 0 18449 72 0 0 19 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 136008017 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=562328 CPUtime=175.06
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 388168 0 0 0 17427 79 0 0 21 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 135999578 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=562328 CPUtime=194.89
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 304711 0 0 0 19427 62 0 0 21 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 136007616 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=562328 CPUtime=183.14
/proc/21094/task/21156/stat : 21156 (pb_cplex) R 21093 21093 20664 0 -1 4202560 290396 0 0 0 18247 67 0 0 21 0 8 0 146842477 575823872 110065 4089446400 134512640 146736320 4287773648 18446744073709551615 136007277 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1759.89
Current children cumulated vsize (KiB) 571028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+533.807 s]
/proc/loadavg: 12.06 10.15 6.42 11/195 21180
/proc/meminfo: memFree=30707416/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=558504 CPUtime=1800.49
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 3363742 0 0 0 179349 700 0 0 20 0 8 0 146828905 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135450724 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21094/statm: 139626 109492 1080 2985 0 136168 0
[pid=21094/tid=21150] ppid=21093 vsize=558504 CPUtime=195.15
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 331885 0 0 0 19440 75 0 0 17 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 136400566 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=558504 CPUtime=199.28
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 404739 0 0 0 19849 79 0 0 19 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 139047011 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=558504 CPUtime=203.52
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 294672 0 0 0 20292 60 0 0 17 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=558504 CPUtime=191.86
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 359244 0 0 0 19109 77 0 0 25 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=558504 CPUtime=179.47
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 399078 0 0 0 17865 82 0 0 20 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 136007329 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=558504 CPUtime=200.27
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 315985 0 0 0 19963 64 0 0 20 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 139042902 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=558504 CPUtime=188.91
/proc/21094/task/21156/stat : 21156 (pb_cplex) R 21093 21093 20664 0 -1 4202560 300653 0 0 0 18822 69 0 0 19 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135962010 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1800.49
Current children cumulated vsize (KiB) 567204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+533.807 s]
/proc/loadavg: 12.06 10.15 6.42 11/195 21180
/proc/meminfo: memFree=30707416/32951124 swapFree=67111528/67111528
[pid=21093] ppid=21091 vsize=8700 CPUtime=0
/proc/21093/stat : 21093 (run) S 21091 21093 20664 0 -1 4202496 365 0 0 0 0 0 0 0 20 0 1 0 146828898 8908800 249 4089446400 4194304 4922060 140735741997856 18446744073709551615 210204466309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/21093/statm: 2175 249 208 178 0 68 0
[pid=21094] ppid=21093 vsize=558504 CPUtime=1800.49
/proc/21094/stat : 21094 (pb_cplex) R 21093 21093 20664 0 -1 4202496 3363742 0 0 0 179349 700 0 0 20 0 8 0 146828905 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135450724 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21094/statm: 139626 109492 1080 2985 0 136168 0
[pid=21094/tid=21150] ppid=21093 vsize=558504 CPUtime=195.15
/proc/21094/task/21150/stat : 21150 (pb_cplex) R 21093 21093 20664 0 -1 4202560 331885 0 0 0 19440 75 0 0 17 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 136400566 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21094/tid=21151] ppid=21093 vsize=558504 CPUtime=199.28
/proc/21094/task/21151/stat : 21151 (pb_cplex) R 21093 21093 20664 0 -1 4202560 404739 0 0 0 19849 79 0 0 19 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 139047011 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21094/tid=21152] ppid=21093 vsize=558504 CPUtime=203.52
/proc/21094/task/21152/stat : 21152 (pb_cplex) R 21093 21093 20664 0 -1 4202560 294672 0 0 0 20292 60 0 0 17 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21094/tid=21153] ppid=21093 vsize=558504 CPUtime=191.86
/proc/21094/task/21153/stat : 21153 (pb_cplex) R 21093 21093 20664 0 -1 4202560 359244 0 0 0 19109 77 0 0 25 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21094/tid=21154] ppid=21093 vsize=558504 CPUtime=179.47
/proc/21094/task/21154/stat : 21154 (pb_cplex) R 21093 21093 20664 0 -1 4202560 399078 0 0 0 17865 82 0 0 20 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 136007329 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21094/tid=21155] ppid=21093 vsize=558504 CPUtime=200.27
/proc/21094/task/21155/stat : 21155 (pb_cplex) R 21093 21093 20664 0 -1 4202560 315985 0 0 0 19963 64 0 0 20 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 139042902 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21094/tid=21156] ppid=21093 vsize=558504 CPUtime=188.91
/proc/21094/task/21156/stat : 21156 (pb_cplex) R 21093 21093 20664 0 -1 4202560 300653 0 0 0 18822 69 0 0 19 0 8 0 146842477 571908096 109492 4089446400 134512640 146736320 4287773648 18446744073709551615 135962010 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1800.49
Current children cumulated vsize (KiB) 567204

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21093 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1800.49
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 533.825
CPU time (s): 1800.49
CPU user time (s): 1793.49
CPU system time (s): 7
CPU usage (%): 337.281
Max. virtual memory (cumulated for all children) (KiB): 594812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 11

runsolver used 0.85187 second user time and 2.09268 second system time

The end

Launcher Data 

Begin job on node130 at 2010-07-02 09:22:08
IDJOB=2697386
IDBENCH=79004
IDSOLVER=1210
FILE ID=node130/2697386-1278055328
PBS_JOBID= 11198922
Free space on /tmp= 74168 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/web/uclid_pb_benchmarks/normalized-dlx1c.rwmem.ucl--soft-66-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697386-1278055328/watcher-2697386-1278055328 -o /tmp/evaluation-result-2697386-1278055328/solver-2697386-1278055328 -C 1800 -W 2000 -M 3800  run HOME/instance-2697386-1278055328.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 912ca607d723e7995f4e9e6209c25e32
RANDOM SEED=1244874401

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.72
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.796
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5237.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31276368 kB
Buffers:        223572 kB
Cached:        1176760 kB
SwapCached:          0 kB
Active:         694376 kB
Inactive:       830940 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31276368 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           17128 kB
Writeback:           0 kB
AnonPages:      125020 kB
Mapped:          19300 kB
Slab:            82784 kB
PageTables:       5276 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   342360 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74152 MiB
End job on node130 at 2010-07-02 09:31:04