Trace number 2697601

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.05 551.124

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/
normalized-j605_10-unsat--soft-33-100-0.wbo
MD5SUM511a250f181b5f88452d86a600065d28
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMSAT
Best cost obtained on this benchmark1902
Best CPU time to get the best result obtained on this benchmark1800.35
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables9638
Total number of constraints30220
Number of soft constraints20091
Number of constraints which are clauses29908
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints312
Minimum length of a constraint1
Maximum length of a constraint38
Top cost 1014619
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 1014618
Biggest number in a constraint 20
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 254
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697601-1278055436.wbo.
0.00/0.00	c Instance file HOME/instance-2697601-1278055436.wbo
0.00/0.00	c File size is 966558 bytes.
83.97/85.85	c Highest Coefficient sum: 254
83.97/85.85	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
83.97/85.89	c ============================[ Problem Statistics ]=============================
83.97/85.89	c |                                                                             |
83.97/85.89	c |  Parsing time:          84.04        s                                      |
83.97/85.89	c |  Number Variables:      29729                                               |
83.97/85.89	c |  Number Constraints:    30221                                               |
83.97/85.89	c ===============================================================================
1800.05/551.11	c Remaining time 1715.95 sec.
1800.05/551.11	c 
1800.05/551.11	c *** INTERRUPTED ***
1800.05/551.11	s UNKNOWN
1800.05/551.11	c Total CPU time              : 1797.46 s
1800.05/551.11	c Memory used           : 574.22 MB
1800.05/551.11	c CPU time              : 1797.46 s
1800.05/551.11	c 
1800.05/551.11	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697601-1278055436/watcher-2697601-1278055436 -o /tmp/evaluation-result-2697601-1278055436/solver-2697601-1278055436 -C 1800 -W 2000 -M 3800 run HOME/instance-2697601-1278055436.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.09 6.71 3.84 4/186 22977
/proc/meminfo: memFree=30769948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0

[startup+0.052488 s]
/proc/loadavg: 5.09 6.71 3.84 4/186 22977
/proc/meminfo: memFree=30769948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100536 s]
/proc/loadavg: 5.09 6.71 3.84 4/186 22977
/proc/meminfo: memFree=30769948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300501 s]
/proc/loadavg: 5.09 6.71 3.84 4/186 22977
/proc/meminfo: memFree=30769948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700368 s]
/proc/loadavg: 5.09 6.71 3.84 4/186 22977
/proc/meminfo: memFree=30769948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50029 s]
/proc/loadavg: 4.84 6.63 3.83 3/188 22979
/proc/meminfo: memFree=30767328/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=15824 CPUtime=1.49
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 944 0 0 0 149 0 0 0 25 0 1 0 146840377 16203776 898 4089446400 134512640 146736320 4287866176 18446744073709551615 140528736 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22978/statm: 3956 898 314 2985 0 654 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 24524

[startup+3.1009 s]
/proc/loadavg: 4.84 6.63 3.83 10/188 22979
/proc/meminfo: memFree=30762108/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=16668 CPUtime=3.09
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1148 0 0 0 309 0 0 0 25 0 1 0 146840377 17068032 1102 4089446400 134512640 146736320 4287866176 18446744073709551615 140679008 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22978/statm: 4167 1102 325 2985 0 865 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 25368

[startup+6.30033 s]
/proc/loadavg: 4.84 6.63 3.83 10/188 22979
/proc/meminfo: memFree=30722676/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=17412 CPUtime=6.29
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1351 0 0 0 629 0 0 0 25 0 1 0 146840377 17829888 1305 4089446400 134512640 146736320 4287866176 18446744073709551615 140526592 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22978/statm: 4353 1305 342 2985 0 1051 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 26112

[startup+12.7002 s]
/proc/loadavg: 5.40 6.69 3.88 9/188 22979
/proc/meminfo: memFree=30717612/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=18780 CPUtime=12.69
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1744 0 0 0 1269 0 0 0 25 0 1 0 146840377 19230720 1665 4089446400 134512640 146736320 4287866176 18446744073709551615 141014053 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22978/statm: 4695 1665 366 2985 0 1393 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 27480

[startup+25.501 s]
/proc/loadavg: 5.17 6.60 3.88 3/188 22980
/proc/meminfo: memFree=30713528/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=20380 CPUtime=25.49
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 2161 0 0 0 2549 0 0 0 25 0 1 0 146840377 20869120 2082 4089446400 134512640 146736320 4287866176 18446744073709551615 140679039 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/22978/statm: 5095 2082 399 2985 0 1793 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 29080

[startup+51.1005 s]
/proc/loadavg: 4.92 6.40 3.90 4/188 22980
/proc/meminfo: memFree=30705948/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=23616 CPUtime=51.09
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 3007 0 0 0 5109 0 0 0 25 0 1 0 146840377 24182784 2863 4089446400 134512640 146736320 4287866176 18446744073709551615 140714090 0 0 4096 16387 0 0 0 17 7 0 0 0
/proc/22978/statm: 5904 2863 450 2985 0 2602 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 32316

[startup+102.306 s]
/proc/loadavg: 3.80 5.91 3.87 3/181 22982
/proc/meminfo: memFree=30775060/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=105076 CPUtime=100.47
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 67050 0 0 0 10040 7 0 0 25 0 1 0 146840377 107597824 16434 4089446400 134512640 146736320 4287866176 18446744073709551615 139046519 0 0 4096 16387 0 0 0 17 2 0 0 0
/proc/22978/statm: 26269 16434 1060 2985 0 22811 0
Current children cumulated CPU time (s) 100.47
Current children cumulated vsize (KiB) 113776

[startup+162.301 s]
/proc/loadavg: 2.66 5.19 3.75 3/181 22983
/proc/meminfo: memFree=30765760/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=109632 CPUtime=160.46
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 198583 0 0 0 16022 24 0 0 25 0 1 0 146840377 112263168 18738 4089446400 134512640 146736320 4287866176 18446744073709551615 135854509 0 0 4096 16387 0 0 0 17 2 0 0 0
/proc/22978/statm: 27408 18738 1057 2985 0 23950 0
Current children cumulated CPU time (s) 160.46
Current children cumulated vsize (KiB) 118332

[startup+222.301 s]
/proc/loadavg: 4.77 5.20 3.83 10/188 23012
/proc/meminfo: memFree=30496020/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=551376 CPUtime=384.36
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 475261 0 0 0 38351 85 0 0 25 0 8 0 146840377 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136008165 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/22978/statm: 137844 86088 1111 2985 0 134386 0
[pid=22978/tid=23006] ppid=22977 vsize=551376 CPUtime=22.94
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 32742 0 0 0 2288 6 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136003493 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=551376 CPUtime=22.94
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 24337 0 0 0 2287 7 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=551376 CPUtime=17.87
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 12866 0 0 0 1785 2 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136008042 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=551376 CPUtime=22.93
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 22456 0 0 0 2288 5 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=551376 CPUtime=17.51
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 28368 0 0 0 1746 5 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136015696 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=551376 CPUtime=22.54
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 23532 0 0 0 2249 5 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=551376 CPUtime=18.02
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 22540 0 0 0 1797 5 0 0 25 0 8 0 146858585 564609024 86088 4089446400 134512640 146736320 4287866176 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 384.36
Current children cumulated vsize (KiB) 560076

[startup+282.301 s]
/proc/loadavg: 7.28 5.77 4.11 11/195 23021
/proc/meminfo: memFree=30395884/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=578928 CPUtime=676.74
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 646968 0 0 0 67552 122 0 0 25 0 8 0 146840377 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 135468697 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/22978/statm: 144732 92396 1126 2985 0 141274 0
[pid=22978/tid=23006] ppid=22977 vsize=578928 CPUtime=69.5
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 68514 0 0 0 6937 13 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=578928 CPUtime=69.4
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 61810 0 0 0 6926 14 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136003522 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=578928 CPUtime=44.28
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 21477 0 0 0 4423 5 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 135526881 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=578928 CPUtime=66.42
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 41852 0 0 0 6631 11 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136008160 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=578928 CPUtime=64.72
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 58118 0 0 0 6459 13 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136470864 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=578928 CPUtime=56.36
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 46630 0 0 0 5627 9 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136008170 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=578928 CPUtime=46.99
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 28253 0 0 0 4693 6 0 0 25 0 8 0 146858585 592822272 92396 4089446400 134512640 146736320 4287866176 18446744073709551615 136476044 0 2 4096 16387 0 0 0 -1 1 0 0 0

################
# More data... #
################

/proc/22978/statm: 146716 94290 1111 2985 0 143258 0
[pid=22978/tid=23006] ppid=22977 vsize=586864 CPUtime=102.5
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 81205 0 0 0 10235 15 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 136008450 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=586864 CPUtime=101.8
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 76214 0 0 0 10163 17 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 136008042 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=586864 CPUtime=74.65
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 43786 0 0 0 7456 9 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 135454198 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=586864 CPUtime=98.99
/proc/22978/task/23009/stat : 23009 (pb_cplex) S 22977 22977 22276 0 -1 4202560 74185 0 0 0 9881 18 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 7 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=586864 CPUtime=99.29
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 87693 0 0 0 9909 20 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 135526874 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=586864 CPUtime=90.37
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 69899 0 0 0 9024 13 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 135854543 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=586864 CPUtime=78.87
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 33709 0 0 0 7880 7 0 0 25 0 8 0 146858585 600948736 94290 4089446400 134512640 146736320 4287866176 18446744073709551615 136008385 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 941.44
Current children cumulated vsize (KiB) 595564

[startup+402.301 s]
/proc/loadavg: 10.05 7.67 5.02 10/195 23025
/proc/meminfo: memFree=30362172/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=584132 CPUtime=1250.99
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1020433 0 0 0 124904 195 0 0 25 0 8 0 146840377 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 139044505 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/22978/statm: 146033 94791 1111 2985 0 142575 0
[pid=22978/tid=23006] ppid=22977 vsize=584132 CPUtime=136.95
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 97560 0 0 0 13677 18 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 136384852 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=584132 CPUtime=154.86
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 111809 0 0 0 15464 22 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=584132 CPUtime=120.51
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 84133 0 0 0 12033 18 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 135999265 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=584132 CPUtime=132.36
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 95390 0 0 0 13214 22 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=584132 CPUtime=138.63
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 119312 0 0 0 13836 27 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 136384852 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=584132 CPUtime=135.06
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 91088 0 0 0 13489 17 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 135854186 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=584132 CPUtime=97.08
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 43363 0 0 0 9699 9 0 0 25 0 8 0 146858585 598151168 94791 4089446400 134512640 146736320 4287866176 18446744073709551615 136008416 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1250.99
Current children cumulated vsize (KiB) 592832

[startup+462.3 s]
/proc/loadavg: 11.73 8.69 5.54 11/196 23029
/proc/meminfo: memFree=30322612/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=597000 CPUtime=1442.95
/proc/22978/stat : 22978 (pb_cplex) S 22977 22977 22276 0 -1 4202496 1131892 0 0 0 144078 217 0 0 25 0 8 0 146840377 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/22978/statm: 149250 95550 1111 2985 0 145792 0
[pid=22978/tid=23006] ppid=22977 vsize=597000 CPUtime=171.21
/proc/22978/task/23006/stat : 23006 (pb_cplex) S 22977 22977 22276 0 -1 4202560 126807 0 0 0 17097 24 0 0 25 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 1 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=597000 CPUtime=176.5
/proc/22978/task/23007/stat : 23007 (pb_cplex) S 22977 22977 22276 0 -1 4202560 123176 0 0 0 17626 24 0 0 18 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 1 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=597000 CPUtime=143.61
/proc/22978/task/23008/stat : 23008 (pb_cplex) S 22977 22977 22276 0 -1 4202560 89967 0 0 0 14342 19 0 0 18 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 7 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=597000 CPUtime=139.87
/proc/22978/task/23009/stat : 23009 (pb_cplex) S 22977 22977 22276 0 -1 4202560 96678 0 0 0 13965 22 0 0 18 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 7 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=597000 CPUtime=149.93
/proc/22978/task/23010/stat : 23010 (pb_cplex) S 22977 22977 22276 0 -1 4202560 126321 0 0 0 14966 27 0 0 18 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 1 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=597000 CPUtime=164.56
/proc/22978/task/23011/stat : 23011 (pb_cplex) S 22977 22977 22276 0 -1 4202560 112151 0 0 0 16435 21 0 0 18 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 144580073 0 2 4096 16387 18446604471145808000 0 0 -1 2 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=597000 CPUtime=136.62
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 74503 0 0 0 13646 16 0 0 25 0 8 0 146858585 611328000 95550 4089446400 134512640 146736320 4287866176 18446744073709551615 136385265 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1442.95
Current children cumulated vsize (KiB) 605700

[startup+522.301 s]
/proc/loadavg: 13.49 9.63 6.06 17/195 23030
/proc/meminfo: memFree=30346184/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=585412 CPUtime=1678.78
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1258603 0 0 0 167631 247 0 0 25 0 8 0 146840377 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136007277 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/22978/statm: 146353 95046 1111 2985 0 142895 0
[pid=22978/tid=23006] ppid=22977 vsize=585412 CPUtime=202.24
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 137471 0 0 0 20198 26 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=585412 CPUtime=203.29
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 144993 0 0 0 20302 27 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=585412 CPUtime=174.96
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 110216 0 0 0 17472 24 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 135999696 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=585412 CPUtime=168.81
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 104167 0 0 0 16855 26 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=585412 CPUtime=174.26
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 147141 0 0 0 17394 32 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136384857 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=585412 CPUtime=191.38
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 131672 0 0 0 19113 25 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 136403408 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=585412 CPUtime=173.97
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 96496 0 0 0 17376 21 0 0 25 0 8 0 146858585 599461888 95046 4089446400 134512640 146736320 4287866176 18446744073709551615 135453262 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1678.78
Current children cumulated vsize (KiB) 594112



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+551.107 s]
/proc/loadavg: 11.66 9.59 6.16 10/195 23032
/proc/meminfo: memFree=30341644/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=589676 CPUtime=1800.05
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1335341 0 0 0 179741 264 0 0 25 0 8 0 146840377 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 137412881 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/22978/statm: 147419 95486 1111 2985 0 143961 0
[pid=22978/tid=23006] ppid=22977 vsize=589676 CPUtime=213.64
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 139395 0 0 0 21337 27 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 135854509 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=589676 CPUtime=226.21
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 162217 0 0 0 22591 30 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=589676 CPUtime=191.15
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 116117 0 0 0 19089 26 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136475862 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=589676 CPUtime=179.42
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 114947 0 0 0 17913 29 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136007216 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=589676 CPUtime=197.23
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 162065 0 0 0 19688 35 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=589676 CPUtime=199.38
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 146984 0 0 0 19909 29 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136002914 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=589676 CPUtime=186.27
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 103911 0 0 0 18604 23 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136475800 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 598376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+551.107 s]
/proc/loadavg: 11.66 9.59 6.16 10/195 23032
/proc/meminfo: memFree=30341644/32950928 swapFree=67111528/67111528
[pid=22977] ppid=22975 vsize=8700 CPUtime=0
/proc/22977/stat : 22977 (run) S 22975 22977 22276 0 -1 4202496 364 0 0 0 0 0 0 0 24 0 1 0 146840377 8908800 249 4089446400 4194304 4922060 140734908393712 18446744073709551615 248089517189 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/22977/statm: 2175 249 208 178 0 68 0
[pid=22978] ppid=22977 vsize=589676 CPUtime=1800.05
/proc/22978/stat : 22978 (pb_cplex) R 22977 22977 22276 0 -1 4202496 1335341 0 0 0 179741 264 0 0 25 0 8 0 146840377 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 137412881 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/22978/statm: 147419 95486 1111 2985 0 143961 0
[pid=22978/tid=23006] ppid=22977 vsize=589676 CPUtime=213.64
/proc/22978/task/23006/stat : 23006 (pb_cplex) R 22977 22977 22276 0 -1 4202560 139395 0 0 0 21337 27 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 135854509 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=22978/tid=23007] ppid=22977 vsize=589676 CPUtime=226.21
/proc/22978/task/23007/stat : 23007 (pb_cplex) R 22977 22977 22276 0 -1 4202560 162217 0 0 0 22591 30 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=22978/tid=23008] ppid=22977 vsize=589676 CPUtime=191.15
/proc/22978/task/23008/stat : 23008 (pb_cplex) R 22977 22977 22276 0 -1 4202560 116117 0 0 0 19089 26 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136475862 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=22978/tid=23009] ppid=22977 vsize=589676 CPUtime=179.42
/proc/22978/task/23009/stat : 23009 (pb_cplex) R 22977 22977 22276 0 -1 4202560 114947 0 0 0 17913 29 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136007216 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=22978/tid=23010] ppid=22977 vsize=589676 CPUtime=197.23
/proc/22978/task/23010/stat : 23010 (pb_cplex) R 22977 22977 22276 0 -1 4202560 162065 0 0 0 19688 35 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=22978/tid=23011] ppid=22977 vsize=589676 CPUtime=199.38
/proc/22978/task/23011/stat : 23011 (pb_cplex) R 22977 22977 22276 0 -1 4202560 146984 0 0 0 19909 29 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136002914 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=22978/tid=23012] ppid=22977 vsize=589676 CPUtime=186.27
/proc/22978/task/23012/stat : 23012 (pb_cplex) R 22977 22977 22276 0 -1 4202560 103911 0 0 0 18604 23 0 0 25 0 8 0 146858585 603828224 95486 4089446400 134512640 146736320 4287866176 18446744073709551615 136475800 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 598376

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22977 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 551.124
CPU time (s): 1800.05
CPU user time (s): 1797.41
CPU system time (s): 2.64
CPU usage (%): 326.614
Max. virtual memory (cumulated for all children) (KiB): 609248

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 364
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1

runsolver used 0.955854 second user time and 2.01369 second system time

The end

Launcher Data 

Begin job on node123 at 2010-07-02 09:23:56
IDJOB=2697601
IDBENCH=79086
IDSOLVER=1210
FILE ID=node123/2697601-1278055436
PBS_JOBID= 11198935
Free space on /tmp= 74140 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/normalized-j605_10-unsat--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697601-1278055436/watcher-2697601-1278055436 -o /tmp/evaluation-result-2697601-1278055436/solver-2697601-1278055436 -C 1800 -W 2000 -M 3800  run HOME/instance-2697601-1278055436.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 511a250f181b5f88452d86a600065d28
RANDOM SEED=366481958

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5294.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.804
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30770608 kB
Buffers:        223744 kB
Cached:        1424452 kB
SwapCached:          0 kB
Active:         966792 kB
Inactive:      1062536 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30770608 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           18564 kB
Writeback:           0 kB
AnonPages:      381124 kB
Mapped:          18784 kB
Slab:            85128 kB
PageTables:       5704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   708140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74124 MiB
End job on node123 at 2010-07-02 09:33:09