Trace number 3697745

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver inc-topDown? (TO) 1800.03 1800.81

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Base/
normalized-minisat70_4_22_7.opb
MD5SUMb79cf832cc8fb39cc9e05c792def1a32
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark4636291
Best CPU time to get the best result obtained on this benchmark1800.13
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9940
Total number of constraints14846
Number of constraints which are clauses140
Number of constraints which are cardinality constraints (but not clauses)6
Number of constraints which are nor clauses,nor cardinality constraints14700
Minimum length of a constraint2
Maximum length of a constraint2415
Number of terms in the objective function 9730
Biggest coefficient in the objective function 134217728
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 95222180678
Number of bits of the sum of numbers in the objective function 37
Biggest number in a constraint 134217728
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 95222180678
Number of bits of the biggest sum of numbers37
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.35	c run inc solver
0.00/0.35	c [INC SYSTEM] run initial solver
0.00/0.35	c [INC SYSTEM] preprocess with white file
2.37/2.47	c [INC SYSTEM] finished preprocessing in 2 s
2.37/2.47	c [INC SYSTEM] execute solver
3.76/3.87	c [INC SEARCH] formula is SAT
3.76/3.88	c [INC SYSTEM] solved the initial formula
3.86/3.91	c model valid
3.86/3.91	c current solution ok
4.77/5.15	o 225165407
4.77/5.15	c [INC SYSTEM] there exists a inc, kill it!
4.77/5.15	c write failed with 2
4.77/5.16	c [INC SEARCH] iteration: 0
4.77/5.16	c [INC BOUNDS] best value:225165477 search for 225165476
4.77/5.16	c [INC SYSTEM] create new solver instance
4.77/5.16	c [INC] encode full formula
4.77/5.16	c fallback to adder encoding
6.26/6.66	c set iterative enc to: adder
6.26/6.66	c set iterative enc to: none
6.46/6.86	c [INC SEARCH] isOptimum variable: 0
15.15/15.56	c formula is SAT
15.25/15.61	c [INC SEARCH] copied best model
15.25/15.61	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
15.25/15.64	c model valid
15.25/15.64	c current solution ok
15.25/15.64	o 185094601
15.25/15.64	c [INC SEARCH] iteration: 1
15.25/15.64	c [INC BOUNDS] best value:185094671 search for 185094670
15.25/15.64	c [INC SYSTEM] there exists a inc, kill it!
15.25/15.64	c write failed with 2
15.25/15.66	c [INC SYSTEM] create new solver instance
15.25/15.66	c [INC] encode full formula
15.25/15.66	c fallback to adder encoding
16.75/17.17	c set iterative enc to: adder
16.75/17.17	c set iterative enc to: none
16.94/17.38	c [INC SEARCH] isOptimum variable: 0
26.74/27.11	c formula is SAT
26.74/27.16	c [INC SEARCH] copied best model
26.74/27.16	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
26.74/27.19	c model valid
26.74/27.19	c current solution ok
26.74/27.19	o 66951099
26.74/27.19	c [INC SEARCH] iteration: 2
26.74/27.19	c [INC BOUNDS] best value:66951169 search for 66951168
26.74/27.19	c [INC SYSTEM] there exists a inc, kill it!
26.74/27.19	c write failed with 2
26.85/27.21	c [INC SYSTEM] create new solver instance
26.85/27.21	c [INC] encode full formula
26.85/27.21	c fallback to adder encoding
28.26/28.64	c set iterative enc to: adder
28.26/28.64	c set iterative enc to: none
28.46/28.86	c [INC SEARCH] isOptimum variable: 0
43.06/43.49	c formula is SAT
43.16/43.54	c [INC SEARCH] copied best model
43.16/43.54	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
43.16/43.57	c model valid
43.16/43.57	c current solution ok
43.16/43.57	o 60167575
43.16/43.57	c [INC SEARCH] iteration: 3
43.16/43.57	c [INC BOUNDS] best value:60167645 search for 60167644
43.16/43.57	c [INC SYSTEM] there exists a inc, kill it!
43.16/43.57	c write failed with 2
43.16/43.59	c [INC SYSTEM] create new solver instance
43.16/43.59	c [INC] encode full formula
43.16/43.59	c fallback to adder encoding
44.68/45.01	c set iterative enc to: adder
44.68/45.01	c set iterative enc to: none
44.88/45.23	c [INC SEARCH] isOptimum variable: 0
91.06/91.49	c formula is SAT
91.18/91.54	c [INC SEARCH] copied best model
91.18/91.54	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
91.18/91.57	c model valid
91.18/91.57	c current solution ok
91.18/91.57	o 55913201
91.18/91.57	c [INC SEARCH] iteration: 4
91.18/91.57	c [INC BOUNDS] best value:55913271 search for 55913270
91.18/91.57	c [INC SYSTEM] there exists a inc, kill it!
91.18/91.57	c write failed with 2
91.18/91.59	c [INC SYSTEM] create new solver instance
91.18/91.59	c [INC] encode full formula
91.18/91.59	c fallback to adder encoding
92.69/93.00	c set iterative enc to: adder
92.69/93.00	c set iterative enc to: none
92.89/93.21	c [INC SEARCH] isOptimum variable: 0
124.19/124.55	c formula is SAT
124.19/124.59	c [INC SEARCH] copied best model
124.19/124.59	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
124.30/124.63	c model valid
124.30/124.63	c current solution ok
124.30/124.63	o 51489827
124.30/124.63	c [INC SEARCH] iteration: 5
124.30/124.63	c [INC BOUNDS] best value:51489897 search for 51489896
124.30/124.63	c [INC SYSTEM] there exists a inc, kill it!
124.30/124.63	c write failed with 2
124.30/124.65	c [INC SYSTEM] create new solver instance
124.30/124.65	c [INC] encode full formula
124.30/124.65	c fallback to adder encoding
125.69/126.05	c set iterative enc to: adder
125.69/126.05	c set iterative enc to: none
125.90/126.25	c [INC SEARCH] isOptimum variable: 0
139.90/140.28	c formula is SAT
140.00/140.32	c [INC SEARCH] copied best model
140.00/140.32	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
140.00/140.36	c model valid
140.00/140.36	c current solution ok
140.00/140.36	o 37759513
140.00/140.36	c [INC SEARCH] iteration: 6
140.00/140.36	c [INC BOUNDS] best value:37759583 search for 37759582
140.00/140.36	c [INC SYSTEM] there exists a inc, kill it!
140.00/140.36	c write failed with 2
140.00/140.37	c [INC SYSTEM] create new solver instance
140.00/140.37	c [INC] encode full formula
140.00/140.37	c fallback to adder encoding
141.41/141.71	c set iterative enc to: adder
141.41/141.71	c set iterative enc to: none
141.60/141.91	c [INC SEARCH] isOptimum variable: 0
202.79/203.15	c formula is SAT
202.79/203.19	c [INC SEARCH] copied best model
202.79/203.20	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
202.90/203.23	c model valid
202.90/203.23	c current solution ok
202.90/203.23	o 37473939
202.90/203.23	c [INC SEARCH] iteration: 7
202.90/203.23	c [INC BOUNDS] best value:37474009 search for 37474008
202.90/203.23	c [INC SYSTEM] there exists a inc, kill it!
202.90/203.23	c write failed with 2
202.90/203.25	c [INC SYSTEM] create new solver instance
202.90/203.25	c [INC] encode full formula
202.90/203.25	c fallback to adder encoding
204.22/204.58	c set iterative enc to: adder
204.22/204.58	c set iterative enc to: none
204.42/204.78	c [INC SEARCH] isOptimum variable: 0
225.81/226.11	c formula is SAT
225.81/226.15	c [INC SEARCH] copied best model
225.81/226.15	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
225.81/226.19	c model valid
225.81/226.19	c current solution ok
225.81/226.19	o 15623391
225.81/226.19	c [INC SEARCH] iteration: 8
225.81/226.19	c [INC BOUNDS] best value:15623461 search for 15623460
225.81/226.19	c [INC SYSTEM] there exists a inc, kill it!
225.81/226.19	c write failed with 2
225.92/226.20	c [INC SYSTEM] create new solver instance
225.92/226.20	c [INC] encode full formula
225.92/226.20	c fallback to adder encoding
226.93/227.28	c set iterative enc to: adder
226.93/227.28	c set iterative enc to: none
227.12/227.45	c [INC SEARCH] isOptimum variable: 0
534.29/534.70	c formula is SAT
534.29/534.74	c [INC SEARCH] copied best model
534.29/534.74	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
534.29/534.77	c model valid
534.29/534.77	c current solution ok
534.29/534.77	o 14655869
534.29/534.77	c [INC SEARCH] iteration: 9
534.29/534.77	c [INC BOUNDS] best value:14655939 search for 14655938
534.29/534.77	c [INC SYSTEM] there exists a inc, kill it!
534.29/534.77	c write failed with 2
534.29/534.78	c [INC SYSTEM] create new solver instance
534.29/534.78	c [INC] encode full formula
534.29/534.78	c fallback to adder encoding
535.40/535.86	c set iterative enc to: adder
535.40/535.86	c set iterative enc to: none
535.61/536.02	c [INC SEARCH] isOptimum variable: 0
641.90/642.33	c formula is SAT
641.90/642.37	c [INC SEARCH] copied best model
641.90/642.37	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
642.00/642.40	c model valid
642.00/642.40	c current solution ok
642.00/642.40	o 14390803
642.00/642.40	c [INC SEARCH] iteration: 10
642.00/642.40	c [INC BOUNDS] best value:14390873 search for 14390872
642.00/642.40	c [INC SYSTEM] there exists a inc, kill it!
642.00/642.40	c write failed with 2
642.00/642.42	c [INC SYSTEM] create new solver instance
642.00/642.42	c [INC] encode full formula
642.00/642.42	c fallback to adder encoding
643.01/643.49	c set iterative enc to: adder
643.01/643.49	c set iterative enc to: none
643.20/643.65	c [INC SEARCH] isOptimum variable: 0
868.12/868.67	c formula is SAT
868.24/868.71	c [INC SEARCH] copied best model
868.24/868.71	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
868.24/868.74	c model valid
868.24/868.74	c current solution ok
868.24/868.74	o 13895865
868.24/868.74	c [INC SEARCH] iteration: 11
868.24/868.74	c [INC BOUNDS] best value:13895935 search for 13895934
868.24/868.74	c [INC SYSTEM] there exists a inc, kill it!
868.24/868.74	c write failed with 2
868.24/868.75	c [INC SYSTEM] create new solver instance
868.24/868.75	c [INC] encode full formula
868.24/868.75	c fallback to adder encoding
869.34/869.81	c set iterative enc to: adder
869.34/869.81	c set iterative enc to: none
869.44/869.98	c [INC SEARCH] isOptimum variable: 0
886.23/886.75	c formula is SAT
886.23/886.78	c [INC SEARCH] copied best model
886.23/886.78	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
886.34/886.81	c model valid
886.34/886.81	c current solution ok
886.34/886.81	o 13416807
886.34/886.81	c [INC SEARCH] iteration: 12
886.34/886.81	c [INC BOUNDS] best value:13416877 search for 13416876
886.34/886.81	c [INC SYSTEM] there exists a inc, kill it!
886.34/886.81	c write failed with 2
886.34/886.83	c [INC SYSTEM] create new solver instance
886.34/886.83	c [INC] encode full formula
886.34/886.83	c fallback to adder encoding
887.35/887.88	c set iterative enc to: adder
887.35/887.88	c set iterative enc to: none
887.54/888.04	c [INC SEARCH] isOptimum variable: 0
914.11/914.66	c formula is SAT
914.11/914.69	c [INC SEARCH] copied best model
914.11/914.69	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
914.22/914.73	c model valid
914.22/914.73	c current solution ok
914.22/914.73	o 13045945
914.22/914.73	c [INC SEARCH] iteration: 13
914.22/914.73	c [INC BOUNDS] best value:13046015 search for 13046014
914.22/914.73	c [INC SYSTEM] there exists a inc, kill it!
914.22/914.73	c write failed with 2
914.22/914.74	c [INC SYSTEM] create new solver instance
914.22/914.74	c [INC] encode full formula
914.22/914.74	c fallback to adder encoding
915.24/915.75	c set iterative enc to: adder
915.24/915.75	c set iterative enc to: none
915.44/915.90	c [INC SEARCH] isOptimum variable: 0
1060.29/1060.89	c formula is SAT
1060.39/1060.93	c [INC SEARCH] copied best model
1060.39/1060.93	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
1060.39/1060.96	c model valid
1060.39/1060.96	c current solution ok
1060.39/1060.96	o 12782615
1060.39/1060.96	c [INC SEARCH] iteration: 14
1060.39/1060.96	c [INC BOUNDS] best value:12782685 search for 12782684
1060.39/1060.96	c [INC SYSTEM] there exists a inc, kill it!
1060.39/1060.96	c write failed with 2
1060.39/1060.97	c [INC SYSTEM] create new solver instance
1060.39/1060.97	c [INC] encode full formula
1060.39/1060.97	c fallback to adder encoding
1061.38/1061.97	c set iterative enc to: adder
1061.38/1061.97	c set iterative enc to: none
1061.59/1062.12	c [INC SEARCH] isOptimum variable: 0
1105.95/1106.58	c formula is SAT
1106.07/1106.61	c [INC SEARCH] copied best model
1106.07/1106.61	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
1106.07/1106.64	c model valid
1106.07/1106.64	c current solution ok
1106.07/1106.64	o 11532243
1106.07/1106.64	c [INC SEARCH] iteration: 15
1106.07/1106.64	c [INC BOUNDS] best value:11532313 search for 11532312
1106.07/1106.64	c [INC SYSTEM] there exists a inc, kill it!
1106.07/1106.64	c write failed with 2
1106.07/1106.65	c [INC SYSTEM] create new solver instance
1106.07/1106.65	c [INC] encode full formula
1106.07/1106.65	c fallback to adder encoding
1107.07/1107.62	c set iterative enc to: adder
1107.07/1107.62	c set iterative enc to: none
1107.17/1107.77	c [INC SEARCH] isOptimum variable: 0
1255.50/1256.15	c formula is SAT
1255.50/1256.19	c [INC SEARCH] copied best model
1255.50/1256.19	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
1255.61/1256.22	c model valid
1255.61/1256.22	c current solution ok
1255.61/1256.22	o 10250203
1255.61/1256.22	c [INC SEARCH] iteration: 16
1255.61/1256.22	c [INC BOUNDS] best value:10250273 search for 10250272
1255.61/1256.22	c [INC SYSTEM] there exists a inc, kill it!
1255.61/1256.22	c write failed with 2
1255.61/1256.23	c [INC SYSTEM] create new solver instance
1255.61/1256.23	c [INC] encode full formula
1255.61/1256.23	c fallback to adder encoding
1256.53/1257.16	c set iterative enc to: adder
1256.53/1257.16	c set iterative enc to: none
1256.73/1257.31	c [INC SEARCH] isOptimum variable: 0
1394.17/1394.81	c formula is SAT
1394.17/1394.84	c [INC SEARCH] copied best model
1394.17/1394.84	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
1394.17/1394.87	c model valid
1394.17/1394.87	c current solution ok
1394.17/1394.87	o 9119247
1394.17/1394.87	c [INC SEARCH] iteration: 17
1394.17/1394.87	c [INC BOUNDS] best value:9119317 search for 9119316
1394.17/1394.87	c [INC SYSTEM] there exists a inc, kill it!
1394.17/1394.87	c write failed with 2
1394.17/1394.88	c [INC SYSTEM] create new solver instance
1394.17/1394.88	c [INC] encode full formula
1394.17/1394.88	c fallback to adder encoding
1395.07/1395.80	c set iterative enc to: adder
1395.07/1395.80	c set iterative enc to: none
1395.27/1395.94	c [INC SEARCH] isOptimum variable: 0
1746.45/1747.26	c formula is SAT
1746.45/1747.29	c [INC SEARCH] copied best model
1746.45/1747.30	c [INC SEARCH] sat variable: 1 optimum/unsat variable: 0
1746.56/1747.33	c model valid
1746.56/1747.33	c current solution ok
1746.56/1747.33	o 8299747
1746.56/1747.33	c [INC SEARCH] iteration: 18
1746.56/1747.33	c [INC BOUNDS] best value:8299817 search for 8299816
1746.56/1747.33	c [INC SYSTEM] there exists a inc, kill it!
1746.56/1747.33	c write failed with 2
1746.56/1747.33	c [INC SYSTEM] create new solver instance
1746.56/1747.33	c [INC] encode full formula
1746.56/1747.33	c fallback to adder encoding
1747.48/1748.20	c set iterative enc to: adder
1747.48/1748.20	c set iterative enc to: none
1747.56/1748.34	c [INC SEARCH] isOptimum variable: 0
1800.03/1800.81	HOME/npSolver-pbo-Itd.sh: line 18: 16129 Terminated              ./npSolver-pbo $file $tmp -rnd_seed=$seed -useQuickBound=0 -useBinSearch=0 -useCP2=1 -useInc=1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3697745-1338134480/watcher-3697745-1338134480 -o /tmp/evaluation-result-3697745-1338134480/solver-3697745-1338134480 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-Itd.sh HOME/instance-3697745-1338134480.opb 1426894276 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16128
/proc/meminfo: memFree=28784360/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0

[startup+0.0583439 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16128
/proc/meminfo: memFree=28784360/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100311 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16128
/proc/meminfo: memFree=28784360/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300321 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16128
/proc/meminfo: memFree=28784360/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700337 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 16128
/proc/meminfo: memFree=28784360/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50037 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 16132
/proc/meminfo: memFree=28615900/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=30344 CPUtime=0.35 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 6018 0 0 0 31 4 0 0 20 0 1 0 279573030 31072256 6506 33554432000 4194304 5992684 140735202564176 140735202558624 5175646 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/16129/statm: 7586 6506 172 440 0 7142 0
[pid=16131] ppid=16129 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16131/stat : 16131 (cp2_pre.sh) S 16129 16128 14200 0 -1 4202496 609 0 0 0 0 0 0 0 20 0 1 0 279573067 9367552 277 33554432000 4194304 5064252 140736947664944 140736947663648 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/16131/statm: 2287 277 234 213 0 72 0
[pid=16132] ppid=16131 vsize=165088 CPUtime=1.12 cores=0,2,4,6
/proc/16132/stat : 16132 (coprocessor) R 16131 16128 14200 0 -1 4202496 28636 0 0 0 107 5 0 0 20 0 1 0 279573067 169050112 40159 33554432000 4194304 6586260 140733644845264 140733644841288 4691883 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/16132/statm: 41272 40159 184 584 0 40684 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 213728

[startup+3.10031 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 16132
/proc/meminfo: memFree=28558076/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=30344 CPUtime=2.44 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 6034 34295 0 0 31 4 183 26 20 0 1 0 279573030 31072256 6508 33554432000 4194304 5992684 140735202564176 140735202550440 5179600 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 0 0 0
/proc/16129/statm: 7586 6508 174 440 0 7142 0
Current children cumulated CPU time (s) 2.44
Current children cumulated vsize (KiB) 39492
heavy processes:

[startup+6.30035 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 16135
/proc/meminfo: memFree=28686396/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=191508 CPUtime=5.95 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) R 16128 16128 14200 0 -1 4202496 12761 50782 0 0 160 83 320 32 20 0 1 0 279573030 196104192 33232 33554432000 4194304 5992684 140735202564176 140735202556568 4568047 0 0 4096 0 0 0 0 17 2 0 0 10 0 0
/proc/16129/statm: 47877 33232 190 440 0 47433 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 200656

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.00 3/182 16137
/proc/meminfo: memFree=28288460/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=60436 CPUtime=6.52 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 13522 51300 0 0 199 99 320 34 20 0 1 0 279573030 61886464 14051 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 10 0 0
/proc/16129/statm: 15109 14051 191 440 0 14665 0
[pid=16137] ppid=16129 vsize=351052 CPUtime=5.83 cores=0,2,4,6
/proc/16137/stat : 16137 (glucosInc) R 16129 16128 14200 0 -1 4202496 57935 0 0 0 569 14 0 0 20 0 1 0 279573716 359477248 77404 33554432000 4194304 5654031 140734849471520 140734849459336 4232752 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/16137/statm: 87763 77404 141 357 0 87403 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 420636

[startup+25.5004 s]
/proc/loadavg: 2.07 2.02 2.00 3/182 16139
/proc/meminfo: memFree=28296572/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=51880 CPUtime=17.04 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 20814 110112 0 0 357 118 1175 54 20 0 1 0 279573030 53125120 11914 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 10 0 0
/proc/16129/statm: 12970 11914 191 440 0 12526 0
[pid=16139] ppid=16129 vsize=350336 CPUtime=8.09 cores=0,2,4,6
/proc/16139/stat : 16139 (glucosInc) R 16129 16128 14200 0 -1 4202496 58090 0 0 0 795 14 0 0 20 0 1 0 279574769 358744064 77829 33554432000 4194304 5654031 140733988020288 140733988018072 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16139/statm: 87584 77829 141 357 0 87224 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 411364

[startup+51.1004 s]
/proc/loadavg: 2.05 2.02 2.00 3/181 16143
/proc/meminfo: memFree=28317380/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=50732 CPUtime=44.91 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 37429 225655 0 0 659 157 3577 98 20 0 1 0 279573030 51949568 11627 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 10 0 0
/proc/16129/statm: 12683 11627 191 440 0 12239 0
[pid=16143] ppid=16129 vsize=341672 CPUtime=5.86 cores=0,2,4,6
/proc/16143/stat : 16143 (glucosInc) R 16129 16128 14200 0 -1 4202496 53909 0 0 0 572 14 0 0 20 0 1 0 279577553 349872128 72428 33554432000 4194304 5654031 140733492181392 140733492169208 4232821 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16143/statm: 85418 72428 140 357 0 85058 0
Current children cumulated CPU time (s) 50.77
Current children cumulated vsize (KiB) 401552

[startup+102.307 s]
/proc/loadavg: 2.09 2.03 2.00 3/181 16147
/proc/meminfo: memFree=28339504/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=50640 CPUtime=92.91 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 45777 282688 0 0 808 177 8184 122 20 0 1 0 279573030 51855360 11604 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 10 0 0
/proc/16129/statm: 12660 11604 191 440 0 12216 0
[pid=16147] ppid=16129 vsize=342536 CPUtime=9.08 cores=0,2,4,6
/proc/16147/stat : 16147 (glucosInc) R 16129 16128 14200 0 -1 4202496 54331 0 0 0 896 12 0 0 20 0 1 0 279582352 350756864 71656 33554432000 4194304 5654031 140734188066768 140734188064376 4232887 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16147/statm: 85634 71656 140 357 0 85274 0
Current children cumulated CPU time (s) 101.99
Current children cumulated vsize (KiB) 402324

[startup+162.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/181 16151
/proc/meminfo: memFree=28339316/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=50068 CPUtime=141.62 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 62868 398271 0 0 1098 214 12683 167 20 0 1 0 279573030 51269632 11461 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 10 0 0
/proc/16129/statm: 12517 11461 191 440 0 12073 0
[pid=16151] ppid=16129 vsize=329960 CPUtime=20.36 cores=0,2,4,6
/proc/16151/stat : 16151 (glucosInc) R 16129 16128 14200 0 -1 4202496 52840 0 0 0 2017 19 0 0 20 0 1 0 279587222 337879040 72674 33554432000 4194304 5654031 140736497415232 140736497413016 4215009 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16151/statm: 82490 72674 140 357 0 82130 0
Current children cumulated CPU time (s) 161.98
Current children cumulated vsize (KiB) 389176

[startup+222.3 s]
/proc/loadavg: 2.08 2.03 2.00 3/181 16153
/proc/meminfo: memFree=28347916/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=49880 CPUtime=204.5 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 71285 454349 0 0 1239 233 18782 196 20 0 1 0 279573030 51077120 11414 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 10 0 0
/proc/16129/statm: 12470 11414 191 440 0 12026 0
[pid=16153] ppid=16129 vsize=329704 CPUtime=17.51 cores=0,2,4,6
/proc/16153/stat : 16153 (glucosInc) R 16129 16128 14200 0 -1 4202496 53171 0 0 0 1735 16 0 0 20 0 1 0 279593508 337616896 67272 33554432000 4194304 5654031 140735796005648 140735795993464 4232707 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16153/statm: 82426 67272 141 357 0 82066 0
Current children cumulated CPU time (s) 222.01
Current children cumulated vsize (KiB) 388732

[startup+282.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/181 16155
/proc/meminfo: memFree=28373156/32873844 swapFree=7116/7116

################
# More data... #
################

/proc/loadavg: 2.00 2.00 2.00 3/181 16227
/proc/meminfo: memFree=28637012/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46928 CPUtime=1256.74 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 138785 913645 0 0 2221 364 122672 417 20 0 1 0 279573030 48054272 10676 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 10 0 0
/proc/16129/statm: 11732 10676 191 440 0 11288 0
[pid=16227] ppid=16129 vsize=239004 CPUtime=44.93 cores=0,2,4,6
/proc/16227/stat : 16227 (glucosInc) R 16129 16128 14200 0 -1 4202496 43896 0 0 0 4483 10 0 0 20 0 1 0 279698762 244740096 56328 33554432000 4194304 5654031 140734987575584 140734987563400 4232775 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16227/statm: 59751 56328 142 357 0 59391 0
Current children cumulated CPU time (s) 1301.67
Current children cumulated vsize (KiB) 295080

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16227
/proc/meminfo: memFree=28601960/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46928 CPUtime=1256.74 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 138785 913645 0 0 2221 364 122672 417 20 0 1 0 279573030 48054272 10676 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 10 0 0
/proc/16129/statm: 11732 10676 191 440 0 11288 0
[pid=16227] ppid=16129 vsize=323272 CPUtime=104.89 cores=0,2,4,6
/proc/16227/stat : 16227 (glucosInc) R 16129 16128 14200 0 -1 4202496 47732 0 0 0 10473 16 0 0 20 0 1 0 279698762 331030528 65871 33554432000 4194304 5654031 140734987575584 140734987573672 4216213 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/16227/statm: 80818 65871 142 357 0 80458 0
Current children cumulated CPU time (s) 1361.63
Current children cumulated vsize (KiB) 379348

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16229
/proc/meminfo: memFree=28646516/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=235776 CPUtime=26.35 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 43628 0 0 0 2624 11 0 0 20 0 1 0 279712624 241434624 54239 33554432000 4194304 5654031 140733448658896 140733448646712 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 58944 54239 141 357 0 58584 0
Current children cumulated CPU time (s) 1421.66
Current children cumulated vsize (KiB) 291704

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16229
/proc/meminfo: memFree=28629452/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=269192 CPUtime=86.33 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 44880 0 0 0 8621 12 0 0 20 0 1 0 279712624 275652608 58555 33554432000 4194304 5654031 140733448658896 140733448646712 4208595 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 67298 58555 142 357 0 66938 0
Current children cumulated CPU time (s) 1481.64
Current children cumulated vsize (KiB) 325120

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16230
/proc/meminfo: memFree=28632824/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=271368 CPUtime=146.3 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 47873 0 0 0 14614 16 0 0 20 0 1 0 279712624 277880832 57694 33554432000 4194304 5654031 140733448658896 140733448646712 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 67842 57694 142 357 0 67482 0
Current children cumulated CPU time (s) 1541.61
Current children cumulated vsize (KiB) 327296

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16230
/proc/meminfo: memFree=28631704/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=247684 CPUtime=206.27 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 53211 0 0 0 20605 22 0 0 20 0 1 0 279712624 253628416 57903 33554432000 4194304 5654031 140733448658896 140733448646712 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 61921 57903 142 357 0 61561 0
Current children cumulated CPU time (s) 1601.58
Current children cumulated vsize (KiB) 303612

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16230
/proc/meminfo: memFree=28625148/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=278504 CPUtime=266.25 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 54145 0 0 0 26600 25 0 0 20 0 1 0 279712624 285188096 60257 33554432000 4194304 5654031 140733448658896 140733448646712 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 69626 60257 142 357 0 69266 0
Current children cumulated CPU time (s) 1661.56
Current children cumulated vsize (KiB) 334432

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/182 16233
/proc/meminfo: memFree=28612276/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46780 CPUtime=1395.31 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 145659 964386 0 0 2322 377 136392 440 20 0 1 0 279573030 47902720 10639 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11695 10639 191 440 0 11251 0
[pid=16229] ppid=16129 vsize=279836 CPUtime=326.24 cores=0,2,4,6
/proc/16229/stat : 16229 (glucosInc) R 16129 16128 14200 0 -1 4202496 55928 0 0 0 32597 27 0 0 20 0 1 0 279712624 286552064 63329 33554432000 4194304 5654031 140733448658896 140733448656984 4232755 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16229/statm: 69959 63329 142 357 0 69599 0
Current children cumulated CPU time (s) 1721.55
Current children cumulated vsize (KiB) 335764

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16235
/proc/meminfo: memFree=28653368/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46296 CPUtime=1747.61 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 152406 1021556 0 0 2415 389 171484 473 20 0 1 0 279573030 47407104 10518 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11574 10518 191 440 0 11130 0
[pid=16235] ppid=16129 vsize=265004 CPUtime=33.93 cores=0,2,4,6
/proc/16235/stat : 16235 (glucosInc) R 16129 16128 14200 0 -1 4202496 42735 0 0 0 3382 11 0 0 20 0 1 0 279747865 271364096 55323 33554432000 4194304 5654031 140736683760256 140736683748072 4232932 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16235/statm: 66251 55323 141 357 0 65891 0
Current children cumulated CPU time (s) 1781.54
Current children cumulated vsize (KiB) 320448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.8 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 16235
/proc/meminfo: memFree=28649392/32873844 swapFree=7116/7116
[pid=16128] ppid=16126 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/16128/stat : 16128 (npSolver-pbo-It) S 16126 16128 14200 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 279573030 9367552 275 33554432000 4194304 5064252 140734634948288 140734634947200 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/16128/statm: 2287 275 233 213 0 72 0
[pid=16129] ppid=16128 vsize=46296 CPUtime=1747.61 cores=0,2,4,6
/proc/16129/stat : 16129 (npSolver-pbo) S 16128 16128 14200 0 -1 4202496 152406 1021556 0 0 2415 389 171484 473 20 0 1 0 279573030 47407104 10518 33554432000 4194304 5992684 140735202564176 140735202550008 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 10 0 0
/proc/16129/statm: 11574 10518 191 440 0 11130 0
[pid=16235] ppid=16129 vsize=237420 CPUtime=52.42 cores=0,2,4,6
/proc/16235/stat : 16235 (glucosInc) R 16129 16128 14200 0 -1 4202496 43674 0 0 0 5230 12 0 0 20 0 1 0 279747865 243118080 53933 33554432000 4194304 5654031 140736683760256 140736683748072 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/16235/statm: 59355 53933 141 357 0 58995 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 292864

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16128 and gives
#  childrusage.ru_utime.tv_sec=1739
#  childrusage.ru_utime.tv_usec=631
#  childrusage.ru_stime.tv_sec=8
#  childrusage.ru_stime.tv_usec=628688
# CPU time returned by wait4() is 1747.63
# while last known CPU time is 1800.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.81
CPU time (s): 1800.03
CPU user time (s): 1791.29
CPU system time (s): 8.74
CPU usage (%): 99.9564
Max. virtual memory (cumulated for all children) (KiB): 540336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1739
system time used= 8.62869
maximum resident set size= 404068
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1174336
page faults= 0
swaps= 0
block input operations= 0
block output operations= 3448264
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22714
involuntary context switches= 2281

runsolver used 4.13237 second user time and 8.33773 second system time

The end

Launcher Data 

Begin job on node138 at 2012-05-27 18:01:20
IDJOB=3697745
IDBENCH=92758
IDSOLVER=2275
FILE ID=node138/3697745-1338134480
RUNJOBID= node138-1338124125-14216
PBS_JOBID= 14624507
Free space on /tmp= 71400 MiB

SOLVER NAME= npSolver inc-topDown
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Base/normalized-minisat70_4_22_7.opb
COMMAND LINE= DIR/npSolver-pbo-Itd.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3697745-1338134480/watcher-3697745-1338134480 -o /tmp/evaluation-result-3697745-1338134480/solver-3697745-1338134480 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-Itd.sh HOME/instance-3697745-1338134480.opb 1426894276 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b79cf832cc8fb39cc9e05c792def1a32
RANDOM SEED=1426894276

node138.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28784996 kB
Buffers:          420644 kB
Cached:          2497068 kB
SwapCached:          212 kB
Active:          1273424 kB
Inactive:        1941096 kB
Active(anon):     287452 kB
Inactive(anon):    11368 kB
Active(file):     985972 kB
Inactive(file):  1929728 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67108644 kB
Dirty:              8976 kB
Writeback:             0 kB
AnonPages:        424440 kB
Mapped:            15812 kB
Shmem:               200 kB
Slab:             732000 kB
SReclaimable:     174532 kB
SUnreclaim:       557468 kB
KernelStack:        1512 kB
PageTables:         4860 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     449808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    292864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71388 MiB
End job on node138 at 2012-05-27 18:31:20