Trace number 3695232

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb2satCp2 2012-05-19? (TO) 1800.07 1808.72

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j120opt/
normalized-j1207_6.std.opb
MD5SUMd16d5193341210b17a0f2e49373cb527
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark125
Best CPU time to get the best result obtained on this benchmark1800.02
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints234141
Number of constraints which are clauses232941
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint67
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

3.48/3.54	c model valid
3.48/3.54	c current solution ok
7.68/7.91	o 291
9.96/10.14	c model valid
9.96/10.14	c current solution ok
10.08/10.91	o 290
12.37/13.24	c model valid
12.37/13.24	c current solution ok
12.41/13.33	o 289
15.57/16.44	c model valid
15.57/16.44	c current solution ok
15.61/16.52	o 288
18.76/19.64	c model valid
18.76/19.64	c current solution ok
18.86/19.74	o 287
21.96/22.87	c model valid
21.96/22.87	c current solution ok
22.04/22.95	o 286
25.16/26.05	c model valid
25.16/26.05	c current solution ok
25.21/26.13	o 285
27.96/28.83	c model valid
27.96/28.83	c current solution ok
28.00/28.92	o 284
31.55/32.49	c model valid
31.55/32.49	c current solution ok
31.65/32.58	o 283
34.86/35.73	c model valid
34.86/35.73	c current solution ok
34.89/35.81	o 282
39.86/40.72	c model valid
39.86/40.72	c current solution ok
39.87/40.83	o 281
50.82/51.79	c model valid
50.82/51.79	c current solution ok
50.90/51.87	o 280
61.61/62.57	c model valid
61.61/62.57	c current solution ok
61.70/62.66	o 279
72.90/73.82	c model valid
72.90/73.82	c current solution ok
72.93/73.90	o 278
75.51/76.44	c model valid
75.51/76.44	c current solution ok
75.55/76.53	o 277
86.40/87.39	c model valid
86.40/87.39	c current solution ok
86.50/87.47	o 276
88.98/89.92	c model valid
88.98/89.92	c current solution ok
89.00/90.01	o 275
91.49/92.49	c model valid
91.49/92.49	c current solution ok
91.57/92.59	o 274
93.97/94.93	c model valid
93.97/94.93	c current solution ok
94.01/95.02	o 273
96.56/97.53	c model valid
96.56/97.53	c current solution ok
96.59/97.66	o 272
99.53/100.56	c model valid
99.53/100.56	c current solution ok
99.60/100.65	o 271
101.82/102.84	c model valid
101.82/102.84	c current solution ok
101.86/102.95	o 270
104.79/105.85	c model valid
104.79/105.85	c current solution ok
104.85/105.94	o 269
107.68/108.80	c model valid
107.68/108.80	c current solution ok
107.78/108.90	o 268
111.08/112.17	c model valid
111.08/112.17	c current solution ok
111.15/112.26	o 267
113.56/114.67	c model valid
113.56/114.67	c current solution ok
113.64/114.76	o 266
115.64/116.70	c model valid
115.64/116.70	c current solution ok
115.64/116.78	o 265
117.55/118.64	c model valid
117.55/118.64	c current solution ok
117.65/118.72	o 264
119.43/120.59	c model valid
119.43/120.59	c current solution ok
119.53/120.67	o 263
121.43/122.59	c model valid
121.43/122.59	c current solution ok
121.53/122.68	o 262
124.42/125.57	c model valid
124.50/125.60	c current solution ok
124.50/125.70	o 261
128.87/130.08	c model valid
128.87/130.08	c current solution ok
128.98/130.87	o 260
133.47/135.39	c model valid
133.47/135.39	c current solution ok
133.55/136.30	o 259
138.13/140.80	c model valid
138.13/140.80	c current solution ok
138.13/140.90	o 258
142.51/145.26	c model valid
142.51/145.26	c current solution ok
142.57/145.35	o 257
145.49/148.20	c model valid
145.49/148.20	c current solution ok
145.49/148.28	o 256
149.59/152.35	c model valid
149.59/152.35	c current solution ok
149.65/152.44	o 255
153.68/156.48	c model valid
153.68/156.48	c current solution ok
153.77/156.58	o 254
156.87/159.67	c model valid
156.87/159.67	c current solution ok
156.94/159.76	o 253
159.46/162.28	c model valid
159.46/162.28	c current solution ok
159.55/162.37	o 252
162.35/165.18	c model valid
162.35/165.18	c current solution ok
162.43/165.31	o 251
164.91/167.78	c model valid
164.91/167.78	c current solution ok
165.01/167.88	o 250
167.61/170.48	c model valid
167.61/170.48	c current solution ok
167.69/170.57	o 249
170.20/173.06	c model valid
170.20/173.06	c current solution ok
170.28/173.16	o 248
172.70/175.55	c model valid
172.70/175.55	c current solution ok
172.76/175.65	o 247
175.19/178.05	c model valid
175.19/178.05	c current solution ok
175.29/178.14	o 246
177.38/180.29	c model valid
177.38/180.29	c current solution ok
177.47/180.78	o 245
179.67/182.98	c model valid
179.67/182.98	c current solution ok
179.76/183.07	o 244
181.96/185.26	c model valid
181.96/185.26	c current solution ok
182.02/185.35	o 243
185.09/188.55	c model valid
185.09/188.55	c current solution ok
185.15/188.63	o 242
188.29/191.77	c model valid
188.29/191.77	c current solution ok
188.36/191.85	o 241
191.68/195.16	c model valid
191.68/195.16	c current solution ok
191.74/195.24	o 240
194.28/197.71	c model valid
194.28/197.71	c current solution ok
194.29/197.80	o 239
196.77/200.24	c model valid
196.77/200.24	c current solution ok
196.81/200.33	o 238
198.95/202.47	c model valid
199.02/202.52	c current solution ok
199.02/202.95	o 237
202.66/206.57	c model valid
202.66/206.57	c current solution ok
202.74/206.66	o 236
206.56/210.49	c model valid
206.56/210.49	c current solution ok
206.65/210.58	o 235
210.36/214.28	c model valid
210.36/214.28	c current solution ok
210.45/214.38	o 234
214.25/218.13	c model valid
214.25/218.13	c current solution ok
214.28/218.21	o 233
218.15/222.02	c model valid
218.15/222.02	c current solution ok
218.25/222.10	o 232
220.64/224.53	c model valid
220.64/224.53	c current solution ok
220.68/224.62	o 231
223.84/227.79	c model valid
223.84/227.79	c current solution ok
223.92/227.89	o 230
226.23/230.19	c model valid
226.23/230.19	c current solution ok
226.32/230.28	o 229
228.72/232.62	c model valid
228.72/232.62	c current solution ok
228.74/232.71	o 228
231.71/235.69	c model valid
231.71/235.69	c current solution ok
231.80/235.79	o 227
235.12/239.03	c model valid
235.12/239.03	c current solution ok
235.15/239.12	o 226
237.12/241.05	c model valid
237.12/241.05	c current solution ok
237.17/241.14	o 225
243.61/247.55	c model valid
243.61/247.55	c current solution ok
243.66/247.64	o 224
245.61/249.57	c model valid
245.61/249.57	c current solution ok
245.71/249.67	o 223
248.01/251.97	c model valid
248.01/251.97	c current solution ok
248.17/252.80	o 222
251.37/256.09	c model valid
251.37/256.09	c current solution ok
251.46/256.18	o 221
253.87/258.59	c model valid
253.87/258.59	c current solution ok
253.96/258.69	o 220
256.16/260.87	c model valid
256.16/260.87	c current solution ok
256.23/260.96	o 219
258.45/263.17	c model valid
258.45/263.17	c current solution ok
258.59/264.02	o 218
260.70/266.17	c model valid
260.70/266.17	c current solution ok
260.77/266.25	o 217
263.00/268.46	c model valid
263.00/268.46	c current solution ok
263.12/269.42	o 216
265.33/271.67	c model valid
265.33/271.67	c current solution ok
265.40/271.76	o 215
267.63/273.96	c model valid
267.68/274.17	c current solution ok
267.68/274.33	o 214
269.94/276.56	c model valid
269.94/276.56	c current solution ok
270.00/276.65	o 213
272.24/278.88	c model valid
272.24/278.88	c current solution ok
272.39/279.33	o 212
274.48/281.48	c model valid
274.48/281.48	c current solution ok
274.58/281.58	o 211
276.88/283.83	c model valid
276.88/283.83	c current solution ok
276.93/284.59	o 210
281.02/288.66	c model valid
281.02/288.66	c current solution ok
281.08/288.76	o 209
283.41/291.08	c model valid
283.41/291.08	c current solution ok
283.50/291.18	o 208
286.51/294.19	c model valid
286.51/294.19	c current solution ok
286.61/294.29	o 207
290.12/297.73	c model valid
290.12/297.73	c current solution ok
290.15/297.82	o 206
293.60/301.30	c model valid
293.60/301.30	c current solution ok
293.70/301.39	o 205
295.90/303.56	c model valid
295.90/303.56	c current solution ok
295.98/303.66	o 204
298.49/306.17	c model valid
298.49/306.17	c current solution ok
298.57/306.26	o 203
301.68/309.33	c model valid
301.68/309.33	c current solution ok
301.71/309.42	o 202
303.87/311.59	c model valid
303.87/311.59	c current solution ok
303.97/311.69	o 201
306.37/314.03	c model valid
306.37/314.03	c current solution ok
306.48/314.70	o 200
311.98/320.26	c model valid
311.98/320.26	c current solution ok
312.04/320.35	o 199
314.97/323.21	c model valid
314.97/323.21	c current solution ok
314.97/323.29	o 198
317.65/325.96	c model valid
317.65/325.96	c current solution ok
317.72/326.05	o 197
319.95/328.22	c model valid
319.95/328.22	c current solution ok
319.97/328.31	o 196
322.64/330.92	c model valid
322.64/330.92	c current solution ok
322.72/331.03	o 195
325.01/333.35	c model valid
325.01/333.35	c current solution ok
325.07/333.44	o 194
327.51/335.84	c model valid
327.51/335.84	c current solution ok
327.55/336.06	o 193
329.96/338.44	c model valid
329.96/338.44	c current solution ok
330.00/338.52	o 192
335.55/344.06	c model valid
335.55/344.06	c current solution ok
335.61/344.14	o 191
338.75/347.21	c model valid
338.75/347.21	c current solution ok
338.77/347.31	o 190
343.67/352.72	c model valid
343.67/352.72	c current solution ok
343.69/352.80	o 189
345.86/354.95	c model valid
345.86/354.95	c current solution ok
345.92/355.04	o 188
347.94/357.07	c model valid
347.94/357.07	c current solution ok
348.02/357.16	o 187
350.14/359.20	c model valid
350.14/359.20	c current solution ok
350.14/359.29	o 186
352.34/361.43	c model valid
352.34/361.43	c current solution ok
352.37/361.52	o 185
354.83/363.90	c model valid
354.83/363.90	c current solution ok
354.85/364.56	o 184
357.07/366.77	c model valid
357.07/366.77	c current solution ok
357.14/366.86	o 183
360.07/369.73	c model valid
360.07/369.73	c current solution ok
360.10/369.85	o 182
363.03/372.77	c model valid
363.03/372.77	c current solution ok
363.12/372.87	o 181
365.52/375.28	c model valid
365.52/375.28	c current solution ok
365.61/375.53	o 180
368.57/378.45	c model valid
368.57/378.45	c current solution ok
368.62/378.55	o 179
371.56/381.48	c model valid
371.56/381.48	c current solution ok
371.65/381.57	o 178
374.56/384.48	c model valid
374.56/384.48	c current solution ok
374.65/384.57	o 177
376.64/386.56	c model valid
376.64/386.56	c current solution ok
376.72/386.65	o 176
378.85/388.74	c model valid
378.85/388.74	c current solution ok
378.89/388.83	o 175
381.84/391.74	c model valid
381.84/391.74	c current solution ok
381.88/391.92	o 174
384.75/394.74	c model valid
384.75/394.74	c current solution ok
384.86/394.83	o 173
387.64/397.62	c model valid
387.64/397.62	c current solution ok
387.67/397.71	o 172
391.44/401.47	c model valid
391.44/401.47	c current solution ok
391.50/401.56	o 171
393.92/403.90	c model valid
393.92/403.90	c current solution ok
393.92/403.98	o 170
396.51/406.57	c model valid
396.51/406.57	c current solution ok
396.59/406.66	o 169
399.41/409.44	c model valid
399.41/409.44	c current solution ok
399.45/409.53	o 168
401.81/411.85	c model valid
401.81/411.85	c current solution ok
401.86/411.95	o 167
404.58/414.74	c model valid
404.58/414.74	c current solution ok
404.62/414.84	o 166
407.38/417.52	c model valid
407.38/417.52	c current solution ok
407.40/417.61	o 165
411.37/421.53	c model valid
411.37/421.53	c current solution ok
411.40/421.62	o 164
413.86/424.04	c model valid
413.86/424.04	c current solution ok
413.91/424.13	o 163
416.35/426.56	c model valid
416.35/426.56	c current solution ok
416.42/426.68	o 162
419.30/429.57	c model valid
419.30/429.57	c current solution ok
419.38/429.65	o 161
422.81/433.08	c model valid
422.81/433.08	c current solution ok
422.90/433.16	o 160
425.90/436.17	c model valid
425.90/436.17	c current solution ok
425.98/436.26	o 159
429.20/439.45	c model valid
429.20/439.45	c current solution ok
429.25/439.54	o 158
432.19/442.44	c model valid
432.19/442.44	c current solution ok
432.24/442.54	o 157
435.37/445.63	c model valid
435.37/445.63	c current solution ok
435.40/445.71	o 156
446.86/457.14	c model valid
446.86/457.14	c current solution ok
446.91/457.22	o 155
451.76/462.03	c model valid
451.76/462.03	c current solution ok
451.79/462.33	o 154
454.42/464.95	c model valid
454.42/464.95	c current solution ok
454.48/465.04	o 153
456.92/467.43	c model valid
456.92/467.43	c current solution ok
456.95/467.52	o 152
459.51/470.03	c model valid
459.51/470.03	c current solution ok
459.55/470.13	o 151
461.99/472.53	c model valid
461.99/472.53	c current solution ok
462.03/472.61	o 150
466.30/476.86	c model valid
466.30/476.86	c current solution ok
466.36/476.95	o 149
469.78/480.52	c model valid
469.78/480.52	c current solution ok
469.88/480.61	o 148
472.37/483.18	c model valid
472.37/483.18	c current solution ok
472.46/483.27	o 147
475.57/486.39	c model valid
475.57/486.39	c current solution ok
475.67/486.50	o 146
478.87/489.63	c model valid
478.87/489.63	c current solution ok
478.90/489.72	o 145
481.65/492.47	c model valid
481.65/492.47	c current solution ok
481.73/492.55	o 144
484.46/495.25	c model valid
484.46/495.25	c current solution ok
484.52/495.35	o 143
487.06/497.85	c model valid
487.06/497.85	c current solution ok
487.12/497.95	o 142
491.36/502.10	c model valid
491.36/502.10	c current solution ok
491.42/503.63	o 141
494.52/506.79	c model valid
494.52/506.79	c current solution ok
494.70/507.60	o 140
499.00/511.90	c model valid
499.00/511.90	c current solution ok
499.00/512.79	o 139
504.99/518.72	c model valid
504.99/518.72	c current solution ok
505.01/518.80	o 138
511.19/524.94	c model valid
511.19/524.94	c current solution ok
511.24/525.02	o 137
524.19/537.96	c model valid
524.19/537.96	c current solution ok
524.25/538.05	o 136
531.57/545.39	c model valid
531.57/545.39	c current solution ok
531.66/545.48	o 135
534.34/548.13	c model valid
534.34/548.13	c current solution ok
534.37/548.21	o 134
541.04/554.80	c model valid
541.04/554.80	c current solution ok
541.04/554.89	o 133
544.63/558.49	c model valid
544.63/558.49	c current solution ok
544.72/558.58	o 132
550.84/564.65	c model valid
550.84/564.65	c current solution ok
550.89/564.74	o 131
577.12/590.98	c model valid
577.12/590.98	c current solution ok
577.20/591.06	o 130
597.42/611.22	c model valid
597.42/611.22	c current solution ok
597.45/611.31	o 129
637.81/651.66	c model valid
637.81/651.66	c current solution ok
637.88/651.75	o 128
722.49/736.36	c model valid
722.49/736.36	c current solution ok
722.56/736.45	o 127
1549.14/1563.17	c model valid
1549.14/1563.17	c current solution ok
1549.29/1563.33	o 126
1793.52/1808.71	c error: unexpected solver exit code
1793.52/1808.71	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3695232-1338111217/watcher-3695232-1338111217 -o /tmp/evaluation-result-3695232-1338111217/solver-3695232-1338111217 -C 1800 -W 1900 -M 15500 HOME/runPb2satCp2.sh HOME/instance-3695232-1338111217.opb 857300052 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.06 2.21 3/179 9912
/proc/meminfo: memFree=26580824/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0

[startup+0.070029 s]
/proc/loadavg: 2.02 2.06 2.21 3/179 9912
/proc/meminfo: memFree=26580824/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100314 s]
/proc/loadavg: 2.02 2.06 2.21 3/179 9912
/proc/meminfo: memFree=26580824/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300285 s]
/proc/loadavg: 2.02 2.06 2.21 3/179 9912
/proc/meminfo: memFree=26580824/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700322 s]
/proc/loadavg: 2.02 2.06 2.21 3/179 9912
/proc/meminfo: memFree=26580824/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50032 s]
/proc/loadavg: 2.02 2.06 2.21 3/181 9914
/proc/meminfo: memFree=26527756/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165836 CPUtime=1.49 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) R 9912 9912 6267 0 -1 4202496 16684 0 0 0 140 9 0 0 20 0 1 0 277248694 169816064 37081 33554432000 4194304 5873084 140735064891504 140735064883944 5129975 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/9913/statm: 41459 37081 161 410 0 41041 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 174984

[startup+3.10041 s]
/proc/loadavg: 2.02 2.06 2.21 3/183 9916
/proc/meminfo: memFree=26215452/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=117264 CPUtime=1.51 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 16688 0 0 0 140 11 0 0 20 0 1 0 277248694 120078336 24941 33554432000 4194304 5873084 140735064891504 140735064887928 5124602 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/9913/statm: 29316 24941 164 410 0 28898 0
[pid=9915] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9915/stat : 9915 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277248846 9367552 267 33554432000 4194304 5064252 140736935102656 140736935101568 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/9915/statm: 2287 267 226 213 0 72 0
[pid=9916] ppid=9915 vsize=327508 CPUtime=1.56 cores=0,2,4,6
/proc/9916/stat : 9916 (glucose_static) R 9915 9912 6267 0 -1 4202496 53744 0 0 0 146 10 0 0 20 0 1 0 277248847 335368192 69395 33554432000 4194304 4896791 140734184276640 140734184273944 4423776 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/9916/statm: 81877 69395 79 172 0 81703 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 463068

[startup+6.30032 s]
/proc/loadavg: 2.02 2.06 2.21 3/181 9916
/proc/meminfo: memFree=26369756/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=149908 CPUtime=6.15 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) R 9912 9912 6267 0 -1 4202496 17304 54350 0 0 224 226 153 12 20 0 1 0 277248694 153505792 32109 33554432000 4194304 5873084 140735064891504 140735064886936 5127520 0 0 4096 0 0 0 0 17 2 0 0 12 0 0
/proc/9913/statm: 37477 32109 172 410 0 37059 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 159056

[startup+12.7004 s]
/proc/loadavg: 2.02 2.06 2.21 3/183 9922
/proc/meminfo: memFree=26047768/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=10.14 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 19129 109770 0 0 298 353 317 46 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 12 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=9921] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9921/stat : 9921 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277249790 9367552 267 33554432000 4194304 5064252 140733737674720 140733737673632 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/9921/statm: 2287 267 226 213 0 72 0
[pid=9922] ppid=9921 vsize=333912 CPUtime=1.73 cores=0,2,4,6
/proc/9922/stat : 9922 (glucose_static) R 9921 9912 6267 0 -1 4202496 53845 0 0 0 161 12 0 0 20 0 1 0 277249790 341925888 73423 33554432000 4194304 4896791 140736644530640 140736644528440 4423776 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/9922/statm: 83478 73423 79 172 0 83304 0
Current children cumulated CPU time (s) 11.87
Current children cumulated vsize (KiB) 517328

[startup+25.5004 s]
/proc/loadavg: 2.09 2.07 2.21 3/183 9934
/proc/meminfo: memFree=26045528/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=22.17 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 24002 329747 0 0 466 357 1254 140 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 12 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=9933] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9933/stat : 9933 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 277250994 9367552 267 33554432000 4194304 5064252 140734973235312 140734973234224 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/9933/statm: 2287 267 226 213 0 72 0
[pid=9934] ppid=9933 vsize=333772 CPUtime=2.48 cores=0,2,4,6
/proc/9934/stat : 9934 (glucose_static) R 9933 9912 6267 0 -1 4202496 53398 0 0 0 235 13 0 0 20 0 1 0 277250995 341782528 73795 33554432000 4194304 4896791 140734294145152 140734294142456 4423776 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/9934/statm: 83443 73795 79 172 0 83269 0
Current children cumulated CPU time (s) 24.65
Current children cumulated vsize (KiB) 517188

[startup+51.1004 s]
/proc/loadavg: 2.06 2.07 2.20 3/183 9949
/proc/meminfo: memFree=26045520/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=40.01 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 30099 608540 0 0 677 363 2698 263 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 12 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=9948] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9948/stat : 9948 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277252782 9367552 266 33554432000 4194304 5064252 140734154912656 140734154911568 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/9948/statm: 2287 266 226 213 0 72 0
[pid=9949] ppid=9948 vsize=333560 CPUtime=10.2 cores=0,2,4,6
/proc/9949/stat : 9949 (glucose_static) R 9948 9912 6267 0 -1 4202496 53891 0 0 0 1007 13 0 0 20 0 1 0 277252783 341565440 73439 33554432000 4194304 4896791 140737239000544 140737238998088 4318678 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/9949/statm: 83390 73439 78 172 0 83216 0
Current children cumulated CPU time (s) 50.21
Current children cumulated vsize (KiB) 516976

[startup+102.307 s]
/proc/loadavg: 2.22 2.10 2.20 3/184 9980
/proc/meminfo: memFree=26041912/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=99.72 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 42286 1167483 0 0 1080 374 8005 513 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 6 0 0 12 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=9979] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9979/stat : 9979 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277258763 9367552 267 33554432000 4194304 5064252 140735853653472 140735853652384 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9979/statm: 2287 267 226 213 0 72 0
[pid=9980] ppid=9979 vsize=333240 CPUtime=1.59 cores=0,2,4,6
/proc/9980/stat : 9980 (glucose_static) R 9979 9912 6267 0 -1 4202496 53410 0 0 0 146 13 0 0 20 0 1 0 277258764 341237760 72529 33554432000 4194304 4896791 140734910655696 140734910653000 4423776 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/9980/statm: 83310 72529 79 172 0 83136 0
Current children cumulated CPU time (s) 101.31
Current children cumulated vsize (KiB) 516656

############
# WARNING:
# current cumulated CPU time (138.26 s) is less than in the last sample (142.1 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (3.83998 s) to the 'lost time'.

[startup+144.8 s]
/proc/loadavg: 2.14 2.10 2.19 3/183 10019
/proc/meminfo: memFree=26044652/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=138.26 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 58141 1890507 0 0 1591 389 11010 836 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 12 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=10018] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10018/stat : 10018 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277262788 9367552 267 33554432000 4194304 5064252 140736009731792 140736009730704 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/10018/statm: 2287 267 226 213 0 72 0
[pid=10019] ppid=10018 vsize=333456 CPUtime=3.84 cores=0,2,4,6
/proc/10019/stat : 10019 (glucose_static) R 10018 9912 6267 0 -1 4202496 54056 0 0 0 372 12 0 0 20 0 1 0 277262788 341458944 72406 33554432000 4194304 4896791 140735880146192 140735880142088 4423776 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/10019/statm: 83364 72406 79 172 0 83190 0

################
# More data... #
################

/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=722.65 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201234 9126488 0 0 6599 509 61053 4104 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=10419] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10419/stat : 10419 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 277322340 9367552 266 33554432000 4194304 5064252 140736263020352 140736263019264 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/10419/statm: 2287 266 226 213 0 72 0
[pid=10420] ppid=10419 vsize=342688 CPUtime=745.67 cores=0,2,4,6
/proc/10420/stat : 10420 (glucose_static) R 10419 9912 6267 0 -1 4202496 63966 0 0 0 74539 28 0 0 20 0 1 0 277322341 350912512 74137 33554432000 4194304 4896791 140736860915408 140736860912616 4225029 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10420/statm: 85672 74137 78 172 0 85498 0
Current children cumulated CPU time (s) 1468.32
Current children cumulated vsize (KiB) 526104

[startup+1542.3 s]
/proc/loadavg: 2.11 2.09 2.09 2/182 12635
/proc/meminfo: memFree=27506884/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=722.65 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201234 9126488 0 0 6599 509 61053 4104 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=10419] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/10419/stat : 10419 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 277322340 9367552 266 33554432000 4194304 5064252 140736263020352 140736263019264 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/10419/statm: 2287 266 226 213 0 72 0
[pid=10420] ppid=10419 vsize=343296 CPUtime=805.67 cores=0,2,4,6
/proc/10420/stat : 10420 (glucose_static) R 10419 9912 6267 0 -1 4202496 64896 0 0 0 80537 30 0 0 20 0 1 0 277322341 351535104 74776 33554432000 4194304 4896791 140736860915408 140736860912616 4224684 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/10420/statm: 85824 74776 78 172 0 85650 0
Current children cumulated CPU time (s) 1528.32
Current children cumulated vsize (KiB) 526712

[startup+1602.3 s]
/proc/loadavg: 2.18 2.12 2.09 3/184 12742
/proc/meminfo: memFree=27435540/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=332356 CPUtime=37.88 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 52589 0 0 0 3775 13 0 0 20 0 1 0 277405021 340332544 69782 33554432000 4194304 4896791 140736412419552 140736412416760 4224706 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 83089 69782 78 172 0 82915 0
Current children cumulated CPU time (s) 1587.17
Current children cumulated vsize (KiB) 515772

[startup+1662.3 s]
/proc/loadavg: 2.26 2.15 2.10 3/182 12867
/proc/meminfo: memFree=27504720/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=333852 CPUtime=97.87 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 56330 0 0 0 9772 15 0 0 20 0 1 0 277405021 341864448 68791 33554432000 4194304 4896791 140736412419552 140736412417128 4224680 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 83463 68791 78 172 0 83289 0
Current children cumulated CPU time (s) 1647.16
Current children cumulated vsize (KiB) 517268

[startup+1722.3 s]
/proc/loadavg: 2.23 2.18 2.11 3/182 12964
/proc/meminfo: memFree=27500924/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=335020 CPUtime=157.85 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 56948 0 0 0 15768 17 0 0 20 0 1 0 277405021 343060480 69076 33554432000 4194304 4896791 140736412419552 140736412417128 4224921 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 83755 69076 78 172 0 83581 0
Current children cumulated CPU time (s) 1707.14
Current children cumulated vsize (KiB) 518436

[startup+1782.3 s]
/proc/loadavg: 2.28 2.22 2.13 3/181 13066
/proc/meminfo: memFree=27497860/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=335940 CPUtime=217.83 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 57480 0 0 0 21765 18 0 0 20 0 1 0 277405021 344002560 69314 33554432000 4194304 4896791 140736412419552 140736412416936 4223886 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 83985 69314 78 172 0 83811 0
Current children cumulated CPU time (s) 1767.12
Current children cumulated vsize (KiB) 519356



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1808.7 s]
/proc/loadavg: 2.40 2.26 2.14 3/183 13111
/proc/meminfo: memFree=27437652/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=336344 CPUtime=244.23 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 58613 0 0 0 24404 19 0 0 20 0 1 0 277405021 344416256 71446 33554432000 4194304 4896791 140736412419552 140736412417064 4224706 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 84086 71446 78 172 0 83912 0
Current children cumulated CPU time (s) 1793.52
Current children cumulated vsize (KiB) 519760

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1808.7 s]
/proc/loadavg: 2.40 2.26 2.14 3/183 13111
/proc/meminfo: memFree=27437652/32873844 swapFree=7100/7100
[pid=9912] ppid=9910 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/9912/stat : 9912 (runPb2satCp2.sh) S 9910 9912 6267 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 277248694 9367552 275 33554432000 4194304 5064252 140734214867056 140734214865968 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/9912/statm: 2287 275 233 213 0 72 0
[pid=9913] ppid=9912 vsize=165120 CPUtime=1549.29 cores=0,2,4,6
/proc/9913/stat : 9913 (pb2sat) S 9912 9912 6267 0 -1 4202496 201953 9194084 0 0 6637 510 143637 4145 20 0 1 0 277248694 169082880 35183 33554432000 4194304 5873084 140735064891504 140735064885320 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 87 0 0
/proc/9913/statm: 41280 35183 173 410 0 40862 0
[pid=12675] ppid=9913 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12675/stat : 12675 (satsolver.sh) S 9913 9912 6267 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 277405020 9367552 267 33554432000 4194304 5064252 140735714218960 140735714217872 233411601998 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/12675/statm: 2287 267 226 213 0 72 0
[pid=12676] ppid=12675 vsize=336344 CPUtime=244.23 cores=0,2,4,6
/proc/12676/stat : 12676 (glucose_static) R 12675 9912 6267 0 -1 4202496 58613 0 0 0 24404 19 0 0 20 0 1 0 277405021 344416256 71446 33554432000 4194304 4896791 140736412419552 140736412417064 4224706 0 0 4096 0 0 0 0 17 2 0 0 110 0 0
/proc/12676/statm: 84086 71446 78 172 0 83912 0
Current children cumulated CPU time (s) 1793.52
Current children cumulated vsize (KiB) 519760

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9912 and gives
#  childrusage.ru_utime.tv_sec=1502
#  childrusage.ru_utime.tv_usec=752546
#  childrusage.ru_stime.tv_sec=46
#  childrusage.ru_stime.tv_usec=569920
# CPU time returned by wait4() is 1549.32
# while last known CPU time is 1793.52
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 6.55
#  lost CPU user time (s): 6.29
#  lost CPU system time (s): 0.259999

Real time (s): 1808.72
CPU time (s): 1800.07
CPU user time (s): 1753.07
CPU system time (s): 47
CPU usage (%): 99.5219
Max. virtual memory (cumulated for all children) (KiB): 606708

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1502.75
system time used= 46.5699
maximum resident set size= 342960
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9397014
page faults= 0
swaps= 0
block input operations= 0
block output operations= 19847952
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1907
involuntary context switches= 3913

runsolver used 2.98655 second user time and 8.07877 second system time

The end

Launcher Data 

Begin job on node111 at 2012-05-27 11:33:37
IDJOB=3695232
IDBENCH=77618
IDSOLVER=2273
FILE ID=node111/3695232-1338111217
RUNJOBID= node111-1338087406-6283
PBS_JOBID= 14624442
Free space on /tmp= 71304 MiB

SOLVER NAME= pb2satCp2 2012-05-19
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j120opt/normalized-j1207_6.std.opb
COMMAND LINE= DIR/runPb2satCp2.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3695232-1338111217/watcher-3695232-1338111217 -o /tmp/evaluation-result-3695232-1338111217/solver-3695232-1338111217 -C 1800 -W 1900 -M 15500  HOME/runPb2satCp2.sh HOME/instance-3695232-1338111217.opb 857300052 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d16d5193341210b17a0f2e49373cb527
RANDOM SEED=857300052

node111.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.30
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26581320 kB
Buffers:          373336 kB
Cached:          3666916 kB
SwapCached:            0 kB
Active:          2784492 kB
Inactive:        2686828 kB
Active(anon):    1433064 kB
Inactive(anon):        0 kB
Active(file):    1351428 kB
Inactive(file):  2686828 kB
Unevictable:        7100 kB
Mlocked:            7100 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             15640 kB
Writeback:             0 kB
AnonPages:       1505276 kB
Mapped:            15280 kB
Shmem:               200 kB
Slab:             677384 kB
SReclaimable:     119824 kB
SUnreclaim:       557560 kB
KernelStack:        1472 kB
PageTables:         7044 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1777388 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    432128 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71380 MiB
End job on node111 at 2012-05-27 12:03:46