Trace number 3291953

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Black Hole SAT 2011-03-08? (TO) 1300.18 1300.14

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
MD5SUM776da55785376fd8eac6989ca812b102
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1002.78
Satisfiable
(Un)Satisfiability was proved
Number of variables371419
Number of clauses7170909
Sum of the clauses size20872419
Maximum clause length205
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 26770451
Number of clauses of size 392326
Number of clauses of size 48862
Number of clauses of size 523554
Number of clauses of size over 5275715

Solver Data 

5.59/5.63	c RESTART
6.29/6.34	c RESTART
6.79/6.90	c RESTART
941.52/941.57	c RESTART
970.62/970.60	c RESTART
975.42/975.43	c RESTART
978.92/978.94	c RESTART
1009.32/1009.36	c RESTART
1011.12/1011.13	c RESTART
1012.62/1012.65	c RESTART
1013.43/1013.43	c RESTART
1014.03/1014.05	c RESTART
1014.63/1014.63	c RESTART
1015.13/1015.17	c RESTART
1016.03/1016.06	c RESTART
1016.93/1016.93	c RESTART
1017.52/1017.51	c RESTART
1264.03/1264.01	c RESTART
1264.93/1264.97	c RESTART
1265.83/1265.83	c RESTART
1266.43/1266.48	c RESTART
1267.13/1267.19	c RESTART
1267.73/1267.79	c RESTART
1268.33/1268.31	c RESTART
1268.93/1268.98	c RESTART
1269.53/1269.55	c RESTART
1270.23/1270.23	c RESTART
1270.84/1270.82	c RESTART
1271.33/1271.39	c RESTART
1272.03/1272.00	c RESTART
1272.43/1272.45	c RESTART
1272.94/1272.98	c RESTART
1273.53/1273.59	c RESTART
1273.93/1273.92	c RESTART
1276.03/1276.01	c RESTART
1276.53/1276.55	c RESTART
1277.03/1277.07	c RESTART
1277.64/1277.67	c RESTART
1278.33/1278.35	c RESTART
1278.93/1278.92	c RESTART
1280.23/1280.25	c RESTART
1281.03/1281.05	c RESTART
1281.43/1281.45	c RESTART
1281.93/1281.96	c RESTART
1282.53/1282.58	c RESTART
1283.43/1283.44	c RESTART
1287.53/1287.51	c RESTART
1288.03/1288.03	c RESTART
1289.03/1289.09	c RESTART
1289.73/1289.72	c RESTART
1290.33/1290.32	c RESTART
1291.13/1291.15	c RESTART
1292.03/1292.02	c RESTART
1292.43/1292.45	c RESTART
1293.13/1293.12	c RESTART
1293.54/1293.59	c RESTART
1294.04/1294.06	c RESTART
1294.64/1294.62	c RESTART
1295.24/1295.23	c RESTART
1296.64/1296.67	c RESTART
1298.64/1298.66	c RESTART
1299.24/1299.28	c RESTART

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291953-1303796532/watcher-3291953-1303796532 -o /tmp/evaluation-result-3291953-1303796532/solver-3291953-1303796532 -C 2400 -W 1300 -M 7680 saturn HOME/instance-3291953-1303796532.cnf 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=177044 CPUtime=0 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 3487 0 0 0 0 0 0 0 21 0 1 0 472069165 181293056 3430 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095145053 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 44261 3445 81 5 0 3657 0

[startup+0.095602 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=624100 CPUtime=0.08 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 16777 0 0 0 7 1 0 0 21 0 1 0 472069165 639078400 16720 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 156025 16722 651 5 0 115421 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 624100

[startup+1.56633 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=866056 CPUtime=1.56 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 113135 0 0 0 142 14 0 0 25 0 1 0 472069165 886841344 113077 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 216514 113081 12983 5 0 175910 0
Current children cumulated CPU time (s) 1.56
Current children cumulated vsize (KiB) 866056

[startup+1.60034 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=871468 CPUtime=1.59 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 115308 0 0 0 145 14 0 0 25 0 1 0 472069165 892383232 115250 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 217867 115252 13277 5 0 177263 0
Current children cumulated CPU time (s) 1.59
Current children cumulated vsize (KiB) 871468

[startup+1.70031 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=887440 CPUtime=1.69 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 121705 0 0 0 154 15 0 0 25 0 1 0 472069165 908738560 121647 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 221860 121649 14150 5 0 181256 0
Current children cumulated CPU time (s) 1.69
Current children cumulated vsize (KiB) 887440

[startup+1.8003 s]
/proc/loadavg: 3.37 3.85 3.89 4/186 11862
/proc/meminfo: memFree=13446748/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=903412 CPUtime=1.79 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 128110 0 0 0 163 16 0 0 25 0 1 0 472069165 925093888 128052 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 225853 128056 15029 5 0 185249 0
Current children cumulated CPU time (s) 1.79
Current children cumulated vsize (KiB) 903412

[startup+3.10107 s]
/proc/loadavg: 3.37 3.85 3.89 5/190 11869
/proc/meminfo: memFree=12307984/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=1110256 CPUtime=3.09 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 211493 0 0 0 285 24 0 0 25 0 1 0 472069165 1136902144 211435 33554432000 4194304 4210924 140733929201232 18446744073709551615 228095111877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 277564 211438 26556 5 0 236960 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1110256

[startup+6.30048 s]
/proc/loadavg: 3.50 3.87 3.90 5/190 11869
/proc/meminfo: memFree=11037348/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=1188072 CPUtime=6.29 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 306411 0 0 0 595 34 0 0 25 0 1 0 472069165 1216585728 266553 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200057 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 297018 266553 103 5 0 295489 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1188072

[startup+12.7003 s]
/proc/loadavg: 3.62 3.89 3.91 5/190 11870
/proc/meminfo: memFree=10231320/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=1703136 CPUtime=12.69 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 435278 0 0 0 1219 50 0 0 25 0 1 0 472069165 1744011264 395420 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 425784 395420 104 5 0 424255 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1703136

[startup+25.5009 s]
/proc/loadavg: 3.78 3.91 3.91 5/190 11870
/proc/meminfo: memFree=9724176/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2066392 CPUtime=25.5 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 526093 0 0 0 2488 62 0 0 25 0 1 0 472069165 2115985408 486233 33554432000 4194304 4210924 140733929201232 18446744073709551615 4199408 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 516598 486233 104 5 0 515069 0
Current children cumulated CPU time (s) 25.5
Current children cumulated vsize (KiB) 2066392

[startup+51.1002 s]
/proc/loadavg: 3.85 3.92 3.91 5/190 11871
/proc/meminfo: memFree=8626560/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3112300 CPUtime=51.09 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 787564 0 0 0 5018 91 0 0 25 0 1 0 472069165 3186995200 747704 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778075 747704 104 5 0 776546 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 3112300

[startup+102.301 s]
/proc/loadavg: 3.98 3.94 3.92 5/190 11899
/proc/meminfo: memFree=8299024/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3112660 CPUtime=102.29 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 787654 0 0 0 10138 91 0 0 25 0 1 0 472069165 3187363840 747794 33554432000 4194304 4210924 140733929201232 18446744073709551615 4207055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778165 747794 104 5 0 776636 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 3112660

[startup+162.301 s]
/proc/loadavg: 3.99 3.95 3.92 5/190 11901
/proc/meminfo: memFree=8176948/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3113164 CPUtime=162.29 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 787780 0 0 0 16138 91 0 0 25 0 1 0 472069165 3187879936 747920 33554432000 4194304 4210924 140733929201232 18446744073709551615 4199396 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778291 747920 104 5 0 776762 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 3113164

[startup+222.301 s]
/proc/loadavg: 3.99 3.95 3.92 5/190 11929
/proc/meminfo: memFree=8594920/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3113580 CPUtime=222.29 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 787885 0 0 0 22138 91 0 0 25 0 1 0 472069165 3188305920 748025 33554432000 4194304 4210924 140733929201232 18446744073709551615 4207045 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778395 748025 104 5 0 776866 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 3113580

[startup+282.301 s]
/proc/loadavg: 3.99 3.96 3.92 5/190 11931
/proc/meminfo: memFree=8392984/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3114016 CPUtime=282.3 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 787998 0 0 0 28138 92 0 0 25 0 1 0 472069165 3188752384 748134 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778504 748134 104 5 0 776975 0
Current children cumulated CPU time (s) 282.3
Current children cumulated vsize (KiB) 3114016

[startup+342.301 s]
/proc/loadavg: 4.05 3.98 3.92 5/190 11932
/proc/meminfo: memFree=7938548/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3114392 CPUtime=342.31 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788094 0 0 0 34139 92 0 0 25 0 1 0 472069165 3189137408 748228 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200080 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778598 748228 104 5 0 777069 0
Current children cumulated CPU time (s) 342.31
Current children cumulated vsize (KiB) 3114392

[startup+402.301 s]
/proc/loadavg: 4.02 3.98 3.92 5/190 11934
/proc/meminfo: memFree=7183304/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3114832 CPUtime=402.31 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788207 0 0 0 40139 92 0 0 25 0 1 0 472069165 3189587968 748338 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200072 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778708 748338 104 5 0 777179 0
Current children cumulated CPU time (s) 402.31
Current children cumulated vsize (KiB) 3114832

[startup+462.307 s]
/proc/loadavg: 4.00 3.98 3.92 5/190 11936
/proc/meminfo: memFree=6959540/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3115204 CPUtime=462.31 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788303 0 0 0 46139 92 0 0 25 0 1 0 472069165 3189968896 748431 33554432000 4194304 4210924 140733929201232 18446744073709551615 4198304 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778801 748431 104 5 0 777272 0
Current children cumulated CPU time (s) 462.31
Current children cumulated vsize (KiB) 3115204

[startup+522.301 s]
/proc/loadavg: 4.00 3.98 3.92 5/190 11937
/proc/meminfo: memFree=6903576/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3115632 CPUtime=522.3 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788414 0 0 0 52138 92 0 0 25 0 1 0 472069165 3190407168 748538 33554432000 4194304 4210924 140733929201232 18446744073709551615 4206991 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 778908 748538 104 5 0 777379 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 3115632

[startup+582.301 s]
/proc/loadavg: 4.08 4.00 3.93 5/190 11939
/proc/meminfo: memFree=6919840/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3116004 CPUtime=582.31 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788510 0 0 0 58138 93 0 0 25 0 1 0 472069165 3190788096 748631 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779001 748631 104 5 0 777472 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 3116004

[startup+642.301 s]
/proc/loadavg: 4.03 4.00 3.93 5/190 11940
/proc/meminfo: memFree=6939080/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3116444 CPUtime=642.31 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788623 0 0 0 64138 93 0 0 25 0 1 0 472069165 3191238656 748741 33554432000 4194304 4210924 140733929201232 18446744073709551615 4207055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779111 748741 104 5 0 777582 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 3116444

[startup+702.301 s]
/proc/loadavg: 4.01 4.00 3.93 5/190 11942
/proc/meminfo: memFree=6491960/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3116816 CPUtime=702.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788719 0 0 0 70139 93 0 0 25 0 1 0 472069165 3191619584 748834 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779204 748834 104 5 0 777675 0
Current children cumulated CPU time (s) 702.32
Current children cumulated vsize (KiB) 3116816

[startup+762.301 s]
/proc/loadavg: 4.00 4.00 3.93 5/190 11944
/proc/meminfo: memFree=6416048/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3117244 CPUtime=762.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788830 0 0 0 76139 93 0 0 25 0 1 0 472069165 3192057856 748941 33554432000 4194304 4210924 140733929201232 18446744073709551615 4207051 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779311 748941 104 5 0 777782 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 3117244

[startup+822.301 s]
/proc/loadavg: 4.00 4.00 3.93 5/190 11945
/proc/meminfo: memFree=6313720/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3117684 CPUtime=822.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 788943 0 0 0 82139 93 0 0 25 0 1 0 472069165 3192508416 749051 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779421 749051 104 5 0 777892 0
Current children cumulated CPU time (s) 822.32
Current children cumulated vsize (KiB) 3117684

[startup+882.301 s]
/proc/loadavg: 4.08 4.01 3.93 5/190 11947
/proc/meminfo: memFree=6313972/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3118112 CPUtime=882.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 789054 0 0 0 88139 93 0 0 25 0 1 0 472069165 3192946688 749158 33554432000 4194304 4210924 140733929201232 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779528 749158 104 5 0 777999 0
Current children cumulated CPU time (s) 882.32
Current children cumulated vsize (KiB) 3118112

[startup+942.301 s]
/proc/loadavg: 4.03 4.01 3.93 5/190 11948
/proc/meminfo: memFree=6330112/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3118304 CPUtime=942.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 789151 0 0 0 94139 93 0 0 25 0 1 0 472069165 3193143296 749206 33554432000 4194304 4210924 140733929201232 18446744073709551615 4198585 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 779576 749206 104 5 0 778047 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 3118304

[startup+1002.3 s]
/proc/loadavg: 4.01 4.00 3.93 5/190 11950
/proc/meminfo: memFree=6503844/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2938748 CPUtime=1002.33 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 809170 0 0 0 100135 98 0 0 25 0 1 0 472069165 3009277952 704378 33554432000 4194304 4210924 140733929201232 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 734687 704378 104 5 0 733158 0
Current children cumulated CPU time (s) 1002.33
Current children cumulated vsize (KiB) 2938748

[startup+1062.3 s]
/proc/loadavg: 4.07 4.02 3.94 5/190 11952
/proc/meminfo: memFree=6492972/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2950572 CPUtime=1062.32 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 819726 0 0 0 106132 100 0 0 25 0 1 0 472069165 3021385728 707327 33554432000 4194304 4210924 140733929201232 18446744073709551615 4199396 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 737643 707327 104 5 0 736114 0
Current children cumulated CPU time (s) 1062.32
Current children cumulated vsize (KiB) 2950572

[startup+1122.31 s]
/proc/loadavg: 4.03 4.01 3.94 5/190 11953
/proc/meminfo: memFree=6503056/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2952268 CPUtime=1122.33 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 820222 0 0 0 112133 100 0 0 25 0 1 0 472069165 3023122432 707764 33554432000 4194304 4210924 140733929201232 18446744073709551615 4200055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 738067 707764 104 5 0 736538 0
Current children cumulated CPU time (s) 1122.33
Current children cumulated vsize (KiB) 2952268

[startup+1182.3 s]
/proc/loadavg: 4.01 4.00 3.94 5/190 11964
/proc/meminfo: memFree=6513000/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2952808 CPUtime=1182.33 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 820405 0 0 0 118133 100 0 0 25 0 1 0 472069165 3023675392 707886 33554432000 4194304 4210924 140733929201232 18446744073709551615 4207055 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 738202 707886 104 5 0 736673 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 2952808

[startup+1242.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/190 11965
/proc/meminfo: memFree=6543052/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=2954004 CPUtime=1242.33 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 820711 0 0 0 124133 100 0 0 25 0 1 0 472069165 3024900096 708186 33554432000 4194304 4210924 140733929201232 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 738501 708186 104 5 0 736972 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 2954004



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.92 3.98 3.93 4/185 11985
/proc/meminfo: memFree=8401224/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=3024576 CPUtime=1300.04 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4202496 860714 0 0 0 129897 107 0 0 25 0 1 0 472069165 3097165824 725818 33554432000 4194304 4210924 140733929201232 18446744073709551615 4206988 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/11862/statm: 756144 725818 104 5 0 754615 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 3024576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.11 s]
/proc/loadavg: 3.92 3.98 3.93 4/185 11985
/proc/meminfo: memFree=8401224/32951124 swapFree=67111528/67111528
[pid=11862] ppid=11860 vsize=0 CPUtime=1300.14 cores=0,2
/proc/11862/stat : 11862 (saturn) R 11860 11862 11320 0 -1 4203524 860714 0 0 0 129897 117 0 0 25 0 1 0 472069165 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/11862/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.14
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.14
CPU time (s): 1300.18
CPU user time (s): 1298.98
CPU system time (s): 1.19882
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 3118488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1298.98
system time used= 1.19882
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 860714
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 3498

runsolver used 2.21066 second user time and 4.88226 second system time

The end

Launcher Data 

Begin job on node142 at 2011-04-26 07:42:17
IDJOB=3291953
IDBENCH=85005
IDSOLVER=1583
FILE ID=node142/3291953-1303796532
RUNJOBID= node142-1303796532-11826
PBS_JOBID= 13157276
Free space on /tmp= 70952 MiB

SOLVER NAME= Black Hole SAT 2011-03-08
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
COMMAND LINE= saturn BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291953-1303796532/watcher-3291953-1303796532 -o /tmp/evaluation-result-3291953-1303796532/solver-3291953-1303796532 -C 2400 -W 1300 -M 7680  saturn HOME/instance-3291953-1303796532.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 776da55785376fd8eac6989ca812b102
RANDOM SEED=1188538368

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13447276 kB
Buffers:       2088220 kB
Cached:       15675276 kB
SwapCached:          0 kB
Active:        8681368 kB
Inactive:     10233540 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13447276 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          514812 kB
Writeback:           0 kB
AnonPages:     1150432 kB
Mapped:          91872 kB
Slab:           522408 kB
PageTables:       7484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1483160 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71092 MiB
End job on node142 at 2011-04-26 08:03:59