Trace number 199603

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.01 1810.27

General information on the benchmark

Namerandom/rand-2-23/
rand-23-23-253-131-53021_ext.xml
MD5SUM5fed53841b4b437c3c9731d111aa34a3
Bench Category2-ARY-EXT (binary constraints in extension)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark14.1279
SatisfiableYES
(Un)Satisfiability was provedYES
Number of variables23
Number of constraints253
Maximum constraint arity2
Maximum domain size23
Number of constraints which are defined in extension253
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
0.98	c start processing
0.98	c start relation processing
0.99	c start cnf exporting
2.07	c parsing time : 0.811
2.07	c preprocessing time : 1.901
2.07	
2.07	c Nary constraints - conflicts : 0 supports : 0
2.07	c Binary constraints - conflicts : 253 supports :0
2.07	c max arity constraint : 2
2.07	c Max Tuples generated 0
2.07	c relations : 253
2.07	c relations BDD: 0
2.07	c vars : 530 - clauses :  38985
2.07	
2.11	 
2.11	c --- Minisat Stats ---
2.11	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node2/watcher-199603-1168135249 -o ROOT/results/node2/solver-199603-1168135249 -C 1800 -M 900 /tmp/evaluation/199603-1168135249/galac.sh /tmp/evaluation/199603-1168135249/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.08 2.02 2.01 3/98 26395
/proc/meminfo: memFree=961216/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=552 CPUtime=0
/proc/26394/stat : 26394 (galac.sh) R 26392 26394 26193 0 -1 4194304 18 0 0 0 0 0 0 0 20 0 1 0 161920588 565248 3 18446744073709551615 0 0 548682070041 18446744073709551615 206381313319 0 0 4096 0 0 0 0 17 1 0 0
/proc/26394/statm: 138 3 0 0 0 51 0

[startup+0.102684 s]
/proc/loadavg: 2.08 2.02 2.01 3/98 26395
/proc/meminfo: memFree=961216/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=0.01
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+0.514756 s]
/proc/loadavg: 2.08 2.02 2.01 3/98 26395
/proc/meminfo: memFree=961216/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=0.01
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+1.34091 s]
/proc/loadavg: 2.08 2.02 2.01 4/106 26415
/proc/meminfo: memFree=890432/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=0.01
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 762 1704 0 0 0 0 0 1 18 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26408] ppid=26394 vsize=861064 CPUtime=1.27
/proc/26408/stat : 26408 (java) R 26394 26394 26193 0 -1 0 19697 0 1 0 117 10 0 0 18 0 8 0 161920592 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4154989283 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/26408/statm: 215266 19451 1988 14 0 201471 0
[pid=26408/tid=26409] ppid=26394 vsize=861064 CPUtime=0.03
/proc/26408/task/26409/stat : 26409 (java) S 26394 26394 26193 0 -1 64 3785 0 0 0 2 1 0 0 16 0 8 0 161920596 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26410] ppid=26394 vsize=861064 CPUtime=0
/proc/26408/task/26410/stat : 26410 (java) S 26394 26394 26193 0 -1 64 11 0 0 0 0 0 0 0 16 0 8 0 161920596 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26411] ppid=26394 vsize=861064 CPUtime=0
/proc/26408/task/26411/stat : 26411 (java) S 26394 26394 26193 0 -1 64 4 0 0 0 0 0 0 0 20 0 8 0 161920597 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26412] ppid=26394 vsize=861064 CPUtime=0
/proc/26408/task/26412/stat : 26412 (java) S 26394 26394 26193 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 161920600 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26413] ppid=26394 vsize=861064 CPUtime=0.28
/proc/26408/task/26413/stat : 26413 (java) R 26394 26394 26193 0 -1 64 1012 0 0 0 27 1 0 0 20 0 8 0 161920600 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26414] ppid=26394 vsize=861064 CPUtime=0
/proc/26408/task/26414/stat : 26414 (java) S 26394 26394 26193 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 161920600 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=26408/tid=26415] ppid=26394 vsize=861064 CPUtime=0
/proc/26408/task/26415/stat : 26415 (java) S 26394 26394 26193 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 161920600 881729536 19451 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 908620

[startup+2.97821 s]
/proc/loadavg: 2.08 2.02 2.01 3/99 26416
/proc/meminfo: memFree=957240/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=6224 CPUtime=0.84
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 1311 0 0 0 84 0 0 0 25 0 1 0 161920800 6373376 1293 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 1556 1293 54 142 0 1412 0
Current children cumulated CPU time (s) 2.88
Current children cumulated vsize (KiB) 53780

[startup+6.26882 s]
/proc/loadavg: 2.07 2.02 2.00 3/99 26416
/proc/meminfo: memFree=951544/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=10188 CPUtime=4.1
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 2300 0 0 0 409 1 0 0 25 0 1 0 161920800 10432512 2282 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529304 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 2547 2282 54 142 0 2403 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 57744

[startup+12.756 s]
/proc/loadavg: 2.07 2.02 2.00 3/105 26442
/proc/meminfo: memFree=945528/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=14552 CPUtime=10.49
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 3401 0 0 0 1047 2 0 0 25 0 1 0 161920800 14901248 3383 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 3638 3383 54 142 0 3494 0
Current children cumulated CPU time (s) 12.53
Current children cumulated vsize (KiB) 62108

[startup+25.6264 s]
/proc/loadavg: 2.05 2.01 2.00 3/105 26490
/proc/meminfo: memFree=940000/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=20280 CPUtime=23.2
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 4836 0 0 0 2316 4 0 0 25 0 1 0 161920800 20766720 4818 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529444 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 5070 4818 54 142 0 4926 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 67836

[startup+51.2809 s]
/proc/loadavg: 2.03 2.01 2.00 3/105 26552
/proc/meminfo: memFree=905144/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=24712 CPUtime=48.47
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 5899 0 0 0 4842 5 0 0 25 0 1 0 161920800 25305088 5881 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134525917 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 6178 5881 54 142 0 6034 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 72268

[startup+102.531 s]
/proc/loadavg: 2.01 2.01 2.00 3/105 26592
/proc/meminfo: memFree=904768/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=25288 CPUtime=99.13
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 6031 0 0 0 9908 5 0 0 25 0 1 0 161920800 25894912 6013 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 6322 6013 54 142 0 6178 0
Current children cumulated CPU time (s) 101.17
Current children cumulated vsize (KiB) 72844

[startup+162.561 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26614
/proc/meminfo: memFree=870200/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=30964 CPUtime=158.55
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 7433 0 0 0 15848 7 0 0 25 0 1 0 161920800 31707136 7415 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529321 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 7741 7415 54 142 0 7597 0
Current children cumulated CPU time (s) 160.59
Current children cumulated vsize (KiB) 78520

[startup+222.563 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26614
/proc/meminfo: memFree=867128/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=34016 CPUtime=218.27
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 8199 0 0 0 21819 8 0 0 25 0 1 0 161920800 34832384 8181 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 8504 8181 54 142 0 8360 0
Current children cumulated CPU time (s) 220.31
Current children cumulated vsize (KiB) 81572

[startup+282.632 s]
/proc/loadavg: 2.07 2.02 2.00 3/99 26614
/proc/meminfo: memFree=831032/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=39672 CPUtime=278.05
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 9578 0 0 0 27796 9 0 0 25 0 1 0 161920800 40624128 9560 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 9918 9560 54 142 0 9774 0
Current children cumulated CPU time (s) 280.09
Current children cumulated vsize (KiB) 87228

[startup+342.704 s]
/proc/loadavg: 2.02 2.01 2.00 3/99 26614
/proc/meminfo: memFree=801336/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=40152 CPUtime=337.81
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 9653 0 0 0 33772 9 0 0 25 0 1 0 161920800 41115648 9635 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 10038 9635 54 142 0 9894 0
Current children cumulated CPU time (s) 339.85
Current children cumulated vsize (KiB) 87708

[startup+402.77 s]
/proc/loadavg: 2.01 2.00 2.00 3/99 26614
/proc/meminfo: memFree=798712/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=42704 CPUtime=397.6
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 10293 0 0 0 39749 11 0 0 25 0 1 0 161920800 43728896 10275 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 10676 10275 54 142 0 10532 0
Current children cumulated CPU time (s) 399.64
Current children cumulated vsize (KiB) 90260

[startup+462.829 s]
/proc/loadavg: 2.10 2.03 2.01 3/99 26614
/proc/meminfo: memFree=764536/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=47828 CPUtime=457.28
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 11553 0 0 0 45716 12 0 0 25 0 1 0 161920800 48975872 11535 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0

################
# More data... #
################

/proc/loadavg: 2.00 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1337656/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=55740 CPUtime=1114.64
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 13483 0 0 0 111446 18 0 0 25 0 1 0 161920800 57077760 13465 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 13935 13465 54 142 0 13791 0
Current children cumulated CPU time (s) 1116.68
Current children cumulated vsize (KiB) 103296

[startup+1183.62 s]
/proc/loadavg: 2.07 2.02 2.00 3/99 26671
/proc/meminfo: memFree=1298360/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=56084 CPUtime=1174.43
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 13554 0 0 0 117424 19 0 0 25 0 1 0 161920800 57430016 13536 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 14021 13536 54 142 0 13877 0
Current children cumulated CPU time (s) 1176.47
Current children cumulated vsize (KiB) 103640

[startup+1243.69 s]
/proc/loadavg: 2.02 2.01 2.00 3/99 26671
/proc/meminfo: memFree=1297720/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=56960 CPUtime=1234.21
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 13729 0 0 0 123402 19 0 0 25 0 1 0 161920800 58327040 13711 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 14240 13711 54 142 0 14096 0
Current children cumulated CPU time (s) 1236.25
Current children cumulated vsize (KiB) 104516

[startup+1303.77 s]
/proc/loadavg: 2.01 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1291896/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=62852 CPUtime=1294.01
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15194 0 0 0 129379 22 0 0 25 0 1 0 161920800 64360448 15176 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 15713 15176 54 142 0 15569 0
Current children cumulated CPU time (s) 1296.05
Current children cumulated vsize (KiB) 110408

[startup+1363.84 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1290296/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=64112 CPUtime=1353.78
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15539 0 0 0 135356 22 0 0 25 0 1 0 161920800 65650688 15521 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 16028 15521 54 142 0 15884 0
Current children cumulated CPU time (s) 1355.82
Current children cumulated vsize (KiB) 111668

[startup+1423.91 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1289848/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=64668 CPUtime=1413.57
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15644 0 0 0 141334 23 0 0 25 0 1 0 161920800 66220032 15626 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 16167 15626 54 142 0 16023 0
Current children cumulated CPU time (s) 1415.61
Current children cumulated vsize (KiB) 112224

[startup+1483.97 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1289464/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=65120 CPUtime=1473.33
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15741 0 0 0 147310 23 0 0 25 0 1 0 161920800 66682880 15723 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 16280 15723 54 142 0 16136 0
Current children cumulated CPU time (s) 1475.37
Current children cumulated vsize (KiB) 112676

[startup+1544.03 s]
/proc/loadavg: 2.00 2.00 2.00 3/99 26671
/proc/meminfo: memFree=1289208/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=65428 CPUtime=1533.12
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15801 0 0 0 153288 24 0 0 25 0 1 0 161920800 66998272 15783 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/26416/statm: 16357 15783 54 142 0 16213 0
Current children cumulated CPU time (s) 1535.16
Current children cumulated vsize (KiB) 112984

[startup+1604.1 s]
/proc/loadavg: 2.03 2.01 2.00 3/99 26671
/proc/meminfo: memFree=1221176/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=65572 CPUtime=1592.79
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15828 0 0 0 159255 24 0 0 25 0 1 0 161920800 67145728 15810 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134526779 0 0 4096 3 0 0 0 17 0 0 0
/proc/26416/statm: 16393 15810 54 142 0 16249 0
Current children cumulated CPU time (s) 1594.83
Current children cumulated vsize (KiB) 113128

[startup+1664.16 s]
/proc/loadavg: 2.08 2.02 2.00 3/99 26671
/proc/meminfo: memFree=1221176/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=65572 CPUtime=1652.58
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15830 0 0 0 165234 24 0 0 25 0 1 0 161920800 67145728 15812 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 0 0 0
/proc/26416/statm: 16393 15812 54 142 0 16249 0
Current children cumulated CPU time (s) 1654.62
Current children cumulated vsize (KiB) 113128

[startup+1724.22 s]
/proc/loadavg: 2.03 2.02 2.00 3/99 26671
/proc/meminfo: memFree=1221048/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=65572 CPUtime=1712.34
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 15831 0 0 0 171210 24 0 0 25 0 1 0 161920800 67145728 15813 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134526976 0 0 4096 3 0 0 0 17 0 0 0
/proc/26416/statm: 16393 15813 54 142 0 16249 0
Current children cumulated CPU time (s) 1714.38
Current children cumulated vsize (KiB) 113128

[startup+1784.28 s]
/proc/loadavg: 2.01 2.01 2.00 3/99 26671
/proc/meminfo: memFree=1219704/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=66900 CPUtime=1772.13
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 16165 0 0 0 177188 25 0 0 25 0 1 0 161920800 68505600 16147 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 0 0 0
/proc/26416/statm: 16725 16147 54 142 0 16581 0
Current children cumulated CPU time (s) 1774.17
Current children cumulated vsize (KiB) 114456



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1810.26 s]
/proc/loadavg: 2.00 2.01 2.00 3/99 26671
/proc/meminfo: memFree=1219640/2055920 swapFree=4191880/4192956
[pid=26394] ppid=26392 vsize=47556 CPUtime=2.04
/proc/26394/stat : 26394 (galac.sh) S 26392 26394 26193 0 -1 4194304 800 22836 0 1 0 0 190 14 17 0 1 0 161920588 48697344 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 206380919642 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/26394/statm: 11889 363 245 79 0 218 0
[pid=26416] ppid=26394 vsize=66900 CPUtime=1797.97
/proc/26416/stat : 26416 (minisat) R 26394 26394 26193 0 -1 4194304 16178 0 0 0 179772 25 0 0 25 0 1 0 161920800 68505600 16160 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134525757 0 0 4096 3 0 0 0 17 0 0 0
/proc/26416/statm: 16725 16160 54 142 0 16581 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 114456

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 26394 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=907709 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=152976
CPU time returned by wait4() is 2.06069
while last known CPU time is 1800.01

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1810.27
CPU time (s): 1800.01
CPU user time (s): 1799.62
CPU system time (s): 0.39
CPU usage (%): 99.4331
Max. virtual memory (cumulated for all children) (KiB): 908620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.90771
system time used= 0.152976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23636
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 835
involuntary context switches= 826

runsolver used 1.79873 s user time and 5.03823 s system time

The end

Launcher Data (download as text)

Begin job on node2 on Sun Jan  7 02:00:49 UTC 2007


IDJOB= 199603
IDBENCH= 3628
FILE ID= node2/199603-1168135249

PBS_JOBID= 3477777

Free space on /tmp= 66322 MiB

BENCH NAME= HOME/pub/bench/CPAI06/random/rand-2-23/rand-23-23-253-131-53021_ext.xml
COMMAND LINE= /tmp/evaluation/199603-1168135249/galac.sh /tmp/evaluation/199603-1168135249/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node2/watcher-199603-1168135249 -o ROOT/results/node2/solver-199603-1168135249 -C 1800 -M 900  /tmp/evaluation/199603-1168135249/galac.sh /tmp/evaluation/199603-1168135249/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  5fed53841b4b437c3c9731d111aa34a3

RANDOM SEED= 638278308

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.259
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        961696 kB
Buffers:         59900 kB
Cached:         421568 kB
SwapCached:        448 kB
Active:         776832 kB
Inactive:       258788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        961696 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            3052 kB
Writeback:           0 kB
Mapped:         582756 kB
Slab:            42328 kB
Committed_AS:  4563424 kB
PageTables:       3396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66321 MiB



End job on node2 on Sun Jan  7 02:31:00 UTC 2007