Trace number 237952

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.05 1806.26

General information on the benchmark

Namehaystacks/
haystacks_12.xml
MD5SUM498c0dcde5a4d383917d0f53f1b43c78
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.547916
SatisfiableNO
(Un)Satisfiability was proved
Number of variables144
Number of constraints803
Maximum constraint arity2
Maximum domain size12
Number of constraints which are defined in extension0
Number of constraints which are defined in intension803
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.36	c start processing
1.36	c start relation processing
1.36	c start cnf exporting
2.00	c parsing time : 1.18
2.00	c preprocessing time : 1.828
2.00	
2.00	c Nary constraints - conflicts : 0 supports : 0
2.00	c Binary constraints - conflicts : 792 supports :11
2.00	c max arity constraint : 2
2.00	c Max Tuples generated 144
2.00	c relations : 4
2.00	c relations BDD: 0
2.00	c vars : 1729 - clauses :  19658
2.00	
2.06	 
2.06	c --- Minisat Stats ---
2.06	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node1/watcher-237952-1168352376 -o ROOT/results/node1/solver-237952-1168352376 -C 1800 -M 900 /tmp/evaluation/237952-1168352376/galac.sh /tmp/evaluation/237952-1168352376/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.00 2.02 2.00 3/95 31032
/proc/meminfo: memFree=1143832/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=644 CPUtime=0
/proc/31031/stat : 31031 (galac.sh) R 31029 31031 29916 0 -1 4194304 19 0 0 0 0 0 0 0 20 0 1 0 183633387 659456 4 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259350596224 0 0 4096 0 0 0 0 17 1 0 0
/proc/31031/statm: 161 4 0 79 0 51 0

[startup+0.102815 s]
/proc/loadavg: 2.00 2.02 2.00 3/95 31032
/proc/meminfo: memFree=1143832/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=0.01
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47572

[startup+0.510864 s]
/proc/loadavg: 2.00 2.02 2.00 3/95 31032
/proc/meminfo: memFree=1143832/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=0.01
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47572

[startup+1.33396 s]
/proc/loadavg: 2.00 2.02 2.00 5/103 31052
/proc/meminfo: memFree=1065176/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=0.01
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31045] ppid=31031 vsize=860856 CPUtime=1.27
/proc/31045/stat : 31045 (java) S 31031 31031 29916 0 -1 0 11921 0 1 0 117 10 0 0 16 0 8 0 183633391 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/31045/statm: 215214 11672 1994 14 0 201471 0
[pid=31045/tid=31046] ppid=31031 vsize=860856 CPUtime=0.15
/proc/31045/task/31046/stat : 31046 (java) S 31031 31031 29916 0 -1 64 3365 0 0 0 13 2 0 0 16 0 8 0 183633395 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31047] ppid=31031 vsize=860856 CPUtime=0
/proc/31045/task/31047/stat : 31047 (java) S 31031 31031 29916 0 -1 64 12 0 0 0 0 0 0 0 15 0 8 0 183633396 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31048] ppid=31031 vsize=860856 CPUtime=0
/proc/31045/task/31048/stat : 31048 (java) S 31031 31031 29916 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 183633396 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31049] ppid=31031 vsize=860856 CPUtime=0
/proc/31045/task/31049/stat : 31049 (java) S 31031 31031 29916 0 -1 64 2 0 0 0 0 0 0 0 18 0 8 0 183633399 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31050] ppid=31031 vsize=860856 CPUtime=0.32
/proc/31045/task/31050/stat : 31050 (java) R 31031 31031 29916 0 -1 64 1049 0 0 0 31 1 0 0 22 0 8 0 183633399 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4153465364 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31051] ppid=31031 vsize=860856 CPUtime=0
/proc/31045/task/31051/stat : 31051 (java) S 31031 31031 29916 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 183633399 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=31045/tid=31052] ppid=31031 vsize=860856 CPUtime=0
/proc/31045/task/31052/stat : 31052 (java) S 31031 31031 29916 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 183633399 881516544 11672 18446744073709551615 134512640 134570532 4294956096 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 908428

[startup+2.97915 s]
/proc/loadavg: 2.00 2.02 2.00 3/96 31053
/proc/meminfo: memFree=1100816/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=7120 CPUtime=0.9
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 1508 0 0 0 90 0 0 0 25 0 1 0 183633594 7290880 1490 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529321 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 1780 1490 54 142 0 1636 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 54692

[startup+6.27654 s]
/proc/loadavg: 2.00 2.02 2.00 3/96 31055
/proc/meminfo: memFree=1094288/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=10892 CPUtime=4.18
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 2445 0 0 0 418 0 0 0 25 0 1 0 183633594 11153408 2427 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134527659 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 2723 2427 54 142 0 2579 0
Current children cumulated CPU time (s) 6.14
Current children cumulated vsize (KiB) 58464

[startup+12.7353 s]
/proc/loadavg: 2.00 2.02 2.00 3/96 31055
/proc/meminfo: memFree=1092248/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=12924 CPUtime=10.61
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 2911 0 0 0 1060 1 0 0 25 0 1 0 183633594 13234176 2893 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529450 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 3231 2893 54 142 0 3087 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 60496

[startup+25.5808 s]
/proc/loadavg: 2.00 2.02 2.00 3/96 31055
/proc/meminfo: memFree=1090072/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=15384 CPUtime=23.39
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 3492 0 0 0 2338 1 0 0 25 0 1 0 183633594 15753216 3474 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 3846 3474 54 142 0 3702 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 62956

[startup+51.2588 s]
/proc/loadavg: 2.00 2.01 2.00 3/96 31055
/proc/meminfo: memFree=1086808/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=18772 CPUtime=48.95
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 4303 0 0 0 4893 2 0 0 25 0 1 0 183633594 19222528 4285 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 4693 4285 54 142 0 4549 0
Current children cumulated CPU time (s) 50.91
Current children cumulated vsize (KiB) 66344

[startup+102.512 s]
/proc/loadavg: 2.00 2.01 2.00 3/96 31055
/proc/meminfo: memFree=1081944/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=23900 CPUtime=99.96
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 5516 0 0 0 9993 3 0 0 25 0 1 0 183633594 24473600 5498 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 5975 5498 54 142 0 5831 0
Current children cumulated CPU time (s) 101.92
Current children cumulated vsize (KiB) 71472

[startup+162.596 s]
/proc/loadavg: 2.00 2.00 2.00 3/96 31055
/proc/meminfo: memFree=1078104/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=28028 CPUtime=159.76
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 6457 0 0 0 15972 4 0 0 25 0 1 0 183633594 28700672 6439 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 7007 6439 54 142 0 6863 0
Current children cumulated CPU time (s) 161.72
Current children cumulated vsize (KiB) 75600

[startup+222.682 s]
/proc/loadavg: 2.00 2.00 2.00 3/96 31055
/proc/meminfo: memFree=1075032/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=31108 CPUtime=219.57
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 7175 0 0 0 21952 5 0 0 25 0 1 0 183633594 31854592 7157 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134526779 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 7777 7157 54 142 0 7633 0
Current children cumulated CPU time (s) 221.53
Current children cumulated vsize (KiB) 78680

[startup+282.762 s]
/proc/loadavg: 2.00 2.00 2.00 4/96 31055
/proc/meminfo: memFree=1071000/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=35452 CPUtime=279.36
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 8180 0 0 0 27930 6 0 0 25 0 1 0 183633594 36302848 8162 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529361 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 8863 8162 54 142 0 8719 0
Current children cumulated CPU time (s) 281.32
Current children cumulated vsize (KiB) 83024

[startup+342.846 s]
/proc/loadavg: 2.00 2.00 2.00 3/96 31055
/proc/meminfo: memFree=1067288/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=39304 CPUtime=339.17
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 9082 0 0 0 33909 8 0 0 25 0 1 0 183633594 40247296 9064 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 9826 9064 54 142 0 9682 0
Current children cumulated CPU time (s) 341.13
Current children cumulated vsize (KiB) 86876

[startup+402.926 s]
/proc/loadavg: 2.00 2.00 2.00 3/96 31055
/proc/meminfo: memFree=1063896/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=42864 CPUtime=398.97
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 9903 0 0 0 39888 9 0 0 25 0 1 0 183633594 43892736 9885 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 10716 9885 54 142 0 10572 0
Current children cumulated CPU time (s) 400.93
Current children cumulated vsize (KiB) 90436

[startup+463.008 s]
/proc/loadavg: 2.00 2.00 2.00 3/96 31055
/proc/meminfo: memFree=1061464/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=45712 CPUtime=458.76
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 10521 0 0 0 45867 9 0 0 25 0 1 0 183633594 46809088 10503 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0

################
# More data... #
################

/proc/loadavg: 2.00 2.02 2.00 3/96 31055
/proc/meminfo: memFree=1047832/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=59932 CPUtime=1116.61
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 13723 0 0 0 111645 16 0 0 25 0 1 0 183633594 61370368 13705 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/31053/statm: 14983 13705 54 142 0 14839 0
Current children cumulated CPU time (s) 1118.57
Current children cumulated vsize (KiB) 107504

[startup+1183.97 s]
/proc/loadavg: 2.00 2.01 2.00 3/88 31346
/proc/meminfo: memFree=1772312/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=60736 CPUtime=1176.49
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 13877 0 0 0 117626 23 0 0 25 0 1 0 183633594 62193664 13859 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 15184 13859 54 142 0 15040 0
Current children cumulated CPU time (s) 1178.45
Current children cumulated vsize (KiB) 108308

[startup+1243.99 s]
/proc/loadavg: 2.03 2.02 2.00 3/88 31346
/proc/meminfo: memFree=1769368/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=63724 CPUtime=1236.45
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 14637 0 0 0 123620 25 0 0 25 0 1 0 183633594 65253376 14619 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 15931 14619 54 142 0 15787 0
Current children cumulated CPU time (s) 1238.41
Current children cumulated vsize (KiB) 111296

[startup+1304 s]
/proc/loadavg: 2.01 2.02 2.00 3/88 31346
/proc/meminfo: memFree=1768536/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=64528 CPUtime=1296.37
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 14836 0 0 0 129612 25 0 0 25 0 1 0 183633594 66076672 14816 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 16132 14816 54 142 0 15988 0
Current children cumulated CPU time (s) 1298.33
Current children cumulated vsize (KiB) 112100

[startup+1364 s]
/proc/loadavg: 2.00 2.01 2.00 3/88 31346
/proc/meminfo: memFree=1768472/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=64584 CPUtime=1356.32
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 14846 0 0 0 135607 25 0 0 25 0 1 0 183633594 66134016 14820 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529414 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 16146 14820 54 142 0 16002 0
Current children cumulated CPU time (s) 1358.28
Current children cumulated vsize (KiB) 112156

[startup+1424.01 s]
/proc/loadavg: 2.00 2.01 2.00 3/88 31346
/proc/meminfo: memFree=1767128/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=66228 CPUtime=1416.28
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 15204 0 0 0 141603 25 0 0 25 0 1 0 183633594 67817472 15178 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 16557 15178 54 142 0 16413 0
Current children cumulated CPU time (s) 1418.24
Current children cumulated vsize (KiB) 113800

[startup+1484.02 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 31346
/proc/meminfo: memFree=1765720/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=67620 CPUtime=1476.21
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 15500 0 0 0 147595 26 0 0 25 0 1 0 183633594 69242880 15474 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 16905 15474 54 142 0 16761 0
Current children cumulated CPU time (s) 1478.17
Current children cumulated vsize (KiB) 115192

[startup+1544.03 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 31346
/proc/meminfo: memFree=1765080/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=68344 CPUtime=1536.16
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 15654 0 0 0 153590 26 0 0 25 0 1 0 183633594 69984256 15628 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17086 15628 54 142 0 16942 0
Current children cumulated CPU time (s) 1538.12
Current children cumulated vsize (KiB) 115916

[startup+1604.04 s]
/proc/loadavg: 2.00 2.00 2.00 3/88 31346
/proc/meminfo: memFree=1764120/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=69360 CPUtime=1596.13
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 15864 0 0 0 159586 27 0 0 25 0 1 0 183633594 71024640 15838 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529492 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17340 15838 54 142 0 17196 0
Current children cumulated CPU time (s) 1598.09
Current children cumulated vsize (KiB) 116932

[startup+1664.06 s]
/proc/loadavg: 2.10 2.03 2.01 3/88 31346
/proc/meminfo: memFree=1763416/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=70124 CPUtime=1656.05
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 16036 0 0 0 165578 27 0 0 25 0 1 0 183633594 71806976 16010 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17531 16010 54 142 0 17387 0
Current children cumulated CPU time (s) 1658.01
Current children cumulated vsize (KiB) 117696

[startup+1724.07 s]
/proc/loadavg: 2.03 2.02 2.00 3/88 31346
/proc/meminfo: memFree=1762904/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=70660 CPUtime=1716.01
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 16156 0 0 0 171574 27 0 0 25 0 1 0 183633594 72355840 16130 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529382 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17665 16130 54 142 0 17521 0
Current children cumulated CPU time (s) 1717.97
Current children cumulated vsize (KiB) 118232

[startup+1784.08 s]
/proc/loadavg: 2.01 2.02 2.00 3/88 31346
/proc/meminfo: memFree=1762264/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=71284 CPUtime=1775.96
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 16290 0 0 0 177569 27 0 0 25 0 1 0 183633594 72994816 16264 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17821 16264 54 142 0 17677 0
Current children cumulated CPU time (s) 1777.92
Current children cumulated vsize (KiB) 118856



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1806.24 s]
/proc/loadavg: 2.01 2.01 2.00 3/88 31346
/proc/meminfo: memFree=1761752/2055920 swapFree=4165612/4192956
[pid=31031] ppid=31029 vsize=47572 CPUtime=1.96
/proc/31031/stat : 31031 (galac.sh) S 31029 31031 29916 0 -1 4194304 799 20289 0 1 0 0 179 17 17 0 1 0 183633387 48713728 363 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 259352882010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/31031/statm: 11893 363 245 79 0 218 0
[pid=31053] ppid=31031 vsize=71692 CPUtime=1798.09
/proc/31053/stat : 31053 (minisat) R 31031 31031 29916 0 -1 4194304 16400 0 0 0 179782 27 0 0 25 0 1 0 183633594 73412608 16374 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/31053/statm: 17923 16374 54 142 0 17779 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 119264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 31031 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=804725 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=184971
CPU time returned by wait4() is 1.9897
while last known CPU time is 1800.05

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1806.26
CPU time (s): 1800.05
CPU user time (s): 1799.61
CPU system time (s): 0.44
CPU usage (%): 99.6562
Max. virtual memory (cumulated for all children) (KiB): 908560

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.80472
system time used= 0.184971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21088
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1076
involuntary context switches= 1041

runsolver used 1.89771 s user time and 5.53516 s system time

The end

Launcher Data (download as text)

Begin job on node1 on Tue Jan  9 14:19:36 UTC 2007


IDJOB= 237952
IDBENCH= 6973
FILE ID= node1/237952-1168352376

PBS_JOBID= 3503680

Free space on /tmp= 66503 MiB

BENCH NAME= HOME/pub/bench/CPAI06/haystacks/haystacks_12.xml
COMMAND LINE= /tmp/evaluation/237952-1168352376/galac.sh /tmp/evaluation/237952-1168352376/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node1/watcher-237952-1168352376 -o ROOT/results/node1/solver-237952-1168352376 -C 1800 -M 900  /tmp/evaluation/237952-1168352376/galac.sh /tmp/evaluation/237952-1168352376/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  498c0dcde5a4d383917d0f53f1b43c78

RANDOM SEED= 479840973

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.234
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1144248 kB
Buffers:         17572 kB
Cached:         103280 kB
SwapCached:       4064 kB
Active:         780884 kB
Inactive:        71712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1144248 kB
SwapTotal:     4192956 kB
SwapFree:      4165612 kB
Dirty:            2948 kB
Writeback:           0 kB
Mapped:         750320 kB
Slab:            42260 kB
Committed_AS:  6606104 kB
PageTables:       3792 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66510 MiB



End job on node1 on Tue Jan  9 14:49:43 UTC 2007