Trace number 238032

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800 1812.65

General information on the benchmark

Namehaystacks/
haystacks_21.xml
MD5SUMf7604e5d4a195ac07a94a60497bb2137
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark7.44587
SatisfiableNO
(Un)Satisfiability was proved
Number of variables441
Number of constraints4430
Maximum constraint arity2
Maximum domain size21
Number of constraints which are defined in extension0
Number of constraints which are defined in intension4430
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
2.52	c start processing
2.52	c start relation processing
2.52	c start cnf exporting
6.74	c parsing time : 2.355
6.74	c preprocessing time : 6.574
6.74	
6.74	c Nary constraints - conflicts : 0 supports : 0
6.74	c Binary constraints - conflicts : 4410 supports :20
6.74	c max arity constraint : 2
6.74	c Max Tuples generated 441
6.74	c relations : 4
6.74	c relations BDD: 0
6.74	c vars : 9262 - clauses :  187301
6.74	
6.80	 
6.80	c --- Minisat Stats ---
6.80

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node10/watcher-238032-1168352867 -o ROOT/results/node10/solver-238032-1168352867 -C 1800 -M 900 /tmp/evaluation/238032-1168352867/galac.sh /tmp/evaluation/238032-1168352867/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.33 2.10 2.03 5/94 20574
/proc/meminfo: memFree=1808080/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=5184 CPUtime=0
/proc/20573/stat : 20573 (galac.sh) R 20571 20573 19914 0 -1 4194304 95 0 0 0 0 0 0 0 20 0 1 0 183681845 5308416 68 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919445184 0 0 4096 0 0 0 0 17 1 0 0
/proc/20573/statm: 1296 68 51 79 0 106 0

[startup+0.104324 s]
/proc/loadavg: 2.33 2.10 2.03 5/94 20574
/proc/meminfo: memFree=1808080/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=0.01
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+0.51438 s]
/proc/loadavg: 2.33 2.10 2.03 5/94 20574
/proc/meminfo: memFree=1808080/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=0.01
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+1.33549 s]
/proc/loadavg: 2.30 2.10 2.03 3/102 20594
/proc/meminfo: memFree=1768464/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=0.01
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20587] ppid=20573 vsize=861196 CPUtime=1.27
/proc/20587/stat : 20587 (java) R 20573 20573 19914 0 -1 0 11978 0 1 0 120 7 0 0 17 0 8 0 183681848 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4073458715 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20587/statm: 215299 11729 1994 14 0 201504 0
[pid=20587/tid=20588] ppid=20573 vsize=861196 CPUtime=0.12
/proc/20587/task/20588/stat : 20588 (java) S 20573 20573 19914 0 -1 64 3384 0 0 0 11 1 0 0 16 0 8 0 183681852 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20589] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20589/stat : 20589 (java) S 20573 20573 19914 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 183681853 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20590] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20590/stat : 20590 (java) S 20573 20573 19914 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 183681853 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20591] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20591/stat : 20591 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 183681856 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20592] ppid=20573 vsize=861196 CPUtime=0.3
/proc/20587/task/20592/stat : 20592 (java) R 20573 20573 19914 0 -1 64 1050 0 0 0 29 1 0 0 21 0 8 0 183681856 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20593] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20593/stat : 20593 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 183681856 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20594] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20594/stat : 20594 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 183681856 881864704 11729 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 908772

[startup+2.97271 s]
/proc/loadavg: 2.30 2.10 2.03 3/102 20594
/proc/meminfo: memFree=1746768/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=0.01
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20587] ppid=20573 vsize=861196 CPUtime=2.89
/proc/20587/stat : 20587 (java) R 20573 20573 19914 0 -1 0 19615 0 2 0 277 12 0 0 25 0 8 0 183681848 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4074325988 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20587/statm: 215299 19365 2014 14 0 201504 0
[pid=20587/tid=20588] ppid=20573 vsize=861196 CPUtime=0.12
/proc/20587/task/20588/stat : 20588 (java) S 20573 20573 19914 0 -1 64 3528 0 0 0 11 1 0 0 16 0 8 0 183681852 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20589] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20589/stat : 20589 (java) S 20573 20573 19914 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 183681853 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20590] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20590/stat : 20590 (java) S 20573 20573 19914 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 183681853 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20591] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20591/stat : 20591 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 183681856 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20592] ppid=20573 vsize=861196 CPUtime=0.38
/proc/20587/task/20592/stat : 20592 (java) S 20573 20573 19914 0 -1 64 1119 0 0 0 37 1 0 0 16 0 8 0 183681856 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20593] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20593/stat : 20593 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 183681856 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20594] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20594/stat : 20594 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 183681856 881864704 19365 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 2.9
Current children cumulated vsize (KiB) 908772

[startup+6.27473 s]
/proc/loadavg: 2.28 2.10 2.03 3/102 20594
/proc/meminfo: memFree=1734992/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=0.01
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 761 1704 0 0 0 0 0 1 24 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20587] ppid=20573 vsize=861196 CPUtime=6.14
/proc/20587/stat : 20587 (java) R 20573 20573 19914 0 -1 0 19764 0 2 0 601 13 0 0 25 0 8 0 183681848 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4074334802 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20587/statm: 215299 19508 2016 14 0 201504 0
[pid=20587/tid=20588] ppid=20573 vsize=861196 CPUtime=0.14
/proc/20587/task/20588/stat : 20588 (java) S 20573 20573 19914 0 -1 64 3663 0 0 0 13 1 0 0 16 0 8 0 183681852 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20589] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20589/stat : 20589 (java) S 20573 20573 19914 0 -1 64 12 0 0 0 0 0 0 0 16 0 8 0 183681853 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20590] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20590/stat : 20590 (java) S 20573 20573 19914 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 183681853 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20591] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20591/stat : 20591 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 183681856 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20592] ppid=20573 vsize=861196 CPUtime=0.39
/proc/20587/task/20592/stat : 20592 (java) S 20573 20573 19914 0 -1 64 1125 0 0 0 38 1 0 0 16 0 8 0 183681856 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20593] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20593/stat : 20593 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 183681856 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20587/tid=20594] ppid=20573 vsize=861196 CPUtime=0
/proc/20587/task/20594/stat : 20594 (java) S 20573 20573 19914 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 183681856 881864704 19508 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 908772

[startup+12.7597 s]
/proc/loadavg: 2.25 2.10 2.03 3/95 20595
/proc/meminfo: memFree=1765896/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=40504 CPUtime=5.89
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 9957 0 0 0 584 5 0 0 25 0 1 0 183682525 41476096 9939 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529461 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 10126 9939 54 142 0 9982 0
Current children cumulated CPU time (s) 12.53
Current children cumulated vsize (KiB) 88080

[startup+25.6554 s]
/proc/loadavg: 2.21 2.09 2.03 3/95 20595
/proc/meminfo: memFree=1744456/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=61560 CPUtime=18.67
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 15194 0 0 0 1859 8 0 0 25 0 1 0 183682525 63037440 15176 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 15390 15176 54 142 0 15246 0
Current children cumulated CPU time (s) 25.31
Current children cumulated vsize (KiB) 109136

[startup+51.313 s]
/proc/loadavg: 2.13 2.08 2.02 3/95 20595
/proc/meminfo: memFree=1718856/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=87304 CPUtime=44.09
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 21567 0 0 0 4396 13 0 0 25 0 1 0 183682525 89399296 21549 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 21826 21549 54 142 0 21682 0
Current children cumulated CPU time (s) 50.73
Current children cumulated vsize (KiB) 134880

[startup+102.514 s]
/proc/loadavg: 2.05 2.07 2.02 3/95 20595
/proc/meminfo: memFree=1654536/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=151992 CPUtime=94.82
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 37613 0 0 0 9458 24 0 0 25 0 1 0 183682525 155639808 37595 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 37998 37595 54 142 0 37854 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 199568

[startup+162.578 s]
/proc/loadavg: 2.10 2.07 2.02 3/95 20595
/proc/meminfo: memFree=1614920/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=192292 CPUtime=154.33
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 47479 0 0 0 15400 33 0 0 25 0 1 0 183682525 196907008 47461 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 48073 47461 54 142 0 47929 0
Current children cumulated CPU time (s) 160.97
Current children cumulated vsize (KiB) 239868

[startup+222.646 s]
/proc/loadavg: 2.03 2.05 2.01 3/95 20595
/proc/meminfo: memFree=1596104/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=211316 CPUtime=213.86
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 52119 0 0 0 21348 38 0 0 25 0 1 0 183682525 216387584 52101 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 52829 52101 54 142 0 52685 0
Current children cumulated CPU time (s) 220.5
Current children cumulated vsize (KiB) 258892

[startup+282.667 s]
/proc/loadavg: 2.09 2.06 2.01 3/95 20595
/proc/meminfo: memFree=1587784/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=219600 CPUtime=273.34
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 54195 0 0 0 27293 41 0 0 25 0 1 0 183682525 224870400 54177 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 54900 54177 54 142 0 54756 0
Current children cumulated CPU time (s) 279.98
Current children cumulated vsize (KiB) 267176

[startup+342.754 s]
/proc/loadavg: 2.07 2.06 2.01 3/95 20595
/proc/meminfo: memFree=1580232/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64

################
# More data... #
################

/proc/loadavg: 2.04 2.02 2.00 3/95 20595
/proc/meminfo: memFree=1529224/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=278420 CPUtime=1106.69
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 68581 0 0 0 110611 58 0 0 25 0 1 0 183682525 285102080 68563 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 69605 68563 54 142 0 69461 0
Current children cumulated CPU time (s) 1113.33
Current children cumulated vsize (KiB) 325996

[startup+1183.76 s]
/proc/loadavg: 2.01 2.01 2.00 3/95 20595
/proc/meminfo: memFree=1522312/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=285428 CPUtime=1166.2
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 70279 0 0 0 116559 61 0 0 25 0 1 0 183682525 292278272 70261 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 71357 70261 54 142 0 71213 0
Current children cumulated CPU time (s) 1172.84
Current children cumulated vsize (KiB) 333004

[startup+1243.82 s]
/proc/loadavg: 2.00 2.01 2.00 3/95 20595
/proc/meminfo: memFree=1515720/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=292168 CPUtime=1225.72
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 71907 0 0 0 122509 63 0 0 25 0 1 0 183682525 299180032 71889 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 73042 71889 54 142 0 72898 0
Current children cumulated CPU time (s) 1232.36
Current children cumulated vsize (KiB) 339744

[startup+1303.87 s]
/proc/loadavg: 2.00 2.00 2.00 3/95 20595
/proc/meminfo: memFree=1510280/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=297564 CPUtime=1285.23
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 73237 0 0 0 128458 65 0 0 25 0 1 0 183682525 304705536 73219 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529435 0 0 4096 3 0 0 0 17 1 0 0
/proc/20595/statm: 74391 73219 54 142 0 74247 0
Current children cumulated CPU time (s) 1291.87
Current children cumulated vsize (KiB) 345140

[startup+1363.89 s]
/proc/loadavg: 1.92 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1495176/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=303308 CPUtime=1345.09
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 74644 0 0 0 134428 81 0 0 25 0 1 0 183682525 310587392 74626 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 75827 74626 54 142 0 75683 0
Current children cumulated CPU time (s) 1351.73
Current children cumulated vsize (KiB) 350884

[startup+1423.89 s]
/proc/loadavg: 1.97 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1490056/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=308252 CPUtime=1405.02
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 75873 0 0 0 140420 82 0 0 25 0 1 0 183682525 315650048 75855 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 77063 75855 54 142 0 76919 0
Current children cumulated CPU time (s) 1411.66
Current children cumulated vsize (KiB) 355828

[startup+1483.98 s]
/proc/loadavg: 1.99 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1485448/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=313172 CPUtime=1465.07
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 76996 0 0 0 146423 84 0 0 25 0 1 0 183682525 320688128 76978 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 78293 76978 54 142 0 78149 0
Current children cumulated CPU time (s) 1471.71
Current children cumulated vsize (KiB) 360748

[startup+1543.99 s]
/proc/loadavg: 1.99 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1480968/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=317832 CPUtime=1525
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 78115 0 0 0 152414 86 0 0 25 0 1 0 183682525 325459968 78097 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529453 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 79458 78097 54 142 0 79314 0
Current children cumulated CPU time (s) 1531.64
Current children cumulated vsize (KiB) 365408

[startup+1604.09 s]
/proc/loadavg: 1.99 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1473480/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=325400 CPUtime=1585.04
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 80008 0 0 0 158416 88 0 0 25 0 1 0 183682525 333209600 79982 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 81350 79982 54 142 0 81206 0
Current children cumulated CPU time (s) 1591.68
Current children cumulated vsize (KiB) 372976

[startup+1664.09 s]
/proc/loadavg: 1.99 1.97 1.99 3/95 21002
/proc/meminfo: memFree=1439312/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=360596 CPUtime=1644.98
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 88737 0 0 0 164404 94 0 0 25 0 1 0 183682525 369250304 88711 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529374 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 90149 88711 54 142 0 90005 0
Current children cumulated CPU time (s) 1651.62
Current children cumulated vsize (KiB) 408172

[startup+1724.17 s]
/proc/loadavg: 2.04 1.99 1.99 3/95 21002
/proc/meminfo: memFree=1389392/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=409468 CPUtime=1704.98
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 100922 0 0 0 170392 106 0 0 25 0 1 0 183682525 419295232 100896 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 102367 100896 54 142 0 102223 0
Current children cumulated CPU time (s) 1711.62
Current children cumulated vsize (KiB) 457044

[startup+1784.21 s]
/proc/loadavg: 2.01 1.99 1.99 3/95 21002
/proc/meminfo: memFree=1376912/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=421848 CPUtime=1764.97
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 104011 0 0 0 176388 109 0 0 25 0 1 0 183682525 431972352 103985 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 105462 103985 54 142 0 105318 0
Current children cumulated CPU time (s) 1771.61
Current children cumulated vsize (KiB) 469424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1812.63 s]
/proc/loadavg: 2.01 1.99 1.99 3/95 21002
/proc/meminfo: memFree=1376848/2055920 swapFree=4178216/4192956
[pid=20573] ppid=20571 vsize=47576 CPUtime=6.64
/proc/20573/stat : 20573 (galac.sh) S 20571 20573 19914 0 -1 4194304 799 21477 0 2 0 0 648 16 17 0 1 0 183681845 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 214919474010 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20573/statm: 11894 363 245 79 0 218 0
[pid=20595] ppid=20573 vsize=421848 CPUtime=1793.36
/proc/20595/stat : 20595 (minisat) R 20573 20573 19914 0 -1 4194304 104016 0 0 0 179227 109 0 0 25 0 1 0 183682525 431972352 103990 18446744073709551615 134512640 135096742 4294956480 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 0 0 0
/proc/20595/statm: 105462 103990 54 142 0 105318 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 469424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 20573 and gives childrusage.ru_utime.tv_sec=6 childrusage.ru_utime.tv_usec=490013 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=167974
CPU time returned by wait4() is 6.65799
while last known CPU time is 1800

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1812.65
CPU time (s): 1800
CPU user time (s): 1798.75
CPU system time (s): 1.25
CPU usage (%): 99.3024
Max. virtual memory (cumulated for all children) (KiB): 908772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.49001
system time used= 0.167974
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22276
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1428
involuntary context switches= 1506

runsolver used 2.18767 s user time and 5.72113 s system time

The end

Launcher Data (download as text)

Begin job on node10 on Tue Jan  9 14:27:47 UTC 2007


IDJOB= 238032
IDBENCH= 6978
FILE ID= node10/238032-1168352867

PBS_JOBID= 3503655

Free space on /tmp= 66559 MiB

BENCH NAME= HOME/pub/bench/CPAI06/haystacks/haystacks_21.xml
COMMAND LINE= /tmp/evaluation/238032-1168352867/galac.sh /tmp/evaluation/238032-1168352867/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node10/watcher-238032-1168352867 -o ROOT/results/node10/solver-238032-1168352867 -C 1800 -M 900  /tmp/evaluation/238032-1168352867/galac.sh /tmp/evaluation/238032-1168352867/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  f7604e5d4a195ac07a94a60497bb2137

RANDOM SEED= 461156847

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1808496 kB
Buffers:         41568 kB
Cached:          99452 kB
SwapCached:       2596 kB
Active:          98344 kB
Inactive:        93176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1808496 kB
SwapTotal:     4192956 kB
SwapFree:      4178216 kB
Dirty:            3388 kB
Writeback:           0 kB
Mapped:          67396 kB
Slab:            40680 kB
Committed_AS:  5214892 kB
PageTables:       2320 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66557 MiB



End job on node10 on Tue Jan  9 14:58:07 UTC 2007