Trace number 4407962

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.9 2520

General information on the benchmark

NameQRandom/QRandom-mdd-7-25-5-p7/
mdd-7-25-5-ps05-psh07-9.xml
MD5SUM2d7f03e466d78847960dc3f747db29ef
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark42.4013
Satisfiable
(Un)Satisfiability was proved
Number of variables25
Number of constraints58
Number of domains1
Minimum domain size5
Maximum domain size5
Distribution of domain sizes[{"size":5,"count":25}]
Minimum variable degree12
Maximum variable degree25
Distribution of variable degrees[{"degree":12,"count":1},{"degree":13,"count":3},{"degree":14,"count":6},{"degree":15,"count":2},{"degree":16,"count":3},{"degree":17,"count":4},{"degree":18,"count":1},{"degree":19,"count":1},{"degree":20,"count":2},{"degree":23,"count":1},{"degree":25,"count":1}]
Minimum constraint arity7
Maximum constraint arity7
Distribution of constraint arities[{"arity":7,"count":58}]
Number of extensional constraints58
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":58}]
Optimization problemNO
Type of objective

Solver Data 

14.20/14.27	c root propagations     : 0           
14.20/14.27	c restarts enabled, print stats at every restarts
14.20/14.27	c
14.20/14.27	c
14.20/14.27	c
14.20/14.27	c This is cosoco 2.00 --  
14.20/14.27	c
14.20/14.27	c command line: cosoco -lc -model -restarts -stick HOME/instance-4407962-1569794757.xml 
14.20/14.27	c ========================================[ Problem Statistics ]===========================================
14.20/14.27	c |                                                                                                       
14.20/14.27	c |  Parse time        :        14.12 s 
14.20/14.27	c |
14.20/14.27	c |               Variables: 25
14.20/14.27	c |            Domain Sizes: 5..5
14.20/14.27	c |
14.20/14.27	c |             Constraints: 58
14.20/14.27	c |                   Arity: 7..7
14.20/14.27	c | 
14.20/14.27	c |                   Types: 
14.20/14.27	c |                          Extension: 58  (nb tuples: 38458..39560) -- (shared: 0)
14.20/14.27	c |                          
14.20/14.27	c =========================================================================================================
14.20/14.27	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
16.08/16.20	c 101            234            14611          5463           0              0              7   14   9     
19.08/19.12	c 211            483            32357          11533          0              0              6   12   8     
21.98/22.04	c 332            737            49181          17589          0              0              5   12   8     
26.49/26.53	c 465            1040           72083          25471          0              0              5   11   7     
29.49/29.59	c 611            1351           93960          33316          0              0              6   11   8     
32.88/32.92	c 771            1720           118443         41963          0              0              6   12   8     
35.88/35.99	c 947            2099           143082         50718          0              0              7   11   9     
40.18/40.27	c 1140           2541           170812         59847          0              0              6   12   8     
44.87/45.00	c 1352           2996           200326         70569          0              0              6   11   8     
53.67/53.74	c 1585           3513           237065         83021          0              0              5   11   7     
59.67/59.77	c 1841           4116           277977         96701          0              0              4   13   8     
66.28/66.34	c 2122           4778           323146         112470         0              0              5   12   8     
73.27/73.38	c 2431           5465           371335         129417         0              0              5   13   8     
80.37/80.48	c 2770           6264           428668         148991         0              0              6   13   9     
90.46/90.55	c 3142           7170           493069         170637         0              0              4   12   8     
99.27/99.39	c 3551           8044           551715         190980         0              0              5   13   8     
107.75/107.80	c 4000           8999           618370         213536         0              0              6   14   8     
117.35/117.45	c 4493           10141          698639         240203         0              0              5   15   8     
131.95/132.06	c 5035           11365          784249         269114         0              0              5   13   8     
149.66/149.79	c 5631           12916          891360         304223         0              0              4   16   8     
168.86/168.93	c 6286           14413          991559         338629         0              0              5   13   8     
185.17/185.24	c 7006           16039          1106532        377390         0              0              4   12   8     
200.56/200.69	c 7798           17928          1238264        422548         0              0              5   13   8     
223.66/223.70	c 8669           19890          1378901        471551         0              0              4   14   8     
240.86/240.96	c 9627           22222          1537037        525412         0              0              5   13   9     
265.86/265.96	c 10680          24736          1705369        580300         0              0              6   13   8     
296.86/296.96	c 11838          27437          1893864        645542         0              0              5   13   8     
335.36/335.48	c 13111          30459          2097601        716626         0              0              3   14   8     
374.95/375.00	c 14511          33841          2321444        794449         0              0              3   16   8     
406.45/406.58	c 16051          37488          2571237        882593         0              0              5   14   8     
450.45/450.59	c 17745          41460          2852818        977956         0              0              4   14   8     
483.75/483.82	c 19608          45767          3138442        1079438        0              0              4   13   9     
527.16/527.25	c 21657          50374          3450222        1185432        0              0              5   12   9     
582.84/582.98	c 23910          55464          3805260        1308933        0              0              3   15   8     
639.54/639.68	c 26388          61284          4208960        1448244        0              0              3   13   8     
707.15/707.28	c 29113          67583          4648708        1598348        0              0              4   15   8     
769.54/769.62	c 32110          74544          5104151        1753653        0              0              4   15   9     
847.44/847.53	c 35406          82290          5648226        1940516        0              0              4   14   8     
920.14/920.22	c 39031          90577          6209812        2128928        0              0              5   14   9     
1007.33/1007.48	c 43018          100326         6872406        2343141        0              0              4   14   8     
1133.43/1133.58	c 47403          110696         7585539        2592127        0              0              4   15   8     
1265.23/1265.37	c 52226          122361         8381426        2859640        0              0              3   16   8     
1381.32/1381.42	c 57531          134169         9194996        3141170        0              0              4   14   8     
1483.51/1483.68	c 63366          147953         10152916       3468947        0              0              5   15   9     
1607.42/1607.54	c 69784          163273         11171294       3815155        0              0              4   15   9     
1782.61/1782.77	c 76843          180825         12357961       4214393        1              0              3   16   8     
1992.80/1992.98	c 84607          199874         13666089       4656297        3              0              3   15   8     
2204.50/2204.63	c 93147          221452         15090108       5125388        4              0              3   16   8     
2444.49/2444.64	c 102541         244684         16649713       5625978        5              0              3   16   8     
2519.89/2520.00	
2519.89/2520.00	c *** INTERRUPTED ***
2519.89/2520.00	c restarts              : 49          
2519.89/2520.00	c conflicts             : 106544       (42 /sec)
2519.89/2520.00	c decisions             : 254387       (101 /sec)
2519.89/2520.00	c propagations          : 5827602     (2313 /sec)
2519.89/2520.00	c root propagations     : 0           
2519.89/2520.00	c filter calls          : 17288633       (6861 /sec)
2519.89/2520.00	c useless filter calls  : 14513388       (83 %)
2519.89/2520.00	c Memory used           : 199.52 MB
2519.89/2520.00	c CPU time              : 2519.77 s
2519.89/2520.00	c real time             : 2520 s
2519.89/2520.00	
2519.89/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14830 MiB free)
  memory of node 1: 16384 MiB (14101 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4407962-1569794757/watcher-4407962-1569794757 -o /tmp/evaluation-result-4407962-1569794757/solver-4407962-1569794757 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4407962-1569794757.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=31683, runsolver pid=31680

[startup+0.1002 s]*
/proc/loadavg: 3.09 2.31 2.16 3/201 31684
/proc/meminfo: memFree=29627564/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=28844 memory=4724 CPUtime=0.1 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 1506 0 0 0 10 0 0 0 20 0 1 0 555390417 29536256 1181 33554432000 4194304 6211132 140736002120896 140736002118168 140360846310373 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 7211 1181 803 493 0 516 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 28844 KiB
Current children cumulated memory: 4724 KiB

[startup+0.209496 s]*
/proc/loadavg: 3.09 2.31 2.16 4/201 31687
/proc/meminfo: memFree=29672044/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=30404 memory=5876 CPUtime=0.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 2011 0 0 0 21 0 0 0 20 0 1 0 555390417 31133696 1469 33554432000 4194304 6211132 140736002120896 140736002118168 140360846310373 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 7601 1469 803 493 0 906 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30404 KiB
Current children cumulated memory: 5876 KiB

[startup+0.309733 s]*
/proc/loadavg: 3.09 2.31 2.16 3/200 31687
/proc/meminfo: memFree=30143868/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=34632 memory=10732 CPUtime=0.31 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 3412 0 0 0 31 0 0 0 20 0 1 0 555390417 35463168 2683 33554432000 4194304 6211132 140736002120896 140736002118168 140360862372992 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 8658 2683 809 493 0 1963 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 34632 KiB
Current children cumulated memory: 10732 KiB

[startup+0.709588 s]*
/proc/loadavg: 3.09 2.31 2.16 3/200 31687
/proc/meminfo: memFree=30150536/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=38912 memory=14688 CPUtime=0.71 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 4407 0 0 0 71 0 0 0 20 0 1 0 555390417 39845888 3672 33554432000 4194304 6211132 140736002120896 140736002118168 5818624 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 9728 3672 809 493 0 3033 0
Current children cumulated CPU time: 0.71 s
Current children cumulated vsize: 38912 KiB
Current children cumulated memory: 14688 KiB

[startup+1.50032 s]
/proc/loadavg: 3.09 2.31 2.16 3/200 31687
/proc/meminfo: memFree=30153112/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=49636 memory=24456 CPUtime=1.49 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 6848 0 0 0 148 1 0 0 20 0 1 0 555390417 50827264 6114 33554432000 4194304 6211132 140736002120896 140736002118168 5817196 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 12409 6114 809 493 0 5714 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 49636 KiB
Current children cumulated memory: 24456 KiB

[startup+3.10034 s]
/proc/loadavg: 3.08 2.32 2.17 3/200 31687
/proc/meminfo: memFree=30143228/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=65684 memory=38652 CPUtime=3.08 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 11149 0 0 0 307 1 0 0 20 0 1 0 555390417 67260416 9663 33554432000 4194304 6211132 140736002120896 140736002118168 5818450 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 16421 9663 810 493 0 9726 0
Current children cumulated CPU time: 3.08 s
Current children cumulated vsize: 65684 KiB
Current children cumulated memory: 38652 KiB

[startup+6.30953 s]
/proc/loadavg: 3.08 2.32 2.17 3/200 31687
/proc/meminfo: memFree=30103684/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=101848 memory=70756 CPUtime=6.3 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 20176 0 0 0 627 3 0 0 20 0 1 0 555390417 104292352 17689 33554432000 4194304 6211132 140736002120896 140736002118168 5016216 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 25462 17689 810 493 0 18767 0
Current children cumulated CPU time: 6.3 s
Current children cumulated vsize: 101848 KiB
Current children cumulated memory: 70756 KiB

[startup+12.7003 s]
/proc/loadavg: 3.07 2.34 2.18 3/200 31687
/proc/meminfo: memFree=30043216/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=171660 memory=135972 CPUtime=12.68 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 37358 0 0 0 1263 5 0 0 20 0 1 0 555390417 175779840 33993 33554432000 4194304 6211132 140736002120896 140736002118168 5743421 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 42915 33993 810 493 0 36220 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 171660 KiB
Current children cumulated memory: 135972 KiB

[startup+25.5004 s]
/proc/loadavg: 2.98 2.35 2.18 3/201 31689
/proc/meminfo: memFree=30004264/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=169988 CPUtime=25.49 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 100745 0 0 0 2540 9 0 0 20 0 1 0 555390417 209207296 42497 33554432000 4194304 6211132 140736002120896 140736002118856 5038990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 42497 855 493 0 44381 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 169988 KiB

[startup+51.1004 s]
/proc/loadavg: 2.65 2.32 2.17 3/199 31690
/proc/meminfo: memFree=30001356/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=173092 CPUtime=51.08 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 128694 0 0 0 5098 10 0 0 20 0 1 0 555390417 209207296 43273 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 43273 855 493 0 44381 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 173092 KiB

[startup+102.31 s]
/proc/loadavg: 2.26 2.27 2.16 3/200 31695
/proc/meminfo: memFree=29993292/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=102.26 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 143729 0 0 0 10216 10 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+162.31 s]
/proc/loadavg: 2.09 2.22 2.15 3/200 31701
/proc/meminfo: memFree=29993372/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=162.27 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 144009 0 0 0 16216 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+222.31 s]
/proc/loadavg: 2.04 2.18 2.14 3/200 31706
/proc/meminfo: memFree=29993376/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=222.27 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 144289 0 0 0 22216 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+282.31 s]
/proc/loadavg: 2.01 2.15 2.13 3/200 31710
/proc/meminfo: memFree=29994004/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=282.27 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 144569 0 0 0 28216 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+342.31 s]
/proc/loadavg: 2.00 2.12 2.13 3/201 31725
/proc/meminfo: memFree=29993992/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=342.26 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 144849 0 0 0 34215 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5039026 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+402.31 s]
/proc/loadavg: 2.00 2.10 2.12 3/200 31729
/proc/meminfo: memFree=29994128/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=402.26 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 145129 0 0 0 40215 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5039061 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 402.26 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+462.31 s]
/proc/loadavg: 2.00 2.08 2.11 3/200 31733
/proc/meminfo: memFree=29994276/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=462.26 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 145409 0 0 0 46215 11 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB


################
# More data... #
################

/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 1722.22 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+1782.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31854
/proc/meminfo: memFree=29989248/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=1782.22 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 151417 0 0 0 178210 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 1782.22 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+1842.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31858
/proc/meminfo: memFree=29989376/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=1842.22 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 151692 0 0 0 184210 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 1842.22 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+1902.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31862
/proc/meminfo: memFree=29988792/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=1902.22 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 151959 0 0 0 190210 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038992 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 1902.22 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+1962.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31868
/proc/meminfo: memFree=29988960/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=1962.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 152226 0 0 0 196209 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 1962.21 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2022.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31872
/proc/meminfo: memFree=29988404/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2022.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 152506 0 0 0 202209 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5037825 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2022.21 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2082.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31876
/proc/meminfo: memFree=29988112/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2082.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 152773 0 0 0 208209 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2082.21 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2142.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31890
/proc/meminfo: memFree=29988168/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2142.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 153040 0 0 0 214209 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2142.21 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2202.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31894
/proc/meminfo: memFree=29988116/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2202.21 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 153284 0 0 0 220209 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2202.21 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2262.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31898
/proc/meminfo: memFree=29988020/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2262.2 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 153585 0 0 0 226208 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2322.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31904
/proc/meminfo: memFree=29988628/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2322.2 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 153855 0 0 0 232208 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038990 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2322.2 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2382.31 s]
/proc/loadavg: 2.04 2.03 2.05 3/200 31908
/proc/meminfo: memFree=29988720/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2382.2 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 154122 0 0 0 238208 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2382.2 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2442.31 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 31912
/proc/meminfo: memFree=29987952/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2442.2 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 154389 0 0 0 244208 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2442.2 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

[startup+2502.31 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 31979
/proc/meminfo: memFree=27507008/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2502.19 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 154641 0 0 0 250207 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5039007 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2502.19 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31980
/proc/meminfo: memFree=25865756/32770624 swapFree=66954180/67108860
[pid=31683] ppid=31680 vsize=204304 memory=180548 CPUtime=2519.89 cores=0,2,4,6
/proc/31683/stat : 31683 (cosoco) R 31680 31683 30008 0 -1 4202496 154854 0 0 0 251977 12 0 0 20 0 1 0 555390417 209207296 45137 33554432000 4194304 6211132 140736002120896 140736002118856 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 16723968 140736002122763 140736002122865 140736002122865 140736002125774 0
/proc/31683/statm: 51076 45137 855 493 0 44381 0
Current children cumulated CPU time: 2519.89 s
Current children cumulated vsize: 204304 KiB
Current children cumulated memory: 180548 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520 s]
# the end of solver process 31683 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.77 s, system=0.127996 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520
CPU time (s): 2519.9
CPU user time (s): 2519.77
CPU system time (s): 0.127996
CPU usage (%): 99.9959
Max. virtual memory (cumulated for all children) (KiB): 204304
Max. memory (cumulated for all children) (KiB): 180548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.77
system time used= 0.127996
maximum resident set size= 180608
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 154902
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 48
involuntary context switches= 3142


# summary of solver processes directly reported to runsolver:
#   pid: 31683
#   total CPU time (s): 2519.9
#   total CPU user time (s): 2519.77
#   total CPU system time (s): 0.127996

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.4144 second user time and 19.4836 second system time

The end

Launcher Data 

Begin job on node119 at 2019-09-30 00:05:15
IDJOB=4407962
IDBENCH=125590
IDSOLVER=2874
FILE ID=node119/4407962-1569794757
RUNJOBID= node119-1569787352-30039
PBS_JOBID= 21705833
Free space on /tmp= 61996 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/QRandom/QRandom-mdd-7-25-5-p7/mdd-7-25-5-ps05-psh07-9.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4407962-1569794757/watcher-4407962-1569794757 -o /tmp/evaluation-result-4407962-1569794757/solver-4407962-1569794757 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node119-1569787352-30039 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4407962-1569794757.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2d7f03e466d78847960dc3f747db29ef
RANDOM SEED=1205760014

node119.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29626068 kB
MemAvailable:   31789920 kB
Buffers:          208968 kB
Cached:          2284352 kB
SwapCached:        46700 kB
Active:          1121116 kB
Inactive:        1446912 kB
Active(anon):      37620 kB
Inactive(anon):   119140 kB
Active(file):    1083496 kB
Inactive(file):  1327772 kB
Unevictable:      107588 kB
Mlocked:          107588 kB
SwapTotal:      67108860 kB
SwapFree:       66954180 kB
Dirty:             36316 kB
Writeback:          6004 kB
AnonPages:        137372 kB
Mapped:            29480 kB
Shmem:             73180 kB
Slab:             170768 kB
SReclaimable:     136840 kB
SUnreclaim:        33928 kB
KernelStack:        3488 kB
PageTables:         5652 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     592608 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 61952 MiB
End job on node119 at 2019-09-30 00:47:16