Trace number 4389484

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.03 2520.01

General information on the benchmark

NameNumberPartitioning/NumberPartitioning-m1-s1/
NumberPartitioning-116.xml
MD5SUMd517e275a321760c6bd42601d2b728d6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark23.7128
Satisfiable
(Un)Satisfiability was proved
Number of variables232
Number of constraints124
Number of domains2
Minimum domain size116
Maximum domain size13456
Distribution of domain sizes[{"size":116,"count":116},{"size":13456,"count":116}]
Minimum variable degree2
Maximum variable degree5
Distribution of variable degrees[{"degree":2,"count":116},{"degree":4,"count":115},{"degree":5,"count":1}]
Minimum constraint arity1
Maximum constraint arity116
Distribution of constraint arities[{"arity":1,"count":1},{"arity":2,"count":116},{"arity":58,"count":6},{"arity":116,"count":1}]
Number of extensional constraints0
Number of intensional constraints117
Distribution of constraint types[{"type":"intension","count":117},{"type":"allDifferent","count":1},{"type":"ordered","count":2},{"type":"sum","count":4}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.06	c
0.00/0.06	c This is cosoco 2.00 --  
0.00/0.06	c
0.00/0.06	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389484-1568319795.xml 
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.06	0
0.00/0.08	c root propagations     : 6614        
0.00/0.08	c restarts enabled, print stats at every restarts
0.00/0.08	c
0.00/0.08	c
0.00/0.08	c ========================================[ Problem Statistics ]===========================================
0.00/0.08	c |                                                                                                       
0.00/0.08	c |  Parse time        :         0.05 s 
0.00/0.08	c |
0.00/0.08	c |               Variables: 232
0.00/0.08	c |            Domain Sizes: 116..13456
0.00/0.08	c |
0.00/0.08	c |             Constraints: 236
0.00/0.08	c |                   Arity: 1..116  -- Unary: 1  -- Binary: 230
0.00/0.08	c | 
0.00/0.08	c |                   Types: 
0.00/0.08	c |                          (X - Y < k): 114
0.00/0.08	c |                          All Different: 1
0.00/0.08	c |                          Intension: 116
0.00/0.08	c |                          Sum: 4
0.00/0.08	c |                          Unary: 1
0.00/0.08	c |                          
0.00/0.08	c =========================================================================================================
0.00/0.08	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.41/0.43	c 101            217            14719          10505          116            0              117   117   115
0.69/0.74	c 211            327            15049          17215          117            0              1   1   0      
1.00/1.08	c 332            448            15412          24596          117            0              1   1   0      
1.39/1.46	c 465            581            15811          32709          117            0              1   1   0      
1.79/1.87	c 611            727            16249          41615          117            0              1   1   0      
2.29/2.32	c 771            887            16729          51375          117            0              1   1   0      
2.79/2.81	c 947            1063           17257          62111          117            0              1   1   0      
3.29/3.35	c 1140           1256           17836          73884          117            0              1   1   0      
3.89/3.94	c 1352           1468           18472          86816          117            0              1   1   0      
4.59/4.60	c 1585           1701           19171          101029         117            0              1   1   0      
5.29/5.31	c 1841           1957           19939          116645         117            0              1   1   0      
6.00/6.10	c 2122           2238           20782          133786         117            0              1   1   0      
6.89/6.96	c 2431           2547           21709          152635         117            0              1   1   0      
7.89/7.90	c 2770           2886           22726          173314         117            0              1   1   0      
8.89/8.94	c 3142           3258           23842          196006         117            0              1   1   0      
10.00/10.07	c 3551           3667           25069          220955         117            0              1   1   0      
11.29/11.34	c 4000           4116           27339          268220         117            0              1   1   0      
12.69/12.72	c 4493           4609           29746          318074         117            0              1   1   0      
14.19/14.23	c 5035           5151           32300          370789         117            0              1   1   0      
15.89/15.90	c 5631           5747           35016          426612         117            0              1   1   0      
17.69/17.72	c 6286           6402           37909          485750         117            0              1   1   0      
19.69/19.71	c 7006           7122           41229          553203         117            0              1   1   0      
21.79/21.89	c 7798           8037           45523          614718         117            0              1   124   20   
23.99/24.08	c 8669           9034           49587          633560         118            0              1   127   118  
26.68/26.73	c 9627           10118          53899          670858         119            0              1   127   75   
29.58/29.61	c 10680          11299          58491          713180         120            0              1   129   71   
32.68/32.79	c 11838          12585          63389          761028         121            0              1   129   66   
36.18/36.27	c 13111          13988          68638          814908         122            0              1   131   62   
39.99/40.09	c 14511          15518          74263          875330         123            0              1   131   59   
44.19/44.26	c 16051          17190          80129          942841         124            0              1   133   56   
48.89/48.94	c 17745          19003          88040          1047817        125            0              1   120   32   
53.89/53.90	c 19608          20987          96307          1084341        126            0              1   122   105  
59.29/59.33	c 21657          23155          105054         1107734        126            0              30   120   119 
64.89/64.98	c 23910          25540          114207         1131696        126            0              3   133   122  
71.79/71.81	c 26388          28137          126440         1281401        127            0              1   120   38   
79.00/79.05	c 29113          30983          137644         1330022        128            0              1   122   108  
86.59/86.64	c 32110          34114          147885         1364642        128            0              119   135   122
95.59/95.66	c 35406          37530          162191         1564572        129            0              1   121   42   
105.10/105.19	c 39031          41275          176771         1610908        129            0              21   121   119 
115.29/115.32	c 43018          45387          191291         1648544        129            0              5   126   122  
126.39/126.48	c 47403          49897          208125         1705808        129            0              13   126   121 
138.59/138.60	c 52226          54854          226760         1758286        129            0              13   135   122 
152.79/152.84	c 57531          60281          246769         1975941        130            0              1   123   64   
167.59/167.61	c 63366          66242          267815         2022949        130            0              13   127   122 
182.29/182.39	c 69784          72796          290961         2078853        130            0              12   137   127 
201.29/201.30	c 76843          79977          316646         2355995        131            0              1   123   69   
220.59/220.65	c 84607          87870          341808         2409571        131            0              119   130   123
241.10/241.13	c 93147          96546          371652         2475816        131            0              15   137   125 
265.79/265.85	c 102541         106064         407254         2849607        132            0              1   125   75   
290.10/290.13	c 112874         116535         442224         2932467        132            0              14   139   126 
319.59/319.64	c 124240         128026         482447         3334043        133            0              1   126   79   
347.39/347.44	c 136742         140668         521713         3456430        133            0              12   141   129 
382.59/382.67	c 150494         154546         571110         3945113        134            0              1   127   78   
413.79/413.84	c 165621         169816         619429         4089904        134            0              14   144   132 
456.00/456.08	c 182260         186581         678807         4687317        135            0              1   127   76   
494.39/494.42	c 200562         205028         736854         4834530        135            0              20   146   132 
544.59/544.66	c 220694         225288         802758         5504078        136            0              1   129   79   
597.89/598.00	c 242839         247589         870926         5676299        136            0              125   157   143
650.89/650.94	c 267198         272086         946608         5976138        137            0              1   139   129  
712.59/712.63	c 293992         299024         1029138        6196882        137            0              124   145   134
780.79/780.81	c 323465         328657         1120221        6435310        138            0              1   161   141  
850.89/850.97	c 355885         361222         1219576        6717463        139            0              1   146   130  
933.59/933.69	c 391547         397034         1330686        6987219        139            0              29   146   134 
1019.49/1019.56	c 430775         436420         1450777        7304052        140            0              1   159   134  
1112.29/1112.30	c 473925         479734         1584282        7592971        141            0              1   165   146  
1219.49/1219.58	c 521390         527343         1735199        8188581        142            0              1   145   125  
1324.79/1324.86	c 573601         579853         1908699        8615287        143            0              1   172   155  
1461.70/1461.72	c 631033         637437         2106391        9552647        144            0              1   153   123  
1682.30/1682.31	c 694208         733835         7341833        94116964       144            0              5   126   32   
1815.11/1815.11	c 763700         803515         7555823        94582679       144            0              50   189   159 
1987.31/1987.32	c 840141         880117         7787543        95195688       145            0              1   162   142  
2168.91/2168.96	c 924226         964365         8045986        95821538       145            0              37   164   145 
2295.91/2295.94	c 1016719        1057061        8327472        96478352       145            0              41   197   172 
2465.12/2465.19	c 1118461        1159000        8636987        97157302       145            0              73   198   163 
2520.02/2520.01	
2520.02/2520.01	c *** INTERRUPTED ***
2520.02/2520.01	c restarts              : 74          
2520.02/2520.01	c conflicts             : 1141248      (453 /sec)
2520.02/2520.01	c decisions             : 1181925      (469 /sec)
2520.02/2520.01	c propagations          : 97394496    (38649 /sec)
2520.02/2520.01	c root propagations     : 6614        
2520.02/2520.01	c filter calls          : 8709249        (3456 /sec)
2520.02/2520.01	c useless filter calls  : 6038168        (69 %)
2520.02/2520.01	c Memory used           : 65.41 MB
2520.02/2520.01	c CPU time              : 2520 s
2520.02/2520.01	c real time             : 2520.01 s
2520.02/2520.01	
2520.02/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (12942 MiB free)
  memory of node 1: 16384 MiB (12574 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389484-1568319795/watcher-4389484-1568319795 -o /tmp/evaluation-result-4389484-1568319795/solver-4389484-1568319795 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389484-1568319795.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=11079, runsolver pid=11076
Current StackSize limit: 8192 KiB


[startup+0.100154 s]*
/proc/loadavg: 2.00 2.03 2.05 4/200 11080
/proc/meminfo: memFree=26091520/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42444 CPUtime=0.1 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 10797 0 0 0 9 1 0 0 20 0 1 0 407985812 67444736 10611 33554432000 4194304 6210612 140731156195056 140731156191592 5082010 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10611 869 493 0 9771 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42444 KiB

[startup+0.210767 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 11080
/proc/meminfo: memFree=26091520/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42444 CPUtime=0.21 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 10806 0 0 0 20 1 0 0 20 0 1 0 407985812 67444736 10611 33554432000 4194304 6210612 140731156195056 140731156191592 5149332 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10611 869 493 0 9771 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42444 KiB

[startup+0.310333 s]*
/proc/loadavg: 2.00 2.03 2.05 3/200 11080
/proc/meminfo: memFree=26091520/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42444 CPUtime=0.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 10806 0 0 0 30 1 0 0 20 0 1 0 407985812 67444736 10611 33554432000 4194304 6210612 140731156195056 140731156191592 5149332 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10611 869 493 0 9771 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42444 KiB

[startup+0.700293 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 11080
/proc/meminfo: memFree=26091520/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42444 CPUtime=0.69 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 10807 0 0 0 68 1 0 0 20 0 1 0 407985812 67444736 10611 33554432000 4194304 6210612 140731156195056 140731156193016 5149314 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10611 869 493 0 9771 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42444 KiB

[startup+1.5003 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 11080
/proc/meminfo: memFree=26091096/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42444 CPUtime=1.49 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 10807 0 0 0 148 1 0 0 20 0 1 0 407985812 67444736 10611 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10611 869 493 0 9771 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42444 KiB

[startup+3.11033 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11080
/proc/meminfo: memFree=26091224/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42580 CPUtime=3.1 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 11672 0 0 0 309 1 0 0 20 0 1 0 407985812 67444736 10645 33554432000 4194304 6210612 140731156195056 140731156193016 5149332 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10645 895 493 0 9771 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42580 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11080
/proc/meminfo: memFree=26090984/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42580 CPUtime=6.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 12541 0 0 0 628 1 0 0 20 0 1 0 407985812 67444736 10645 33554432000 4194304 6210612 140731156195056 140731156193016 5149321 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10645 895 493 0 9771 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42580 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11080
/proc/meminfo: memFree=26090952/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42580 CPUtime=12.69 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 13596 0 0 0 1268 1 0 0 20 0 1 0 407985812 67444736 10645 33554432000 4194304 6210612 140731156195056 140731156193016 5149318 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10645 895 493 0 9771 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42580 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11082
/proc/meminfo: memFree=26090756/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42600 CPUtime=25.48 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 17650 0 0 0 2547 1 0 0 20 0 1 0 407985812 67444736 10650 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10650 895 493 0 9771 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42600 KiB

[startup+51.1102 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11082
/proc/meminfo: memFree=26089584/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=65864 memory=42620 CPUtime=51.1 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 18369 0 0 0 5108 2 0 0 20 0 1 0 407985812 67444736 10655 33554432000 4194304 6210612 140731156195056 140731156193016 5149318 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16466 10655 895 493 0 9771 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 65864 KiB
Current children cumulated memory: 42620 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 11086
/proc/meminfo: memFree=26090164/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42648 CPUtime=102.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 18787 0 0 0 10227 2 0 0 20 0 1 0 407985812 67596288 10662 33554432000 4194304 6210612 140731156195056 140731156193016 5149332 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10662 895 493 0 9808 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42648 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11092
/proc/meminfo: memFree=26089424/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42660 CPUtime=162.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 19200 0 0 0 16227 2 0 0 20 0 1 0 407985812 67596288 10665 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10665 895 493 0 9808 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42660 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11096
/proc/meminfo: memFree=26089180/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42684 CPUtime=222.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 19618 0 0 0 22227 2 0 0 20 0 1 0 407985812 67596288 10671 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10671 895 493 0 9808 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42684 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11100
/proc/meminfo: memFree=26089040/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42696 CPUtime=282.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 20040 0 0 0 28227 2 0 0 20 0 1 0 407985812 67596288 10674 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10674 895 493 0 9808 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42696 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11106
/proc/meminfo: memFree=26089684/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42720 CPUtime=342.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 20482 0 0 0 34227 2 0 0 20 0 1 0 407985812 67596288 10680 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10680 895 493 0 9808 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42720 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 11118
/proc/meminfo: memFree=26089376/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66012 memory=42728 CPUtime=402.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 20927 0 0 0 40227 2 0 0 20 0 1 0 407985812 67596288 10682 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16503 10682 895 493 0 9808 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 66012 KiB
Current children cumulated memory: 42728 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 11122
/proc/meminfo: memFree=26088860/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66204 memory=42752 CPUtime=462.29 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 21381 0 0 0 46227 2 0 0 20 0 1 0 407985812 67792896 10688 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16551 10688 895 493 0 9856 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 66204 KiB
Current children cumulated memory: 42752 KiB


################
# More data... #
################

/proc/11079/statm: 16664 10802 895 493 0 9969 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43208 KiB

[startup+1782.3 s]
/proc/loadavg: 2.05 2.12 2.09 3/199 11330
/proc/meminfo: memFree=17543392/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43208 CPUtime=1782.3 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 30397 0 0 0 178228 2 0 0 20 0 1 0 407985812 68255744 10802 33554432000 4194304 6210612 140731156195056 140731156193016 5149306 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10802 895 493 0 9969 0
Current children cumulated CPU time: 1782.3 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43208 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.10 2.08 3/199 11334
/proc/meminfo: memFree=17140188/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43304 CPUtime=1842.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 31086 0 0 0 184228 3 0 0 20 0 1 0 407985812 68255744 10826 33554432000 4194304 6210612 140731156195056 140731156193016 5192915 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10826 895 493 0 9969 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43304 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.08 2.08 3/199 11338
/proc/meminfo: memFree=16739088/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43304 CPUtime=1902.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 31297 0 0 0 190228 3 0 0 20 0 1 0 407985812 68255744 10826 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10826 895 493 0 9969 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43304 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.07 2.07 3/199 11344
/proc/meminfo: memFree=16336044/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43304 CPUtime=1962.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 31543 0 0 0 196228 3 0 0 20 0 1 0 407985812 68255744 10826 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10826 895 493 0 9969 0
Current children cumulated CPU time: 1962.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43304 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.05 2.07 3/199 11348
/proc/meminfo: memFree=15932876/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43356 CPUtime=2022.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 32138 0 0 0 202228 3 0 0 20 0 1 0 407985812 68255744 10839 33554432000 4194304 6210612 140731156195056 140731156193016 5149314 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10839 895 493 0 9969 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43356 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/199 11352
/proc/meminfo: memFree=15530484/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43356 CPUtime=2082.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 32359 0 0 0 208228 3 0 0 20 0 1 0 407985812 68255744 10839 33554432000 4194304 6210612 140731156195056 140731156193016 5149314 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10839 895 493 0 9969 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43356 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/199 11358
/proc/meminfo: memFree=15127472/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66656 memory=43356 CPUtime=2142.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 32617 0 0 0 214228 3 0 0 20 0 1 0 407985812 68255744 10839 33554432000 4194304 6210612 140731156195056 140731156193016 5149280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16664 10839 895 493 0 9969 0
Current children cumulated CPU time: 2142.31 s
Current children cumulated vsize: 66656 KiB
Current children cumulated memory: 43356 KiB

[startup+2202.3 s]
/proc/loadavg: 1.93 2.01 2.04 3/201 11371
/proc/meminfo: memFree=14726956/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43416 CPUtime=2202.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 33267 0 0 0 220228 3 0 0 20 0 1 0 407985812 68583424 10854 33554432000 4194304 6210612 140731156195056 140731156193016 5149290 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10854 895 493 0 10049 0
Current children cumulated CPU time: 2202.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43416 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/201 11375
/proc/meminfo: memFree=14324548/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43416 CPUtime=2262.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 33610 0 0 0 226228 3 0 0 20 0 1 0 407985812 68583424 10854 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10854 895 493 0 10049 0
Current children cumulated CPU time: 2262.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43416 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/201 11381
/proc/meminfo: memFree=13922172/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43416 CPUtime=2322.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 34283 0 0 0 232228 3 0 0 20 0 1 0 407985812 68583424 10854 33554432000 4194304 6210612 140731156195056 140731156193016 5149314 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10854 895 493 0 10049 0
Current children cumulated CPU time: 2322.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43416 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 11385
/proc/meminfo: memFree=13519524/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43416 CPUtime=2382.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 34501 0 0 0 238228 3 0 0 20 0 1 0 407985812 68583424 10854 33554432000 4194304 6210612 140731156195056 140731156193016 5149280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10854 895 493 0 10049 0
Current children cumulated CPU time: 2382.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43416 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 11389
/proc/meminfo: memFree=13116988/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43416 CPUtime=2442.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 34916 0 0 0 244228 3 0 0 20 0 1 0 407985812 68583424 10854 33554432000 4194304 6210612 140731156195056 140731156193016 5380107 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10854 895 493 0 10049 0
Current children cumulated CPU time: 2442.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43416 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11396
/proc/meminfo: memFree=12714052/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43424 CPUtime=2502.31 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 35638 0 0 0 250228 3 0 0 20 0 1 0 407985812 68583424 10856 33554432000 4194304 6210612 140731156195056 140731156193016 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10856 895 493 0 10049 0
Current children cumulated CPU time: 2502.31 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43424 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 11397
/proc/meminfo: memFree=12594080/32770688 swapFree=66919608/67108860
[pid=11079] ppid=11076 vsize=66976 memory=43424 CPUtime=2520.02 cores=0-3
/proc/11079/stat : 11079 (cosoco) R 11076 11079 9478 0 -1 4202496 35726 0 0 0 251999 3 0 0 20 0 1 0 407985812 68583424 10856 33554432000 4194304 6210612 140731156195056 140731156193016 5149280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 20738048 140731156198411 140731156198513 140731156198513 140731156201422 0
/proc/11079/statm: 16744 10856 895 493 0 10049 0
Current children cumulated CPU time: 2520.02 s
Current children cumulated vsize: 66976 KiB
Current children cumulated memory: 43424 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 11079 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.035 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.03
CPU user time (s): 2520
CPU system time (s): 0.035
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 66976
Max. memory (cumulated for all children) (KiB): 43424

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.035
maximum resident set size= 43492
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35778
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18
involuntary context switches= 839


# summary of solver processes directly reported to runsolver:
#   pid: 11079
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.035

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.5996 second user time and 17.6065 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-14 04:43:37
IDJOB=4389484
IDBENCH=122910
IDSOLVER=2829
FILE ID=node120/4389484-1568319795
RUNJOBID= node120-1323826654-9509
PBS_JOBID= 21701129
Free space on /tmp= 59152 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/NumberPartitioning/NumberPartitioning-m1-s1/NumberPartitioning-116.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389484-1568319795/watcher-4389484-1568319795 -o /tmp/evaluation-result-4389484-1568319795/solver-4389484-1568319795 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1323826654-9509 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389484-1568319795.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d517e275a321760c6bd42601d2b728d6
RANDOM SEED=1604836285

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        26129780 kB
MemAvailable:   31739828 kB
Buffers:          142644 kB
Cached:          5740980 kB
SwapCached:        77012 kB
Active:          1286828 kB
Inactive:        4754672 kB
Active(anon):      81680 kB
Inactive(anon):   117464 kB
Active(file):    1205148 kB
Inactive(file):  4637208 kB
Unevictable:      108228 kB
Mlocked:          108228 kB
SwapTotal:      67108860 kB
SwapFree:       66919608 kB
Dirty:              2804 kB
Writeback:             0 kB
AnonPages:        286736 kB
Mapped:            48296 kB
Shmem:             32812 kB
Slab:             195940 kB
SReclaimable:     167052 kB
SUnreclaim:        28888 kB
KernelStack:        3776 kB
PageTables:         5720 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     613024 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    237568 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 59148 MiB
End job on node120 at 2011-12-14 05:25:38