Trace number 4396917

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.02 2520.01

General information on the benchmark

NameQuasiGroups/QuasiGroups-elt-qg7/
QuasiGroup-7-39.xml
MD5SUM5a6cd63004ce40fe2c4de94228743879
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3042
Number of constraints2966
Number of domains1
Minimum domain size39
Maximum domain size39
Distribution of domain sizes[{"size":39,"count":3003}]
Minimum variable degree0
Maximum variable degree79
Distribution of variable degrees[{"degree":0,"count":39},{"degree":2,"count":1482},{"degree":78,"count":39},{"degree":79,"count":1482}]
Minimum constraint arity39
Maximum constraint arity1521
Distribution of constraint arities[{"arity":39,"count":1},{"arity":41,"count":2964},{"arity":1521,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1},{"type":"element","count":2964}]
Optimization problemNO
Type of objective

Solver Data 

0.21/0.27	c root propagations     : 195         
0.21/0.27	c restarts enabled, print stats at every restarts
0.21/0.27	c
0.21/0.27	c
0.21/0.27	c
0.21/0.27	c This is cosoco 2.00 --  
0.21/0.27	c
0.21/0.27	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396917-1568585768.xml 
0.21/0.27	c ========================================[ Problem Statistics ]===========================================
0.21/0.27	c |                                                                                                       
0.21/0.27	c |  Parse time        :         0.21 s 
0.21/0.27	c |
0.21/0.27	c |               Variables: 3042
0.21/0.27	c |            Domain Sizes: 39..39
0.21/0.27	c |
0.21/0.27	c |             Constraints: 3081
0.21/0.27	c |                   Arity: 1..41  -- Unary: 39
0.21/0.27	c | 
0.21/0.27	c |                   Types: 
0.21/0.27	c |                          All Different: 78
0.21/0.27	c |                          Element Variable: 2964
0.21/0.27	c |                          Unary: 39
0.21/0.27	c |                          
0.21/0.27	c =========================================================================================================
0.21/0.27	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.21/0.27	c remove useless variable y[0][0]
0.21/0.27	c remove useless variable y[1][1]
0.21/0.27	c remove useless variable y[2][2]
0.21/0.27	c remove useless variable y[3][3]
0.21/0.27	c remove useless variable y[4][4]
0.21/0.27	c remove useless variable y[5][5]
0.21/0.27	c remove useless variable y[6][6]
0.21/0.27	c remove useless variable y[7][7]
0.21/0.27	c remove useless variable y[8][8]
0.21/0.27	c remove useless variable y[9][9]
0.21/0.27	c remove useless variable y[10][10]
0.21/0.27	c remove useless variable y[11][11]
0.21/0.27	c remove useless variable y[12][12]
0.21/0.27	c remove useless variable y[13][13]
0.21/0.27	c remove useless variable y[14][14]
0.21/0.27	c remove useless variable y[15][15]
0.21/0.27	c remove useless variable y[16][16]
0.21/0.27	c remove useless variable y[17][17]
0.21/0.27	c remove useless variable y[18][18]
0.21/0.27	c remove useless variable y[19][19]
0.21/0.27	c remove useless variable y[20][20]
0.21/0.27	c remove useless variable y[21][21]
0.21/0.27	c remove useless variable y[22][22]
0.21/0.27	c remove useless variable y[23][23]
0.21/0.27	c remove useless variable y[24][24]
0.21/0.27	c remove useless variable y[25][25]
0.21/0.27	c remove useless variable y[26][26]
0.21/0.27	c remove useless variable y[27][27]
0.21/0.27	c remove useless variable y[28][28]
0.21/0.27	c remove useless variable y[29][29]
0.21/0.27	c remove useless variable y[30][30]
0.21/0.27	c remove useless variable y[31][31]
0.21/0.27	c remove useless variable y[32][32]
0.21/0.27	c remove useless variable y[33][33]
0.21/0.27	c remove useless variable y[34][34]
0.21/0.27	c remove useless variable y[35][35]
0.21/0.27	c remove useless variable y[36][36]
0.21/0.27	c remove useless variable y[37][37]
0.21/0.27	c remove useless variable y[38][38]
0.41/0.51	c 101            585            206186         77231          189            0              268   326   305
0.60/0.67	c 211            902            341284         88986          189            0              83   119   116 
0.69/0.79	c 332            1203           453895         101495         189            0              152   163   160
0.89/0.91	c 465            1608           554378         113768         189            0              115   119   117
1.10/1.12	c 611            2070           744395         150031         189            0              101   233   224
1.19/1.29	c 771            2526           899527         178620         189            0              120   228   221
1.39/1.48	c 947            2961           1070385        209712         189            0              57   201   194 
1.59/1.68	c 1140           3445           1253834        245315         189            0              61   211   200 
1.89/1.93	c 1352           4032           1487155        299197         189            0              54   222   212 
2.18/2.24	c 1585           4718           1766146        359799         189            0              56   231   218 
2.48/2.54	c 1841           5361           2024454        423449         189            0              57   97   93   
2.68/2.76	c 2122           6003           2207451        445467         189            0              61   140   137 
3.10/3.12	c 2431           6831           2520892        506926         189            0              65   162   154 
3.48/3.54	c 2770           7909           2879397        602807         189            0              72   159   152 
4.29/4.35	c 3142           9435           3602742        758830         189            0              64   179   167 
4.89/5.00	c 3551           10897          4207090        876511         189            0              74   229   217 
5.69/5.74	c 4000           12450          4893297        995960         189            0              31   231   217 
6.29/6.30	c 4493           14012          5412591        1088415        189            0              28   285   270 
7.10/7.12	c 5035           15779          6151993        1460894        189            0              26   261   200 
7.69/7.77	c 5631           17484          6714319        1555260        189            0              25   303   291 
8.29/8.32	c 6286           19152          7179651        1641335        189            0              27   242   227 
9.00/9.10	c 7006           21566          7844821        1814039        189            0              30   326   312 
9.69/9.77	c 7798           23469          8417778        1957334        189            0              34   259   249 
10.69/10.79	c 8669           26606          9366910        2182473        189            0              38   244   238 
11.49/11.56	c 9627           28885          10066794       2363204        189            0              33   203   196 
12.59/12.66	c 10680          31819          11009005       2528210        189            0              32   263   255 
13.59/13.66	c 11838          34730          11883270       2729654        189            0              34   326   314 
14.59/14.63	c 13111          37519          12740516       3025698        189            0              36   329   318 
15.89/15.98	c 14511          40702          13938914       3231923        189            0              39   331   321 
17.59/17.67	c 16051          44658          15475563       3649304        189            0              40   338   326 
19.19/19.29	c 17745          48993          16906418       3949250        189            0              42   342   331 
21.10/21.12	c 19608          54238          18455868       4319908        189            0              43   280   272 
23.79/23.88	c 21657          60608          20848426       4919563        189            0              46   151   146 
25.88/25.91	c 23910          67099          22558920       5436169        189            0              47   131   129 
28.38/28.46	c 26388          73507          24982881       5970717        189            0              47   264   249 
30.99/31.07	c 29113          79924          27320283       6614925        189            0              54   146   140 
33.68/33.71	c 32110          89109          29838709       7179348        189            0              53   265   254 
35.37/35.44	c 35406          96574          31542151       7596659        189            0              54   272   254 
40.58/40.61	c 39031          108167         36486015       8391728        189            0              51   277   268 
49.38/49.40	c 43018          123115         44968384       10206963       189            0              53   293   279 
52.48/52.52	c 47403          128628         48180686       10908298       189            0              54   315   304 
56.18/56.26	c 52226          139969         51716644       11694516       189            0              47   279   271 
59.99/60.02	c 57531          153571         55231297       12582871       189            0              48   268   257 
63.09/63.15	c 63366          165770         58337724       14153479       189            0              49   212   205 
69.28/69.31	c 69784          183884         64104478       15435619       189            0              49   265   251 
75.18/75.24	c 76843          203840         69177908       17172278       189            0              50   157   156 
79.68/79.72	c 84607          223084         73763440       18828153       189            0              51   257   240 
86.88/86.91	c 93147          241294         81001281       21250772       189            0              49   259   249 
92.48/92.55	c 102541         266232         86695675       22718602       189            0              48   257   247 
102.68/102.76	c 112874         298281         96088144       25830172       189            0              46   183   173 
112.78/112.82	c 124240         332435         106070517      28286295       189            0              48   268   253 
127.58/127.65	c 136742         365853         119732116      30568592       189            0              47   266   264 
138.18/138.27	c 150494         404915         130366682      33808464       189            0              49   269   256 
156.48/156.57	c 165621         451309         147376551      37788311       189            0              47   289   275 
166.48/166.53	c 182260         495039         157198720      40411675       189            0              49   226   210 
180.88/180.93	c 200562         541860         171229935      44264712       189            0              44   225   214 
209.48/209.58	c 220694         590514         199463168      51863568       189            0              45   236   219 
230.58/230.62	c 242839         656359         219938472      57712303       189            0              39   235   214 
250.48/250.59	c 267198         724122         239989997      61260592       189            0              38   223   212 
272.88/272.94	c 293992         799289         260480199      66143643       189            0              28   285   271 
309.78/309.89	c 323465         865920         296603684      71367790       189            0              32   249   238 
343.38/343.47	c 355885         961808         327473845      77811062       189            0              30   294   278 
376.09/376.15	c 391547         1059043        358732052      85606503       189            0              34   288   271 
404.18/404.23	c 430775         1164652        382330407      94624222       189            0              44   178   176 
449.18/449.24	c 473925         1333814        424480617      107182386      189            0              50   250   202 
505.28/505.32	c 521390         1479749        477236139      123316355      189            0              53   286   270 
566.99/567.05	c 573601         1664512        536011936      136339998      189            0              57   583   326 
614.99/615.02	c 631033         1841248        583332349      151334071      189            0              58   290   269 
658.18/658.27	c 694208         1992921        626465500      169051143      189            0              48   270   256 
701.28/701.37	c 763700         2115131        671526492      186889939      189            0              50   267   251 
856.38/856.41	c 840141         2390053        818128682      208475048      189            0              46   299   278 
918.09/918.11	c 924226         2597644        870010933      227344759      189            0              47   155   154 
1013.38/1013.43	c 1016719        2892288        955340209      252625794      189            0              49   153   135 
1105.28/1105.36	c 1118461        3150974        1047278975     279679840      189            0              50   280   258 
1171.78/1171.89	c 1230377        3400626        1115322541     302690088      189            0              49   276   260 
1262.89/1262.95	c 1353484        3727035        1207918093     325931241      189            0              49   280   265 
1363.00/1363.09	c 1488901        4081249        1310313798     353143474      189            0              46   288   267 
1488.69/1488.73	c 1637859        4529625        1438395805     392046633      189            0              45   299   269 
1616.29/1616.32	c 1801712        4951884        1567723497     436891921      189            0              43   278   261 
1768.59/1768.66	c 1981950        5416852        1719714321     475000224      189            0              40   282   258 
1958.50/1958.59	c 2180211        6100287        1907557606     530881675      189            0              44   286   268 
2125.60/2125.63	c 2398298        6681573        2075976080     576659094      189            0              37   288   266 
2386.20/2386.28	c 2638193        7440788        2334777701     659435804      189            0              29   288   271 
2520.01/2520.01	
2520.01/2520.01	c *** INTERRUPTED ***
2520.01/2520.01	c restarts              : 83          
2520.01/2520.01	c conflicts             : 2794870      (1109 /sec)
2520.01/2520.01	c decisions             : 7804552      (3097 /sec)
2520.01/2520.01	c propagations          : 711293487   (282264 /sec)
2520.01/2520.01	c root propagations     : 195         
2520.01/2520.01	c filter calls          : 2471308535     (980694 /sec)
2520.01/2520.01	c useless filter calls  : 2408803712     (97 %)
2520.01/2520.01	c Memory used           : 78.15 MB
2520.01/2520.01	c CPU time              : 2519.96 s
2520.01/2520.01	c real time             : 2520.01 s
2520.01/2520.01	
2520.01/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13973 MiB free)
  memory of node 1: 16384 MiB (14318 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396917-1568585768/watcher-4396917-1568585768 -o /tmp/evaluation-result-4396917-1568585768/solver-4396917-1568585768 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1324087207-28529 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396917-1568585768.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=31078, runsolver pid=31075
Current StackSize limit: 8192 KiB


[startup+0.100175 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28953672/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=48048 memory=24272 CPUtime=0.1 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 6269 0 0 0 9 1 0 0 20 0 1 0 434583140 49201152 6068 33554432000 4194304 6211092 140720616759488 140720616756024 140714765281184 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 12012 6068 827 493 0 5317 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 48048 KiB
Current children cumulated memory: 24272 KiB

[startup+0.210955 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28932592/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=69296 memory=45656 CPUtime=0.21 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 11590 0 0 0 19 2 0 0 20 0 1 0 434583140 70959104 11414 33554432000 4194304 6211092 140720616759488 140720616756024 140714765281184 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 17324 11414 827 493 0 10629 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 69296 KiB
Current children cumulated memory: 45656 KiB

[startup+0.310821 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28926888/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=72500 memory=49088 CPUtime=0.31 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 12449 0 0 0 29 2 0 0 20 0 1 0 434583140 74240000 12272 33554432000 4194304 6211092 140720616759488 140720616747512 5081337 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 18125 12272 858 493 0 11430 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 72500 KiB
Current children cumulated memory: 49088 KiB

[startup+0.700378 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28924368/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=75008 memory=51464 CPUtime=0.69 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 13052 0 0 0 67 2 0 0 20 0 1 0 434583140 76808192 12866 33554432000 4194304 6211092 140720616759488 140720616757448 5102815 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 18752 12866 871 493 0 12057 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 75008 KiB
Current children cumulated memory: 51464 KiB

[startup+1.50039 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28924368/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=75140 memory=51464 CPUtime=1.49 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 13087 0 0 0 147 2 0 0 20 0 1 0 434583140 76943360 12866 33554432000 4194304 6211092 140720616759488 140720616757448 5409476 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 18785 12866 871 493 0 12090 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 75140 KiB
Current children cumulated memory: 51464 KiB

[startup+3.11074 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28924096/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=75272 memory=51880 CPUtime=3.1 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 21872 0 0 0 308 2 0 0 20 0 1 0 434583140 77078528 12970 33554432000 4194304 6211092 140720616759488 140720616757448 5193696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 18818 12970 873 493 0 12123 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75272 KiB
Current children cumulated memory: 51880 KiB

[startup+6.30031 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28923888/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=75536 memory=52116 CPUtime=6.29 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 30888 0 0 0 626 3 0 0 20 0 1 0 434583140 77348864 13029 33554432000 4194304 6211092 140720616759488 140720616756952 5103230 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 18884 13029 873 493 0 12189 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 75536 KiB
Current children cumulated memory: 52116 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31079
/proc/meminfo: memFree=28923020/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=76196 memory=52776 CPUtime=12.69 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 40179 0 0 0 1265 4 0 0 20 0 1 0 434583140 78024704 13194 33554432000 4194304 6211092 140720616759488 140720616757448 5103203 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19049 13194 873 493 0 12354 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 76196 KiB
Current children cumulated memory: 52776 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31081
/proc/meminfo: memFree=28921008/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=76856 memory=53468 CPUtime=25.48 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 58007 0 0 0 2544 4 0 0 20 0 1 0 434583140 78700544 13367 33554432000 4194304 6211092 140720616759488 140720616757448 5008827 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19214 13367 873 493 0 12519 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 76856 KiB
Current children cumulated memory: 53468 KiB

[startup+51.1107 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31082
/proc/meminfo: memFree=28921856/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77120 memory=53648 CPUtime=51.09 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 63297 0 0 0 5104 5 0 0 20 0 1 0 434583140 78970880 13412 33554432000 4194304 6211092 140720616759488 140720616757448 5186176 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19280 13412 873 493 0 12585 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 77120 KiB
Current children cumulated memory: 53648 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31085
/proc/meminfo: memFree=28921436/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77252 memory=53792 CPUtime=102.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 63538 0 0 0 10223 5 0 0 20 0 1 0 434583140 79106048 13448 33554432000 4194304 6211092 140720616759488 140720616757448 5397429 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19313 13448 873 493 0 12618 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 77252 KiB
Current children cumulated memory: 53792 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31091
/proc/meminfo: memFree=28921428/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77252 memory=53868 CPUtime=162.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 63778 0 0 0 16223 5 0 0 20 0 1 0 434583140 79106048 13467 33554432000 4194304 6211092 140720616759488 140720616757448 5409453 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19313 13467 873 493 0 12618 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 77252 KiB
Current children cumulated memory: 53868 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31102
/proc/meminfo: memFree=28920496/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77252 memory=53936 CPUtime=222.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 63982 0 0 0 22223 5 0 0 20 0 1 0 434583140 79106048 13484 33554432000 4194304 6211092 140720616759488 140720616757448 5103225 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19313 13484 873 493 0 12618 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 77252 KiB
Current children cumulated memory: 53936 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31106
/proc/meminfo: memFree=28920884/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77384 memory=53964 CPUtime=282.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 64211 0 0 0 28223 5 0 0 20 0 1 0 434583140 79241216 13491 33554432000 4194304 6211092 140720616759488 140720616757448 5102851 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19346 13491 873 493 0 12651 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 53964 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31112
/proc/meminfo: memFree=28920412/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77384 memory=53980 CPUtime=342.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 64441 0 0 0 34223 5 0 0 20 0 1 0 434583140 79241216 13495 33554432000 4194304 6211092 140720616759488 140720616757448 5008827 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19346 13495 873 493 0 12651 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 53980 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31116
/proc/meminfo: memFree=28920864/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77384 memory=54024 CPUtime=402.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 64671 0 0 0 40223 5 0 0 20 0 1 0 434583140 79241216 13506 33554432000 4194304 6211092 140720616759488 140720616757448 5102815 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19346 13506 873 493 0 12651 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 54024 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31120
/proc/meminfo: memFree=28920748/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=77384 memory=54036 CPUtime=462.28 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 64940 0 0 0 46223 5 0 0 20 0 1 0 434583140 79241216 13509 33554432000 4194304 6211092 140720616759488 140720616757448 5193696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 19346 13509 873 493 0 12651 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 77384 KiB
Current children cumulated memory: 54036 KiB


################
# More data... #
################

/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 1722.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31324
/proc/meminfo: memFree=28932112/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=1782.29 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 73029 0 0 0 178223 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5102802 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 1782.29 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31328
/proc/meminfo: memFree=28932344/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=1842.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 73341 0 0 0 184224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5074426 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 1842.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31332
/proc/meminfo: memFree=28932244/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=1902.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 73644 0 0 0 190224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5393920 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 1902.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+1962.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/200 31338
/proc/meminfo: memFree=28932032/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=1962.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 73990 0 0 0 196224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5103225 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 1962.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2022.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/200 31350
/proc/meminfo: memFree=28932628/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2022.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 74300 0 0 0 202224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5102842 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2022.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2082.3 s]
/proc/loadavg: 2.09 2.03 2.05 3/200 31354
/proc/meminfo: memFree=28932440/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2082.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 74614 0 0 0 208224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5193696 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2082.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2142.3 s]
/proc/loadavg: 2.44 2.16 2.09 3/201 31360
/proc/meminfo: memFree=28932156/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2142.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 74963 0 0 0 214224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5186210 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2142.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2202.3 s]
/proc/loadavg: 2.16 2.13 2.09 3/200 31364
/proc/meminfo: memFree=28932724/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2202.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 75258 0 0 0 220224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5103225 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2202.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2262.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/200 31368
/proc/meminfo: memFree=28932072/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2262.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 75503 0 0 0 226224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5409453 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2262.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/200 31374
/proc/meminfo: memFree=28932356/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2322.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 75805 0 0 0 232224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5103169 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2322.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/199 31378
/proc/meminfo: memFree=28932400/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2382.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 76105 0 0 0 238224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5193710 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2442.3 s]
/proc/loadavg: 2.06 2.07 2.07 3/199 31382
/proc/meminfo: memFree=28932256/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2442.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 76487 0 0 0 244224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5193710 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2442.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

[startup+2502.3 s]
/proc/loadavg: 2.02 2.06 2.06 3/200 31388
/proc/meminfo: memFree=28931376/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2502.3 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 76781 0 0 0 250224 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5075266 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2502.3 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.02 2.06 2.06 3/199 31389
/proc/meminfo: memFree=28931544/32770688 swapFree=66919992/67108860
[pid=31078] ppid=31075 vsize=80024 memory=56600 CPUtime=2520.01 cores=0-3
/proc/31078/stat : 31078 (cosoco) R 31075 31078 28498 0 -1 4202496 77001 0 0 0 251995 6 0 0 20 0 1 0 434583140 81944576 14150 33554432000 4194304 6211092 140720616759488 140720616757448 5103312 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 18341888 140720616764427 140720616764529 140720616764529 140720616767438 0
/proc/31078/statm: 20006 14150 873 493 0 13311 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 80024 KiB
Current children cumulated memory: 56600 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 31078 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.96 s, system=0.066 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.02
CPU user time (s): 2519.96
CPU system time (s): 0.066
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 80024
Max. memory (cumulated for all children) (KiB): 56600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.96
system time used= 0.066
maximum resident set size= 56664
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 77054
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 36
involuntary context switches= 665


# summary of solver processes directly reported to runsolver:
#   pid: 31078
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2519.96
#   total CPU system time (s): 0.066

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.2398 second user time and 19.9702 second system time

The end

Launcher Data 

Begin job on node120 at 2011-12-17 06:36:31
IDJOB=4396917
IDBENCH=133850
IDSOLVER=2848
FILE ID=node120/4396917-1568585768
RUNJOBID= node120-1324087207-28529
PBS_JOBID= 21703329
Free space on /tmp= 61652 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/QuasiGroups/QuasiGroups-elt-qg7/QuasiGroup-7-39.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396917-1568585768/watcher-4396917-1568585768 -o /tmp/evaluation-result-4396917-1568585768/solver-4396917-1568585768 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node120-1324087207-28529 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396917-1568585768.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5a6cd63004ce40fe2c4de94228743879
RANDOM SEED=156964049

node120.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5329.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        28971160 kB
MemAvailable:   31810976 kB
Buffers:          193880 kB
Cached:          2950216 kB
SwapCached:        77548 kB
Active:          1355108 kB
Inactive:        1888820 kB
Active(anon):      20436 kB
Inactive(anon):   129020 kB
Active(file):    1334672 kB
Inactive(file):  1759800 kB
Unevictable:      107628 kB
Mlocked:          107628 kB
SwapTotal:      67108860 kB
SwapFree:       66919992 kB
Dirty:              3180 kB
Writeback:             0 kB
AnonPages:        142912 kB
Mapped:            53088 kB
Shmem:             41008 kB
Slab:             151592 kB
SReclaimable:     122356 kB
SUnreclaim:        29236 kB
KernelStack:        3760 kB
PageTables:         5780 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     561660 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     94208 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      146880 kB
DirectMap2M:    33398784 kB

Free space on /tmp at the end= 61648 MiB
End job on node120 at 2011-12-17 07:18:31