Trace number 4389432

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.01 2519.8

General information on the benchmark

NameCarSequencing/CarSequencing-m1-jcr/
CarSequencing-60-03.xml
MD5SUM20e15596ff36696b27df04e6639fd466
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark14.7818
Satisfiable
(Un)Satisfiability was proved
Number of variables1200
Number of constraints1369
Number of domains2
Minimum domain size2
Maximum domain size24
Distribution of domain sizes[{"size":2,"count":1000},{"size":24,"count":200}]
Minimum variable degree2
Maximum variable degree53
Distribution of variable degrees[{"degree":2,"count":200},{"degree":3,"count":5},{"degree":4,"count":5},{"degree":5,"count":6},{"degree":6,"count":10},{"degree":7,"count":10},{"degree":8,"count":18},{"degree":9,"count":18},{"degree":10,"count":18},{"degree":11,"count":18},{"degree":12,"count":18},{"degree":13,"count":18},{"degree":14,"count":18},{"degree":15,"count":18},{"degree":16,"count":18},{"degree":17,"count":18},{"degree":18,"count":18},{"degree":19,"count":19},{"degree":20,"count":19},{"degree":21,"count":19},{"degree":22,"count":19},{"degree":23,"count":129},{"degree":24,"count":13},{"degree":25,"count":13},{"degree":26,"count":13},"...",{"degree":29,"count":13}, {"degree":30,"count":13}, {"degree":31,"count":13}, {"degree":32,"count":13}, {"degree":33,"count":13}, {"degree":34,"count":13}, {"degree":35,"count":13}, {"degree":36,"count":14}, {"degree":37,"count":14}, {"degree":38,"count":14}, {"degree":39,"count":15}, {"degree":40,"count":164}, {"degree":41,"count":6}, {"degree":42,"count":6}, {"degree":43,"count":6}, {"degree":44,"count":6}, {"degree":45,"count":6}, {"degree":46,"count":7}, {"degree":47,"count":7}, {"degree":48,"count":72}, {"degree":49,"count":3}, {"degree":50,"count":3}, {"degree":51,"count":4}, {"degree":52,"count":4}, {"degree":53,"count":54}]
Minimum constraint arity2
Maximum constraint arity200
Distribution of constraint arities[{"arity":2,"count":199},{"arity":3,"count":396},{"arity":5,"count":392},{"arity":6,"count":200},{"arity":35,"count":1},{"arity":40,"count":1},{"arity":45,"count":1},{"arity":50,"count":1},{"arity":55,"count":1},{"arity":56,"count":1},{"arity":59,"count":1},{"arity":60,"count":1},{"arity":62,"count":1},{"arity":65,"count":2},{"arity":68,"count":1},{"arity":70,"count":1},{"arity":71,"count":2},{"arity":74,"count":2},{"arity":75,"count":1},{"arity":77,"count":2},{"arity":80,"count":3},{"arity":83,"count":2},{"arity":85,"count":1},{"arity":86,"count":2},{"arity":89,"count":2},"...",{"arity":167,"count":2}, {"arity":168,"count":1}, {"arity":170,"count":5}, {"arity":172,"count":1}, {"arity":173,"count":2}, {"arity":174,"count":1}, {"arity":175,"count":2}, {"arity":176,"count":3}, {"arity":178,"count":1}, {"arity":179,"count":2}, {"arity":180,"count":3}, {"arity":182,"count":3}, {"arity":184,"count":1}, {"arity":185,"count":4}, {"arity":186,"count":1}, {"arity":188,"count":3}, {"arity":190,"count":3}, {"arity":191,"count":2}, {"arity":192,"count":1}, {"arity":194,"count":3}, {"arity":195,"count":2}, {"arity":196,"count":1}, {"arity":197,"count":2}, {"arity":198,"count":1}, {"arity":200,"count":6}]
Number of extensional constraints200
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":200},{"type":"sum","count":1168},{"type":"cardinality","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c Create Cardinality(vars,values,occurs) constraint using 200 Exactly/AtMost.. constraint 
0.00/0.01	c
0.10/0.15	c root propagations     : 0           
0.10/0.15	c restarts enabled, print stats at every restarts
0.10/0.15	c
0.10/0.15	c
0.10/0.15	c
0.10/0.15	c This is cosoco 2.00 --  
0.10/0.15	c
0.10/0.15	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389432-1568339324.xml 
0.10/0.15	c ========================================[ Problem Statistics ]===========================================
0.10/0.15	c |                                                                                                       
0.10/0.15	c |  Parse time        :         0.14 s 
0.10/0.15	c |
0.10/0.15	c |               Variables: 1200
0.10/0.15	c |            Domain Sizes: 2..24
0.10/0.15	c |
0.10/0.15	c |             Constraints: 1392
0.10/0.15	c |                   Arity: 2..200  -- Binary: 199  -- Ternary: 396
0.10/0.15	c | 
0.10/0.15	c |                   Types: 
0.10/0.15	c |                          Exactly K: 24
0.10/0.15	c |                          Extension: 200  (nb tuples: 24..24) -- (shared: 199)
0.10/0.15	c |                          Sum: 1168
0.10/0.15	c |                          
0.10/0.15	c =========================================================================================================
0.10/0.15	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.60/0.63	c 101            1275           88303          23635          0              0              723   774   733
0.89/0.93	c 211            2097           141786         55386          0              0              75   179   158 
1.29/1.35	c 332            3461           220329         72504          0              0              911   959   919
1.69/1.70	c 465            4542           287249         98990          0              0              284   345   320
1.89/1.98	c 611            5449           341419         115109         0              0              179   310   212
2.49/2.51	c 771            6700           429279         134807         0              0              272   534   513
3.09/3.12	c 947            7593           517493         150228         0              0              350   359   354
3.59/3.61	c 1140           8338           612551         166984         0              0              171   431   426
4.09/4.16	c 1352           9428           721729         194919         0              0              153   514   468
4.48/4.56	c 1585           10481          809035         212259         0              0              160   493   483
4.78/4.87	c 1841           11381          876781         226551         0              0              161   508   503
5.19/5.27	c 2122           12514          963330         243018         0              0              160   481   476
5.69/5.74	c 2431           14132          1069570        277674         0              0              164   512   482
6.39/6.40	c 2770           16277          1204888        305650         0              0              292   514   508
6.89/6.96	c 3142           18146          1319305        342987         0              0              332   369   359
8.49/8.57	c 3551           20066          1612153        408752         0              0              327   362   349
9.69/9.78	c 4000           22428          1852595        464787         0              0              318   379   347
10.89/10.91	c 4493           25307          2097188        574692         0              0              270   281   277
12.00/12.02	c 5035           28239          2329544        723363         0              0              141   158   153
13.59/13.62	c 5631           31372          2590239        778168         0              0              145   358   319
15.19/15.21	c 6286           33219          2936731        835525         0              0              283   496   491
16.59/16.62	c 7006           36853          3301528        904266         0              0              404   494   490
17.89/17.90	c 7798           40279          3657895        966379         0              0              501   515   510
19.39/19.42	c 8669           43973          3956583        1022549        0              0              355   436   431
22.10/22.11	c 9627           51172          4562137        1101242        0              0              359   485   468
25.00/25.02	c 10680          55750          5211318        1200259        0              0              347   483   462
27.29/27.32	c 11838          61222          5629201        1328306        0              0              328   370   353
30.19/30.20	c 13111          65845          6234547        1543853        0              0              344   422   419
35.10/35.15	c 14511          70872          7124794        1778270        0              0              315   347   330
37.29/37.39	c 16051          77757          7554935        1859971        0              0              338   445   432
45.20/45.29	c 17745          86511          9192528        2255957        0              0              182   442   417
48.29/48.39	c 19608          98920          9890146        2376568        0              0              307   482   466
50.79/50.84	c 21657          107322         10464789       2554977        0              0              141   498   423
54.39/54.42	c 23910          118155         11290116       2699225        0              0              365   498   492
59.89/59.99	c 26388          132019         12414795       3081099        0              0              184   470   395
66.49/66.59	c 29113          148339         13962911       3329810        0              0              396   529   513
73.79/73.86	c 32110          159197         15102439       3500879        0              0              353   385   375
81.80/81.88	c 35406          170742         16951382       3854074        0              0              362   525   516
89.80/89.89	c 39031          183515         18235900       4034184        0              0              368   392   378
99.40/99.40	c 43018          209395         20951797       4323961        0              0              387   554   553
105.80/105.88	c 47403          236763         22547142       4620505        0              0              393   519   497
127.70/127.72	c 52226          276098         27446737       5244185        0              0              368   523   491
136.40/136.48	c 57531          295018         29245504       5581480        0              0              350   518   417
143.50/143.51	c 63366          317607         30892924       5848279        0              0              361   419   396
165.11/165.11	c 69784          376152         36667378       6584476        0              0              387   544   523
208.51/208.50	c 76843          402305         45723856       7595189        0              0              385   560   526
237.02/237.09	c 84607          474979         53232497       8427538        0              0              515   560   549
257.12/257.18	c 93147          534547         57872955       9074437        0              0              365   526   509
278.12/278.15	c 102541         569269         61839462       9695588        0              0              169   462   439
309.52/309.51	c 112874         616245         69234034       10851580       0              0              354   517   476
331.03/331.05	c 124240         651915         73329075       11512329       0              0              352   376   369
343.42/343.49	c 136742         703504         77186551       12157471       0              0              207   555   550
379.13/379.15	c 150494         755480         82842429       12934079       0              0              179   402   394
440.23/440.23	c 165621         814558         95302997       14942415       0              0              372   509   479
490.04/490.07	c 182260         873463         107076451      17629129       0              0              368   527   498
586.24/586.20	c 200562         982805         129392812      23597599       0              0              351   478   462
752.96/752.98	c 220694         1153159        161335457      32304693       0              0              249   419   340
834.36/834.39	c 242839         1230598        176233755      34832562       0              0              341   455   416
953.57/953.51	c 267198         1414598        201774979      38776866       0              0              346   484   444
1045.88/1045.83	c 293992         1527627        216601263      41761009       0              0              325   379   369
1134.79/1134.79	c 323465         1607193        234985094      44348586       0              0              358   482   459
1216.10/1216.09	c 355885         1766757        255284642      47422279       0              0              366   531   501
1266.00/1265.94	c 391547         1867788        267482412      50106031       0              0              159   495   490
1335.80/1335.71	c 430775         2016650        286787369      52839797       0              0              368   553   542
1392.71/1392.64	c 473925         2121189        300861306      55726405       0              0              394   534   521
1623.33/1623.21	c 521390         2312873        354325164      61988239       0              0              391   536   525
1830.34/1830.22	c 573601         2483538        402222065      72207921       0              0              368   495   477
1969.96/1969.83	c 631033         2853765        432580709      77750416       0              0              204   501   462
2165.07/2164.97	c 694208         3099008        474939254      85437537       0              0              178   509   472
2359.59/2359.41	c 763700         3508298        513964517      91902719       0              0              377   474   446
2520.00/2519.80	
2520.00/2519.80	c *** INTERRUPTED ***
2520.00/2519.80	c restarts              : 70          
2520.00/2519.80	c conflicts             : 826825       (328 /sec)
2520.00/2519.80	c decisions             : 3833139      (1521 /sec)
2520.00/2519.80	c propagations          : 100652895   (39942 /sec)
2520.00/2519.80	c root propagations     : 0           
2520.00/2519.80	c filter calls          : 548562479      (217684 /sec)
2520.00/2519.80	c useless filter calls  : 524359146      (95 %)
2520.00/2519.80	c Memory used           : 40.61 MB
2520.00/2519.80	c CPU time              : 2519.99 s
2520.00/2519.80	c real time             : 2519.8 s
2520.00/2519.80	
2520.00/2519.80	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15337 MiB free)
  memory of node 1: 16384 MiB (15545 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389432-1568339324/watcher-4389432-1568339324 -o /tmp/evaluation-result-4389432-1568339324/solver-4389432-1568339324 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568313599-15140 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389432-1568339324.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=20323, runsolver pid=20320


[startup+0.1002 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 20324
/proc/meminfo: memFree=31616196/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=35144 memory=11468 CPUtime=0.1 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 3085 0 0 0 10 0 0 0 20 0 1 0 409870347 35987456 2867 33554432000 4194304 6210612 140727760235328 140727760231864 5755011 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 8786 2867 846 493 0 2091 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 35144 KiB
Current children cumulated memory: 11468 KiB

[startup+0.209758 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 20324
/proc/meminfo: memFree=31613964/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=37092 memory=13540 CPUtime=0.21 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 3604 0 0 0 21 0 0 0 20 0 1 0 409870347 37982208 3385 33554432000 4194304 6210612 140727760235328 140727760231864 5155888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 9273 3385 889 493 0 2578 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 37092 KiB
Current children cumulated memory: 13540 KiB

[startup+0.309509 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 20324
/proc/meminfo: memFree=31613184/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=37884 memory=14332 CPUtime=0.31 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 3796 0 0 0 31 0 0 0 20 0 1 0 409870347 38793216 3583 33554432000 4194304 6210612 140727760235328 140727760232920 5249694 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 9471 3583 889 493 0 2776 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 37884 KiB
Current children cumulated memory: 14332 KiB

[startup+0.700337 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20324
/proc/meminfo: memFree=31611572/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=39204 memory=15652 CPUtime=0.69 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 4134 0 0 0 69 0 0 0 20 0 1 0 409870347 40144896 3913 33554432000 4194304 6210612 140727760235328 140727760232840 5154977 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 9801 3913 889 493 0 3106 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 39204 KiB
Current children cumulated memory: 15652 KiB

[startup+1.50041 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20324
/proc/meminfo: memFree=31611572/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41188 memory=17764 CPUtime=1.49 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 4626 0 0 0 149 0 0 0 20 0 1 0 409870347 42176512 4441 33554432000 4194304 6210612 140727760235328 140727760232920 5249890 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10297 4441 891 493 0 3602 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 41188 KiB
Current children cumulated memory: 17764 KiB

[startup+3.10951 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20326
/proc/meminfo: memFree=31609508/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41188 memory=17860 CPUtime=3.09 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 7440 0 0 0 309 0 0 0 20 0 1 0 409870347 42176512 4465 33554432000 4194304 6210612 140727760235328 140727760233288 5249899 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10297 4465 891 493 0 3602 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 41188 KiB
Current children cumulated memory: 17860 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20326
/proc/meminfo: memFree=31609380/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18016 CPUtime=6.29 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 10856 0 0 0 628 1 0 0 20 0 1 0 409870347 42446848 4504 33554432000 4194304 6210612 140727760235328 140727760232760 5156540 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4504 891 493 0 3668 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18016 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20326
/proc/meminfo: memFree=31609528/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18104 CPUtime=12.69 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 13776 0 0 0 1268 1 0 0 20 0 1 0 409870347 42446848 4526 33554432000 4194304 6210612 140727760235328 140727760233288 5154973 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4526 891 493 0 3668 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18104 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20326
/proc/meminfo: memFree=31609652/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18120 CPUtime=25.49 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 19758 0 0 0 2548 1 0 0 20 0 1 0 409870347 42446848 4530 33554432000 4194304 6210612 140727760235328 140727760233288 5249674 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4530 891 493 0 3668 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18120 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20329
/proc/meminfo: memFree=31609296/32770624 swapFree=66917680/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18124 CPUtime=51.1 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 23056 0 0 0 5109 1 0 0 20 0 1 0 409870347 42446848 4531 33554432000 4194304 6210612 140727760235328 140727760233288 5155366 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4531 891 493 0 3668 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18124 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20356
/proc/meminfo: memFree=31609224/32770624 swapFree=66917684/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18172 CPUtime=102.3 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 23546 0 0 0 10229 1 0 0 20 0 1 0 409870347 42446848 4543 33554432000 4194304 6210612 140727760235328 140727760233288 5249719 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4543 891 493 0 3668 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18172 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20368
/proc/meminfo: memFree=31609036/32770624 swapFree=66917688/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18176 CPUtime=162.3 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 24035 0 0 0 16229 1 0 0 20 0 1 0 409870347 42446848 4544 33554432000 4194304 6210612 140727760235328 140727760233288 5155287 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4544 891 493 0 3668 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18176 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 20372
/proc/meminfo: memFree=31608892/32770624 swapFree=66917688/67108860
[pid=20323] ppid=20320 vsize=41452 memory=18208 CPUtime=222.31 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 24510 0 0 0 22230 1 0 0 20 0 1 0 409870347 42446848 4552 33554432000 4194304 6210612 140727760235328 140727760233288 5249664 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10363 4552 891 493 0 3668 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 41452 KiB
Current children cumulated memory: 18208 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/201 20378
/proc/meminfo: memFree=31609228/32770624 swapFree=66917688/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18208 CPUtime=282.31 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 24524 0 0 0 28230 1 0 0 20 0 1 0 409870347 42582016 4552 33554432000 4194304 6210612 140727760235328 140727760233288 5397289 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4552 891 493 0 3701 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18208 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/201 20382
/proc/meminfo: memFree=31608872/32770624 swapFree=66917688/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18224 CPUtime=342.32 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 25014 0 0 0 34231 1 0 0 20 0 1 0 409870347 42582016 4556 33554432000 4194304 6210612 140727760235328 140727760233288 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4556 891 493 0 3701 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18224 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20386
/proc/meminfo: memFree=31609524/32770624 swapFree=66917688/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18224 CPUtime=402.32 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 25020 0 0 0 40231 1 0 0 20 0 1 0 409870347 42582016 4556 33554432000 4194304 6210612 140727760235328 140727760233288 5155888 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4556 891 493 0 3701 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18224 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 20393
/proc/meminfo: memFree=31609696/32770624 swapFree=66917692/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18244 CPUtime=462.33 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 25501 0 0 0 46232 1 0 0 20 0 1 0 409870347 42582016 4561 33554432000 4194304 6210612 140727760235328 140727760233288 5249890 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4561 891 493 0 3701 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18244 KiB


################
# More data... #
################

/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 1722.43 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.06 2.10 4/199 20847
/proc/meminfo: memFree=31610012/32770624 swapFree=66917732/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=1782.44 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 30469 0 0 0 178243 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249893 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 1782.44 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.05 2.10 4/199 20851
/proc/meminfo: memFree=31610468/32770624 swapFree=66917732/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=1842.44 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 30620 0 0 0 184243 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 1842.44 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.04 2.09 4/199 20857
/proc/meminfo: memFree=31610356/32770624 swapFree=66917732/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=1902.45 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 30963 0 0 0 190244 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249674 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 1902.45 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.04 2.09 4/201 20870
/proc/meminfo: memFree=31610072/32770624 swapFree=66917740/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=1962.45 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 30967 0 0 0 196244 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5409293 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 1962.45 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.03 2.08 4/201 20874
/proc/meminfo: memFree=31610524/32770624 swapFree=66917740/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2022.46 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 31515 0 0 0 202245 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249890 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2022.46 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.02 2.07 4/201 20880
/proc/meminfo: memFree=31609620/32770624 swapFree=66917740/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2082.46 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 31516 0 0 0 208245 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249727 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2082.46 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.02 2.07 4/201 20884
/proc/meminfo: memFree=31609588/32770624 swapFree=66917740/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2142.47 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 31823 0 0 0 214246 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5154980 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2142.47 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.06 4/201 20888
/proc/meminfo: memFree=31609592/32770624 swapFree=66917740/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2202.47 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 31996 0 0 0 220246 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5156265 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2202.47 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.06 3/200 20896
/proc/meminfo: memFree=31609208/32770624 swapFree=66917744/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2262.48 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 32311 0 0 0 226247 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5156088 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20900
/proc/meminfo: memFree=31608752/32770624 swapFree=66917744/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2322.48 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 32385 0 0 0 232247 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5156568 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2322.48 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20904
/proc/meminfo: memFree=31609488/32770624 swapFree=66917744/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2382.49 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 32850 0 0 0 238248 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5154977 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2382.49 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20911
/proc/meminfo: memFree=31609168/32770624 swapFree=66917748/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2442.49 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 32866 0 0 0 244248 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5156097 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2442.49 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20915
/proc/meminfo: memFree=31609572/32770624 swapFree=66917748/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2502.5 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 33166 0 0 0 250249 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5249712 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2502.5 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 20922
/proc/meminfo: memFree=31609492/32770624 swapFree=66917752/67108860
[pid=20323] ppid=20320 vsize=41584 memory=18256 CPUtime=2520 cores=0,2,4,6
/proc/20323/stat : 20323 (cosoco) R 20320 20323 15109 0 -1 4202496 33166 0 0 0 251999 1 0 0 20 0 1 0 409870347 42582016 4564 33554432000 4194304 6210612 140727760235328 140727760233288 5155872 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28155904 140727760241675 140727760241777 140727760241777 140727760244686 0
/proc/20323/statm: 10396 4564 891 493 0 3701 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 41584 KiB
Current children cumulated memory: 18256 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 20323 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.017001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2520
CPU system time (s): 0.017001
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 41584
Max. memory (cumulated for all children) (KiB): 18256

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.017001
maximum resident set size= 18324
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33219
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20
involuntary context switches= 3152


# summary of solver processes directly reported to runsolver:
#   pid: 20323
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.017001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.31209 second user time and 16.6611 second system time

The end

Launcher Data 

Begin job on node141 at 2019-09-13 03:48:03
IDJOB=4389432
IDBENCH=128111
IDSOLVER=2829
FILE ID=node141/4389432-1568339324
RUNJOBID= node141-1568313599-15140
PBS_JOBID= 21701135
Free space on /tmp= 56108 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/CarSequencing/CarSequencing-m1-jcr/CarSequencing-60-03.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389432-1568339324/watcher-4389432-1568339324 -o /tmp/evaluation-result-4389432-1568339324/solver-4389432-1568339324 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node141-1568313599-15140 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389432-1568339324.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 20e15596ff36696b27df04e6639fd466
RANDOM SEED=1395472138

node141.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31624040 kB
MemAvailable:   31841848 kB
Buffers:          131452 kB
Cached:           373728 kB
SwapCached:        81696 kB
Active:           234552 kB
Inactive:         359472 kB
Active(anon):      12788 kB
Inactive(anon):   106144 kB
Active(file):     221764 kB
Inactive(file):   253328 kB
Unevictable:      109212 kB
Mlocked:          109212 kB
SwapTotal:      67108860 kB
SwapFree:       66917680 kB
Dirty:              2708 kB
Writeback:             0 kB
AnonPages:        128584 kB
Mapped:            35236 kB
Shmem:             21728 kB
Slab:             146800 kB
SReclaimable:     117100 kB
SUnreclaim:        29700 kB
KernelStack:        3760 kB
PageTables:         5216 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     530956 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     79872 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      128384 kB
DirectMap2M:    33417216 kB

Free space on /tmp at the end= 56104 MiB
End job on node141 at 2019-09-13 04:30:03