Trace number 4408120

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.79 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-07.xml
MD5SUMcae06e42b01baa71e2bfd0e1b4deb8b1
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark18.1078
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4368        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408120-1569810969.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            990            11914          32998          880            0              601   701   650
0.10/0.13	c 211            2245           24200          81711          880            0              397   683   634
0.21/0.24	c 332            3743           44681          165917         880            0              486   683   648
0.21/0.31	c 465            4966           57887          220057         880            0              528   666   622
0.31/0.41	c 611            6706           76012          283242         880            0              545   626   594
0.51/0.54	c 771            8460           100439         385931         880            0              567   694   648
0.60/0.69	c 947            10250          128322         500850         880            0              545   682   660
0.79/0.86	c 1140           12038          158387         641011         880            0              546   692   665
1.00/1.03	c 1352           14102          188952         778722         880            0              559   686   655
1.10/1.18	c 1585           16266          217417         899940         880            0              547   682   653
1.29/1.36	c 1841           19053          250600         1055791        880            0              591   715   686
1.49/1.59	c 2122           21477          292692         1240029        880            0              562   710   664
1.59/1.65	c 2431           22944          303258         1276955        880            0              558   622   595
1.69/1.71	c 2770           24645          314721         1317226        880            0              548   577   554
1.89/1.97	c 3142           28011          364449         1556998        880            0              530   737   618
2.29/2.33	c 3551           31927          428360         1870893        880            0              544   721   675
2.39/2.46	c 4000           34387          453353         1985072        880            0              552   678   624
2.79/2.80	c 4493           37886          513805         2302469        880            0              524   722   620
3.10/3.14	c 5035           40874          576426         2603433        880            0              514   714   675
3.59/3.63	c 5631           46106          665406         3049694        880            0              535   740   682
4.10/4.15	c 6286           50692          760229         3514085        880            0              540   762   718
4.49/4.55	c 7006           55667          833132         3848807        880            0              544   720   663
5.10/5.12	c 7798           60626          935849         4375720        880            0              544   707   678
5.59/5.68	c 8669           67913          1037440        4862593        880            0              546   700   660
6.39/6.47	c 9627           74475          1179199        5545130        880            0              549   704   670
7.19/7.29	c 10680          82274          1328079        6288646        880            0              552   732   685
7.99/8.03	c 11838          89846          1463032        6931871        880            0              554   708   676
8.99/9.03	c 13111          98482          1642626        7818850        880            0              563   725   688
9.69/9.78	c 14511          106582         1778672        8505356        880            0              565   731   697
10.88/10.95	c 16051          116537         1991674        9545000        880            0              630   729   694
11.88/12.00	c 17745          127628         2181932        10476102       880            0              555   729   691
13.58/13.61	c 19608          140387         2469921        11963460       880            0              562   730   697
14.88/15.00	c 21657          151519         2721668        13183652       880            0              566   722   695
16.48/16.50	c 23910          165558         2991313        14603253       880            0              642   732   684
18.48/18.55	c 26388          179660         3356867        16388285       880            0              637   712   673
20.48/20.59	c 29113          197563         3722379        18294885       880            0              639   724   680
22.99/23.03	c 32110          218878         4160973        20666729       880            0              579   737   695
25.48/25.52	c 35406          236847         4606129        23291280       880            0              601   742   709
28.78/28.80	c 39031          262453         5189733        26463663       880            0              661   744   699
31.88/31.94	c 43018          293898         5758497        29626231       880            0              650   755   709
35.58/35.67	c 47403          323826         6432717        33120963       880            0              643   738   684
39.18/39.24	c 52226          355381         7070517        36722950       880            0              591   729   687
43.09/43.12	c 57531          388856         7774564        40229837       880            0              588   730   696
47.48/47.52	c 63366          424759         8563353        44203841       880            0              592   717   684
52.09/52.11	c 69784          458733         9380705        48572918       880            0              582   702   673
57.58/57.61	c 76843          503888         10366699       53619302       880            0              610   733   692
63.78/63.85	c 84607          558273         11487987       59455298       880            0              604   726   690
70.88/71.00	c 93147          616255         12768023       66011209       880            0              595   725   682
79.09/79.16	c 102541         674563         14220707       73785585       880            0              646   730   685
88.28/88.34	c 112874         741144         15866276       82265929       880            0              616   715   671
95.48/95.51	c 124240         796970         17142735       88942004       880            0              607   735   690
105.09/105.17	c 136742         880071         18875605       98198664       880            0              599   737   687
115.98/116.04	c 150494         979167         20850879       107360404      880            0              610   734   686
126.67/126.76	c 165621         1065505        22771079       117047201      880            0              631   724   678
138.98/139.07	c 182260         1170780        24991272       127860212      880            0              567   727   681
150.57/150.66	c 200562         1253438        27059371       139105074      880            0              637   727   684
162.27/162.39	c 220694         1347889        29158915       150430048      880            0              631   733   681
176.08/176.16	c 242839         1465466        31647491       162745525      880            0              602   726   682
192.87/192.94	c 267198         1600981        34664558       177821191      880            0              592   709   678
212.87/212.97	c 293992         1771390        38279919       195671032      880            0              598   709   670
237.67/237.72	c 323465         1949642        42715848       217493889      880            0              594   735   682
258.16/258.27	c 355885         2117465        46402556       236797847      880            0              593   713   669
284.16/284.25	c 391547         2319434        51067306       260186508      880            0              609   705   661
315.16/315.29	c 430775         2561710        56654761       287973990      880            0              609   725   676
347.96/348.04	c 473925         2797719        62497030       319037760      880            0              636   711   669
380.35/380.47	c 521390         3058693        68309882       348972289      880            0              622   712   666
413.65/413.71	c 573601         3321853        74266201       381239074      880            0              623   707   669
445.25/445.36	c 631033         3578219        79927712       413689825      880            0              631   715   676
479.74/479.88	c 694208         3906194        86157949       446481489      880            0              627   704   669
522.64/522.79	c 763700         4249751        93835825       487623238      880            0              625   713   677
574.05/574.15	c 840141         4709416        103097341      536566002      880            0              626   722   676
642.83/643.00	c 924226         5195543        115397536      600674757      880            0              609   719   671
716.32/716.40	c 1016719        5735353        128549458      668879304      880            0              588   733   685
774.03/774.16	c 1118461        6224792        138860840      722272007      880            0              594   728   679
825.61/825.79	c 1230377        6690524        148180849      768597679      880            0              597   722   671
906.11/906.27	c 1353484        7282854        162638038      847508652      880            0              588   719   670
1009.01/1009.14	c 1488901        8107554        180967944      944668911      880            0              567   764   700
1101.09/1101.21	c 1637859        8771317        197411863      1024929906     880            0              620   715   679
1237.68/1237.82	c 1801712        9662878        221598766      1159051401     880            0              603   712   665
1377.67/1377.81	c 1981950        10765072       246799963      1296351671     880            0              609   747   689
1518.55/1518.75	c 2180211        12019223       272416886      1430407679     880            0              626   757   694
1682.64/1682.82	c 2398298        13260925       301735961      1590759821     880            0              628   749   688
1844.13/1844.31	c 2638193        14645234       330862038      1750737447     880            0              632   745   686
2077.11/2077.31	c 2902077        16503396       372598646      1970226046     880            0              584   755   690
2285.29/2285.52	c 3192349        18314577       409963439      2166861627     880            0              599   747   688
2519.77/2520.00	
2519.77/2520.00	c *** INTERRUPTED ***
2519.77/2520.00	c restarts              : 85          
2519.77/2520.00	c conflicts             : 3495989      (1387 /sec)
2519.77/2520.00	c decisions             : 20430007     (8108 /sec)
2519.77/2520.00	c propagations          : 2381284717  (945037 /sec)
2519.77/2520.00	c root propagations     : 4368        
2519.77/2520.00	c filter calls          : 452497070      (179578 /sec)
2519.77/2520.00	c useless filter calls  : 114186430      (25 %)
2519.77/2520.00	c Memory used           : 32.39 MB
2519.77/2520.00	c CPU time              : 2519.78 s
2519.77/2520.00	c real time             : 2520 s
2519.77/2520.00	
2519.77/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15397 MiB free)
  memory of node 1: 16384 MiB (15703 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408120-1569810969/watcher-4408120-1569810969 -o /tmp/evaluation-result-4408120-1569810969/solver-4408120-1569810969 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1569787354-10133 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4408120-1569810969.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=15849, runsolver pid=15846
Current StackSize limit: 8192 KiB


[startup+0.100146 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31841848/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=32768 memory=9232 CPUtime=0.1 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 2487 0 0 0 10 0 0 0 20 0 1 0 557369360 33554432 2308 33554432000 4194304 6211132 140724029878288 140724029875880 140287497645029 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8192 2308 866 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9232 KiB

[startup+0.209875 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31841924/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=32900 memory=9232 CPUtime=0.21 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 2523 0 0 0 21 0 0 0 20 0 1 0 557369360 33689600 2308 33554432000 4194304 6211132 140724029878288 140724029875880 5081762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8225 2308 866 493 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9232 KiB

[startup+0.309088 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31841924/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=32900 memory=9232 CPUtime=0.31 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 2535 0 0 0 31 0 0 0 20 0 1 0 557369360 33689600 2308 33554432000 4194304 6211132 140724029878288 140724029875880 140287498083424 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8225 2308 866 493 0 1530 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9232 KiB

[startup+0.70027 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31841552/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33032 memory=9496 CPUtime=0.69 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 2556 0 0 0 69 0 0 0 20 0 1 0 557369360 33824768 2374 33554432000 4194304 6211132 140724029878288 140724029875880 5074400 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8258 2374 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9496 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31841552/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33032 memory=9496 CPUtime=1.49 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 2576 0 0 0 149 0 0 0 20 0 1 0 557369360 33824768 2374 33554432000 4194304 6211132 140724029878288 140724029876248 5075974 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8258 2374 866 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9496 KiB

[startup+3.10919 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 15850
/proc/meminfo: memFree=31840184/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33032 memory=9672 CPUtime=3.1 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 3025 0 0 0 310 0 0 0 20 0 1 0 557369360 33824768 2418 33554432000 4194304 6211132 140724029878288 140724029876248 5075263 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8258 2418 866 493 0 1563 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9672 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15850
/proc/meminfo: memFree=31840220/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9696 CPUtime=6.29 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 3482 0 0 0 629 0 0 0 20 0 1 0 557369360 33959936 2424 33554432000 4194304 6211132 140724029878288 140724029876248 5081337 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2424 866 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9696 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15911
/proc/meminfo: memFree=31841384/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9724 CPUtime=12.68 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 3940 0 0 0 1268 0 0 0 20 0 1 0 557369360 33959936 2431 33554432000 4194304 6211132 140724029878288 140724029876248 5081349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2431 866 493 0 1596 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9724 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15911
/proc/meminfo: memFree=31841320/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9736 CPUtime=25.48 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 4852 0 0 0 2548 0 0 0 20 0 1 0 557369360 33959936 2434 33554432000 4194304 6211132 140724029878288 140724029876248 5074703 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2434 866 493 0 1596 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9736 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15913
/proc/meminfo: memFree=31841160/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9744 CPUtime=51.09 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 5317 0 0 0 5109 0 0 0 20 0 1 0 557369360 33959936 2436 33554432000 4194304 6211132 140724029878288 140724029876248 5081355 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2436 866 493 0 1596 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9744 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15917
/proc/meminfo: memFree=31840392/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9752 CPUtime=102.28 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 5785 0 0 0 10228 0 0 0 20 0 1 0 557369360 33959936 2438 33554432000 4194304 6211132 140724029878288 140724029876248 5079432 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2438 866 493 0 1596 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9752 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15921
/proc/meminfo: memFree=31841052/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9764 CPUtime=162.27 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 6253 0 0 0 16227 0 0 0 20 0 1 0 557369360 33959936 2441 33554432000 4194304 6211132 140724029878288 140724029876248 5075234 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2441 866 493 0 1596 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9764 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15925
/proc/meminfo: memFree=31840548/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9768 CPUtime=222.27 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 6718 0 0 0 22227 0 0 0 20 0 1 0 557369360 33959936 2442 33554432000 4194304 6211132 140724029878288 140724029876248 5193742 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2442 866 493 0 1596 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15938
/proc/meminfo: memFree=31840144/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9768 CPUtime=282.26 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 7183 0 0 0 28226 0 0 0 20 0 1 0 557369360 33959936 2442 33554432000 4194304 6211132 140724029878288 140724029876248 5075269 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2442 866 493 0 1596 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15942
/proc/meminfo: memFree=31840488/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9776 CPUtime=342.26 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 7648 0 0 0 34226 0 0 0 20 0 1 0 557369360 33959936 2444 33554432000 4194304 6211132 140724029878288 140724029876248 5075625 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2444 866 493 0 1596 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9776 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15946
/proc/meminfo: memFree=31840100/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9776 CPUtime=402.25 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 8111 0 0 0 40225 0 0 0 20 0 1 0 557369360 33959936 2444 33554432000 4194304 6211132 140724029878288 140724029876248 5392594 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2444 866 493 0 1596 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9776 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 15952
/proc/meminfo: memFree=31840092/32770624 swapFree=66947636/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9776 CPUtime=462.25 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 8578 0 0 0 46225 0 0 0 20 0 1 0 557369360 33959936 2444 33554432000 4194304 6211132 140724029878288 140724029876248 5074419 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2444 866 493 0 1596 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9776 KiB


################
# More data... #
################

/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 1722.14 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16095
/proc/meminfo: memFree=31838844/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=1782.13 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 16716 0 0 0 178213 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5074850 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 1782.13 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16099
/proc/meminfo: memFree=31839092/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=1842.13 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 16954 0 0 0 184213 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5082823 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 1842.13 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16105
/proc/meminfo: memFree=31838572/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=1902.12 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 17422 0 0 0 190212 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5075245 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 1902.12 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16109
/proc/meminfo: memFree=31838800/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=1962.12 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 17654 0 0 0 196212 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5078967 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 1962.12 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16113
/proc/meminfo: memFree=31839168/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2022.11 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 17885 0 0 0 202211 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5079246 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2022.11 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16127
/proc/meminfo: memFree=31839112/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2082.11 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 18352 0 0 0 208211 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5075221 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2082.11 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16131
/proc/meminfo: memFree=31839120/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2142.1 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 18576 0 0 0 214210 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2142.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16135
/proc/meminfo: memFree=31838628/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2202.09 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 18798 0 0 0 220209 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5082717 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2202.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16141
/proc/meminfo: memFree=31838980/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2262.09 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 19022 0 0 0 226209 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2262.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 16145
/proc/meminfo: memFree=31839108/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2322.08 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 19489 0 0 0 232208 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5081301 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2322.08 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16149
/proc/meminfo: memFree=31838628/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2382.08 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 19711 0 0 0 238208 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5079336 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2382.08 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16155
/proc/meminfo: memFree=31838560/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2442.07 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 19937 0 0 0 244207 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5082468 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2442.07 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 16159
/proc/meminfo: memFree=31838784/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2502.07 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 20158 0 0 0 250207 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5075234 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2502.07 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 16162
/proc/meminfo: memFree=31838116/32770624 swapFree=66947644/67108860
[pid=15849] ppid=15846 vsize=33164 memory=9784 CPUtime=2519.77 cores=0,2,4,6
/proc/15849/stat : 15849 (cosoco) R 15846 15849 10102 0 -1 4202496 20379 0 0 0 251977 0 0 0 20 0 1 0 557369360 33959936 2446 33554432000 4194304 6211132 140724029878288 140724029876248 5079333 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 35414016 140724029883403 140724029883505 140724029883505 140724029886414 0
/proc/15849/statm: 8291 2446 866 493 0 1596 0
Current children cumulated CPU time: 2519.77 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 15849 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.78 s, system=0.008999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.79
CPU user time (s): 2519.78
CPU system time (s): 0.008999
CPU usage (%): 99.9913
Max. virtual memory (cumulated for all children) (KiB): 33164
Max. memory (cumulated for all children) (KiB): 9784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.78
system time used= 0.008999
maximum resident set size= 9848
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20430
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 3151


# summary of solver processes directly reported to runsolver:
#   pid: 15849
#   total CPU time (s): 2519.79
#   total CPU user time (s): 2519.78
#   total CPU system time (s): 0.008999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1282 second user time and 15.2798 second system time

The end

Launcher Data 

Begin job on node150 at 2019-09-30 04:35:28
IDJOB=4408120
IDBENCH=138974
IDSOLVER=2874
FILE ID=node150/4408120-1569810969
RUNJOBID= node150-1569787354-10133
PBS_JOBID= 21705815
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-07.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408120-1569810969/watcher-4408120-1569810969 -o /tmp/evaluation-result-4408120-1569810969/solver-4408120-1569810969 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1569787354-10133 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4408120-1569810969.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cae06e42b01baa71e2bfd0e1b4deb8b1
RANDOM SEED=910054828

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31847812 kB
MemAvailable:   31929192 kB
Buffers:          143736 kB
Cached:           224668 kB
SwapCached:         5528 kB
Active:           162724 kB
Inactive:         218936 kB
Active(anon):      15668 kB
Inactive(anon):    21808 kB
Active(file):     147056 kB
Inactive(file):   197128 kB
Unevictable:      110020 kB
Mlocked:          110020 kB
SwapTotal:      67108860 kB
SwapFree:       66947636 kB
Dirty:              2736 kB
Writeback:             0 kB
AnonPages:        224068 kB
Mapped:            28544 kB
Shmem:             15664 kB
Slab:             134952 kB
SReclaimable:     106060 kB
SUnreclaim:        28892 kB
KernelStack:        3568 kB
PageTables:         5572 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     575152 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    176128 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:       99712 kB
DirectMap2M:    33445888 kB

Free space on /tmp at the end= 62024 MiB
End job on node150 at 2019-09-30 05:17:28