Trace number 4389580

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-07.xml
MD5SUMcae06e42b01baa71e2bfd0e1b4deb8b1
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark18.1078
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4368        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389580-1568358528.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            990            11914          32998          880            0              601   701   650
0.10/0.13	c 211            2245           24200          81711          880            0              397   683   634
0.21/0.24	c 332            3743           44681          165917         880            0              486   683   648
0.31/0.31	c 465            4966           57887          220057         880            0              528   666   622
0.31/0.41	c 611            6706           76012          283242         880            0              545   626   594
0.51/0.55	c 771            8460           100439         385931         880            0              567   694   648
0.69/0.70	c 947            10250          128322         500850         880            0              545   682   660
0.79/0.87	c 1140           12038          158387         641011         880            0              546   692   665
1.00/1.04	c 1352           14102          188952         778722         880            0              559   686   655
1.10/1.19	c 1585           16266          217417         899940         880            0              547   682   653
1.29/1.37	c 1841           19053          250600         1055791        880            0              591   715   686
1.59/1.61	c 2122           21477          292692         1240029        880            0              562   710   664
1.59/1.66	c 2431           22944          303258         1276955        880            0              558   622   595
1.69/1.72	c 2770           24645          314721         1317226        880            0              548   577   554
1.89/1.99	c 3142           28011          364449         1556998        880            0              530   737   618
2.29/2.35	c 3551           31927          428360         1870893        880            0              544   721   675
2.39/2.49	c 4000           34387          453353         1985072        880            0              552   678   624
2.79/2.83	c 4493           37886          513805         2302469        880            0              524   722   620
3.10/3.18	c 5035           40874          576426         2603433        880            0              514   714   675
3.59/3.68	c 5631           46106          665406         3049694        880            0              535   740   682
4.19/4.21	c 6286           50692          760229         3514085        880            0              540   762   718
4.59/4.61	c 7006           55667          833132         3848807        880            0              544   720   663
5.10/5.19	c 7798           60626          935849         4375720        880            0              544   707   678
5.69/5.76	c 8669           67913          1037440        4862593        880            0              546   700   660
6.49/6.56	c 9627           74475          1179199        5545130        880            0              549   704   670
7.39/7.40	c 10680          82274          1328079        6288646        880            0              552   732   685
8.10/8.15	c 11838          89846          1463032        6931871        880            0              554   708   676
9.10/9.16	c 13111          98482          1642626        7818850        880            0              563   725   688
9.89/9.93	c 14511          106582         1778672        8505356        880            0              565   731   697
11.10/11.12	c 16051          116537         1991674        9545000        880            0              630   729   694
12.10/12.18	c 17745          127628         2181932        10476102       880            0              555   729   691
13.79/13.81	c 19608          140387         2469921        11963460       880            0              562   730   697
15.19/15.23	c 21657          151519         2721668        13183652       880            0              566   722   695
16.69/16.75	c 23910          165558         2991313        14603253       880            0              642   732   684
18.79/18.83	c 26388          179660         3356867        16388285       880            0              637   712   673
20.89/20.90	c 29113          197563         3722379        18294885       880            0              639   724   680
23.29/23.37	c 32110          218878         4160973        20666729       880            0              579   737   695
25.89/25.90	c 35406          236847         4606129        23291280       880            0              601   742   709
29.19/29.22	c 39031          262453         5189733        26463663       880            0              661   744   699
32.39/32.41	c 43018          293898         5758497        29626231       880            0              650   755   709
36.19/36.20	c 47403          323826         6432717        33120963       880            0              643   738   684
39.79/39.82	c 52226          355381         7070517        36722950       880            0              591   729   687
43.69/43.76	c 57531          388856         7774564        40229837       880            0              588   730   696
48.19/48.22	c 63366          424759         8563353        44203841       880            0              592   717   684
52.78/52.89	c 69784          458733         9380705        48572918       880            0              582   702   673
58.38/58.47	c 76843          503888         10366699       53619302       880            0              610   733   692
64.78/64.80	c 84607          558273         11487987       59455298       880            0              604   726   690
71.99/72.06	c 93147          616255         12768023       66011209       880            0              595   725   682
80.28/80.30	c 102541         674563         14220707       73785585       880            0              646   730   685
89.48/89.57	c 112874         741144         15866276       82265929       880            0              616   715   671
96.78/96.80	c 124240         796970         17142735       88942004       880            0              607   735   690
106.48/106.53	c 136742         880071         18875605       98198664       880            0              599   737   687
117.48/117.50	c 150494         979167         20850879       107360404      880            0              610   734   686
128.28/128.32	c 165621         1065505        22771079       117047201      880            0              631   724   678
140.68/140.74	c 182260         1170780        24991272       127860212      880            0              567   727   681
152.38/152.44	c 200562         1253438        27059371       139105074      880            0              637   727   684
164.18/164.27	c 220694         1347889        29158915       150430048      880            0              631   733   681
178.09/178.17	c 242839         1465466        31647491       162745525      880            0              602   726   682
195.09/195.11	c 267198         1600981        34664558       177821191      880            0              592   709   678
215.28/215.31	c 293992         1771390        38279919       195671032      880            0              598   709   670
240.18/240.28	c 323465         1949642        42715848       217493889      880            0              594   735   682
260.99/261.04	c 355885         2117465        46402556       236797847      880            0              593   713   669
287.18/287.26	c 391547         2319434        51067306       260186508      880            0              609   705   661
318.58/318.61	c 430775         2561710        56654761       287973990      880            0              609   725   676
351.58/351.67	c 473925         2797719        62497030       319037760      880            0              636   711   669
384.38/384.41	c 521390         3058693        68309882       348972289      880            0              622   712   666
417.88/417.95	c 573601         3321853        74266201       381239074      880            0              623   707   669
449.78/449.86	c 631033         3578219        79927712       413689825      880            0              631   715   676
484.68/484.72	c 694208         3906194        86157949       446481489      880            0              627   704   669
527.98/528.03	c 763700         4249751        93835825       487623238      880            0              625   713   677
579.78/579.87	c 840141         4709416        103097341      536566002      880            0              626   722   676
649.28/649.33	c 924226         5195543        115397536      600674757      880            0              609   719   671
723.38/723.46	c 1016719        5735353        128549458      668879304      880            0              588   733   685
781.68/781.74	c 1118461        6224792        138860840      722272007      880            0              594   728   679
833.78/833.85	c 1230377        6690524        148180849      768597679      880            0              597   722   671
914.88/914.99	c 1353484        7282854        162638038      847508652      880            0              588   719   670
1018.58/1018.62	c 1488901        8107554        180967944      944668911      880            0              567   764   700
1111.58/1111.64	c 1637859        8771317        197411863      1024929906     880            0              620   715   679
1249.48/1249.56	c 1801712        9662878        221598766      1159051401     880            0              603   712   665
1390.68/1390.71	c 1981950        10765072       246799963      1296351671     880            0              609   747   689
1532.88/1532.97	c 2180211        12019223       272416886      1430407679     880            0              626   757   694
1698.38/1698.40	c 2398298        13260925       301735961      1590759821     880            0              628   749   688
1861.09/1861.18	c 2638193        14645234       330862038      1750737447     880            0              632   745   686
2095.99/2096.08	c 2902077        16503396       372598646      1970226046     880            0              584   755   690
2306.18/2306.25	c 3192349        18314577       409963439      2166861627     880            0              599   747   688
2519.99/2520.00	
2519.99/2520.00	c *** INTERRUPTED ***
2519.99/2520.00	c restarts              : 85          
2519.99/2520.00	c conflicts             : 3462897      (1374 /sec)
2519.99/2520.00	c decisions             : 20194643     (8014 /sec)
2519.99/2520.00	c propagations          : 2361058471  (936935 /sec)
2519.99/2520.00	c root propagations     : 4368        
2519.99/2520.00	c filter calls          : 448361880      (177923 /sec)
2519.99/2520.00	c useless filter calls  : 113029326      (25 %)
2519.99/2520.00	c Memory used           : 32.39 MB
2519.99/2520.00	c CPU time              : 2519.98 s
2519.99/2520.00	c real time             : 2520 s
2519.99/2520.00	
2519.99/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10683 MiB free)
  memory of node 1: 16384 MiB (13038 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389580-1568358528/watcher-4389580-1568358528 -o /tmp/evaluation-result-4389580-1568358528/solver-4389580-1568358528 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node143-1568358487-22329 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389580-1568358528.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22355, runsolver pid=22350

[startup+0.100196 s]*
/proc/loadavg: 1.00 1.05 1.40 3/199 22360
/proc/meminfo: memFree=24281048/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=32768 memory=9200 CPUtime=0.1 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 2482 0 0 0 10 0 0 0 20 0 1 0 411790153 33554432 2300 33554432000 4194304 6210612 140721168044992 140721168041528 140550547413822 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8192 2300 862 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.20977 s]*
/proc/loadavg: 1.00 1.05 1.40 3/199 22360
/proc/meminfo: memFree=24280428/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=32900 memory=9200 CPUtime=0.21 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 2519 0 0 0 21 0 0 0 20 0 1 0 411790153 33689600 2300 33554432000 4194304 6210612 140721168044992 140721168041528 5075503 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8225 2300 862 493 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9200 KiB

[startup+0.309149 s]*
/proc/loadavg: 1.00 1.05 1.40 3/199 22360
/proc/meminfo: memFree=24280056/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=32900 memory=9464 CPUtime=0.31 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 2531 0 0 0 31 0 0 0 20 0 1 0 411790153 33689600 2366 33554432000 4194304 6210612 140721168044992 140721168041528 5079006 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8225 2366 862 493 0 1530 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700332 s]
/proc/loadavg: 1.00 1.05 1.40 3/199 22360
/proc/meminfo: memFree=24279684/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33032 memory=9464 CPUtime=0.69 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 2552 0 0 0 69 0 0 0 20 0 1 0 411790153 33824768 2366 33554432000 4194304 6210612 140721168044992 140721168041528 5082455 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+1.50035 s]
/proc/loadavg: 1.00 1.05 1.40 3/199 22360
/proc/meminfo: memFree=24279684/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33032 memory=9464 CPUtime=1.49 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 2572 0 0 0 149 0 0 0 20 0 1 0 411790153 33824768 2366 33554432000 4194304 6210612 140721168044992 140721168042952 5192892 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+3.10932 s]
/proc/loadavg: 1.08 1.07 1.40 3/199 22360
/proc/meminfo: memFree=24279484/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33032 memory=9656 CPUtime=3.1 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 4028 0 0 0 310 0 0 0 20 0 1 0 411790153 33824768 2414 33554432000 4194304 6210612 140721168044992 140721168042952 5075375 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8258 2414 862 493 0 1563 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9656 KiB

[startup+6.30034 s]
/proc/loadavg: 1.08 1.07 1.40 3/199 22360
/proc/meminfo: memFree=24280412/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9680 CPUtime=6.29 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 5495 0 0 0 629 0 0 0 20 0 1 0 411790153 33959936 2420 33554432000 4194304 6210612 140721168044992 140721168042952 5074824 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2420 862 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9680 KiB

[startup+12.7003 s]
/proc/loadavg: 1.22 1.10 1.41 3/199 22360
/proc/meminfo: memFree=24281272/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9708 CPUtime=12.69 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 6965 0 0 0 1269 0 0 0 20 0 1 0 411790153 33959936 2427 33554432000 4194304 6210612 140721168044992 140721168042952 5082450 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2427 862 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9708 KiB

[startup+25.5004 s]
/proc/loadavg: 1.34 1.13 1.42 3/199 22360
/proc/meminfo: memFree=24282668/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9716 CPUtime=25.49 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 9895 0 0 0 2549 0 0 0 20 0 1 0 411790153 33959936 2429 33554432000 4194304 6210612 140721168044992 140721168042952 5081014 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2429 862 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9716 KiB

[startup+51.109 s]
/proc/loadavg: 1.57 1.20 1.43 3/199 22363
/proc/meminfo: memFree=24281892/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9728 CPUtime=51.09 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 11373 0 0 0 5109 0 0 0 20 0 1 0 411790153 33959936 2432 33554432000 4194304 6210612 140721168044992 140721168042952 5076031 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2432 862 493 0 1596 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9728 KiB

[startup+102.3 s]
/proc/loadavg: 1.83 1.33 1.46 3/199 22367
/proc/meminfo: memFree=24281060/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9736 CPUtime=102.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 12852 0 0 0 10228 0 0 0 20 0 1 0 411790153 33959936 2434 33554432000 4194304 6210612 140721168044992 140721168042952 5082450 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2434 862 493 0 1596 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9736 KiB

[startup+162.3 s]
/proc/loadavg: 1.94 1.45 1.50 3/200 22379
/proc/meminfo: memFree=24280804/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9748 CPUtime=162.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 13319 0 0 0 16228 0 0 0 20 0 1 0 411790153 33959936 2437 33554432000 4194304 6210612 140721168044992 140721168042952 5079064 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2437 862 493 0 1596 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9748 KiB

[startup+222.3 s]
/proc/loadavg: 1.98 1.55 1.53 3/200 22385
/proc/meminfo: memFree=24280584/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9752 CPUtime=222.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 13787 0 0 0 22228 0 0 0 20 0 1 0 411790153 33959936 2438 33554432000 4194304 6210612 140721168044992 140721168042952 5074824 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2438 862 493 0 1596 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9752 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.63 1.56 3/200 22389
/proc/meminfo: memFree=24280684/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9752 CPUtime=282.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 14252 0 0 0 28228 0 0 0 20 0 1 0 411790153 33959936 2438 33554432000 4194304 6210612 140721168044992 140721168042952 5080933 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2438 862 493 0 1596 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9752 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.70 1.59 3/200 22393
/proc/meminfo: memFree=24281080/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9760 CPUtime=342.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 14717 0 0 0 34228 0 0 0 20 0 1 0 411790153 33959936 2440 33554432000 4194304 6210612 140721168044992 140721168042952 5078394 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2440 862 493 0 1596 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9760 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.76 1.61 3/200 22399
/proc/meminfo: memFree=24280932/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9760 CPUtime=402.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 15181 0 0 0 40228 0 0 0 20 0 1 0 411790153 33959936 2440 33554432000 4194304 6210612 140721168044992 140721168042952 5080969 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2440 862 493 0 1596 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9760 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.80 1.64 3/199 22403
/proc/meminfo: memFree=24281148/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9760 CPUtime=462.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 15647 0 0 0 46228 0 0 0 20 0 1 0 411790153 33959936 2440 33554432000 4194304 6210612 140721168044992 140721168042952 5074302 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2440 862 493 0 1596 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9760 KiB


################
# More data... #
################

/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 1722.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 1.93 3/199 22524
/proc/meminfo: memFree=24279964/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=1782.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 23503 0 0 0 178227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5082063 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 1782.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 1.94 3/199 22530
/proc/meminfo: memFree=24280036/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=1842.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 23731 0 0 0 184227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5080973 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 1842.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22534
/proc/meminfo: memFree=24279556/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=1902.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 24197 0 0 0 190227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5392884 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 1902.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 22546
/proc/meminfo: memFree=24279880/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=1962.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 24424 0 0 0 196227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5082367 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 1962.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 22552
/proc/meminfo: memFree=24279796/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2022.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 24650 0 0 0 202227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5082025 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2022.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 22556
/proc/meminfo: memFree=24279736/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2082.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 24870 0 0 0 208227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5082029 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2082.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 22560
/proc/meminfo: memFree=24279844/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2142.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 25335 0 0 0 214227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5078599 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2142.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/200 22566
/proc/meminfo: memFree=24279864/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2202.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 25556 0 0 0 220227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5078408 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2202.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22570
/proc/meminfo: memFree=24279400/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2262.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 25775 0 0 0 226227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5078397 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2262.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22574
/proc/meminfo: memFree=24279852/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2322.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 26242 0 0 0 232227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5078927 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2322.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22580
/proc/meminfo: memFree=24279804/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2382.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 26461 0 0 0 238227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5078423 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2382.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22584
/proc/meminfo: memFree=24279724/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2442.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 26681 0 0 0 244227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5082648 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2442.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 1.95 3/199 22588
/proc/meminfo: memFree=24279636/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2502.28 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 26907 0 0 0 250227 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5081394 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2502.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 1.95 3/200 22598
/proc/meminfo: memFree=24278684/32770624 swapFree=67108848/67108860
[pid=22355] ppid=22350 vsize=33164 memory=9768 CPUtime=2519.99 cores=0,2,4,6
/proc/22355/stat : 22355 (cosoco) R 22350 22355 22298 0 -1 4202496 27116 0 0 0 251998 1 0 0 20 0 1 0 411790153 33959936 2442 33554432000 4194304 6210612 140721168044992 140721168042952 5081003 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 28987392 140721168053259 140721168053361 140721168053361 140721168056270 0
/proc/22355/statm: 8291 2442 862 493 0 1596 0
Current children cumulated CPU time: 2519.99 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9768 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 22355 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.98 s, system=0.015999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520
CPU user time (s): 2519.98
CPU system time (s): 0.015999
CPU usage (%): 99.9995
Max. virtual memory (cumulated for all children) (KiB): 33164
Max. memory (cumulated for all children) (KiB): 9768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.98
system time used= 0.015999
maximum resident set size= 9836
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27169
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17
involuntary context switches= 666


# summary of solver processes directly reported to runsolver:
#   pid: 22355
#   total CPU time (s): 2520
#   total CPU user time (s): 2519.98
#   total CPU system time (s): 0.015999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.0081 second user time and 15.606 second system time

The end

Launcher Data 

Begin job on node143 at 2019-09-13 09:08:07
IDJOB=4389580
IDBENCH=138974
IDSOLVER=2829
FILE ID=node143/4389580-1568358528
RUNJOBID= node143-1568358487-22329
PBS_JOBID= 21701198
Free space on /tmp= 58856 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-07.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389580-1568358528/watcher-4389580-1568358528 -o /tmp/evaluation-result-4389580-1568358528/solver-4389580-1568358528 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node143-1568358487-22329 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389580-1568358528.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cae06e42b01baa71e2bfd0e1b4deb8b1
RANDOM SEED=1871889995

node143.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        24292164 kB
MemAvailable:   31756424 kB
Buffers:          174376 kB
Cached:          7577768 kB
SwapCached:            8 kB
Active:          2147360 kB
Inactive:        5654960 kB
Active(anon):       5420 kB
Inactive(anon):   144780 kB
Active(file):    2141940 kB
Inactive(file):  5510180 kB
Unevictable:      108040 kB
Mlocked:          108040 kB
SwapTotal:      67108860 kB
SwapFree:       67108848 kB
Dirty:              5548 kB
Writeback:             0 kB
AnonPages:        158056 kB
Mapped:            47008 kB
Shmem:             90756 kB
Slab:             269052 kB
SReclaimable:     240600 kB
SUnreclaim:        28452 kB
KernelStack:        3280 kB
PageTables:         5992 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     502748 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     71680 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      132480 kB
DirectMap2M:    33413120 kB

Free space on /tmp at the end= 58848 MiB
End job on node143 at 2019-09-13 09:50:07