<html>
<head>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
New information about this Intel 10Gbit network card.<br>
We have managed to get our 10Gbe card working with both - IPv4 and
IPv6, but only in kernel 3.10.9-pve and using <b>VEPA.</b> Downside
is that patch does not work with kernel 2.6.32.<br>
Tested driver versions 1.2.37 and 1.2.38.<br>
<br>
Network setup on physical node:<br>
1) switch - eth4 - vmbr40<br>
2) switch - eth4 - eth4.40 - vmbr40<br>
<br>
Patch can be found at <a class="moz-txt-link-freetext" href="https://patchwork.ozlabs.org/patch/470209/">https://patchwork.ozlabs.org/patch/470209/</a><br>
<br>
And reading about VEPA can be done at
<a class="moz-txt-link-freetext" href="http://www.networkworld.com/article/2197460/tech-primers/vepa--an-answer-to-virtual-switching.html">http://www.networkworld.com/article/2197460/tech-primers/vepa--an-answer-to-virtual-switching.html</a><br>
<br>
<div class="moz-cite-prefix">On 06.05.15 12:29, Sten Aus wrote:<br>
</div>
<blockquote cite="mid:5549DEF3.4010202@eenet.ee" type="cite">
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
<div markdown-here-wrapper-content-modified="true" style=""
class="markdown-here-wrapper" data-md-url="Thunderbird">
<p style="margin: 0px 0px 1.2em ! important;">Hi</p>
<p style="margin: 0px 0px 1.2em ! important;">Some new
information about this topic. We did some new tests with this
Intel 10GBe network card.</p>
<p style="margin: 0px 0px 1.2em ! important;">Debian 7.8, with
kernel 4.0.1 and it seems that IPv6 neighbor solicitation is
working fine when using Linux bridges.</p>
<p style="margin: 0px 0px 1.2em ! important;">It seems that
Linus and his developers have used another driver, which Intel
does not provide:</p>
<pre style="font-size: 0.85em; font-family: Consolas,Inconsolata,Courier,monospace;font-size: 1em; line-height: 1.2em;margin: 1.2em 0px;"><code style="font-size: 0.85em; font-family: Consolas,Inconsolata,Courier,monospace;margin: 0px 0.15em; padding: 0px 0.3em; white-space: pre-wrap; border: 1px solid rgb(234, 234, 234); background-color: rgb(248, 248, 248); border-radius: 3px; display: inline;white-space: pre; overflow: auto; border-radius: 3px; border: 1px solid rgb(204, 204, 204); padding: 0.5em 0.7em; display: block ! important;">root@debian ~ $ ethtool -i eth4
driver: i40e
version: 1.2.6-k
firmware-version: f4.22 a1.1 n04.25 e8000143f
</code>
</pre>
<p style="margin: 0px 0px 1.2em ! important;">Still haven't
tried this IPv4 bug, which I discovered in version 1.2.37 (see
my other Subject in this list: Intel X710 10Gbit network
card).<br>
</p>
<p style="margin: 0px 0px 1.2em ! important;">What to do next? I
don't know, actually. :)<br>
</p>
<p style="margin: 0px 0px 1.2em ! important;">On 28.04.15 14:45,
Sten Aus wrote:</p>
<div class="markdown-here-exclude">
<blockquote cite="mid:553F72BC.3020205@eenet.ee" type="cite">Hi
again <br>
<br>
No point making udev rule, because i40e driver is not
working in my enivronment. Going to configure Linux bridges
on 1G interface and report a bug for i40e driver. <br>
<br>
Tried also older OVS (which worked for me in January). And
also oldest i40e driver which I found at Intel's webpage. <br>
<br>
Thanks to all and all the best! <br>
<br>
On 28.04.15 13:55, Alexandre DERUMIER wrote: <br>
<blockquote type="cite">Hi, <br>
<br>
<blockquote type="cite">
<blockquote type="cite">Although udev is still a
problem. <br>
</blockquote>
</blockquote>
you should be able to map macaddress to specific ethX in
<br>
<br>
/etc/udev/rules.d/70-persistent-net.rules <br>
<br>
----- Mail original ----- <br>
De: "Sten Aus" <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:sten.aus@eenet.ee"><sten.aus@eenet.ee></a>
<br>
À: "Michael Rasmussen" <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:mir@miras.org"><mir@miras.org></a>,
"proxmoxve" <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:pve-user@pve.proxmox.com"><pve-user@pve.proxmox.com></a>
<br>
Envoyé: Mardi 28 Avril 2015 11:30:02 <br>
Objet: Re: [PVE-User] Linux bridge, kvm, ipv6, intel 10gbe
<br>
<br>
<br>
<br>
Hi <br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
openvswitch is the way to go. <br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
I sure hope so. :) <br>
<br>
Open vSwitch has been in my mind for some months now. I’ve
tested it in January (ovs version 2.3.0-1) and got it to
work, but as our cluster is quite big, I planned to go to
ovs in the future. <br>
Anyway it seems that on that node Open vSwitch it is not
working as fluently as it worked with other node in
January. OVS is 2.3.1-1 and now I’ve used 10G interface.
Then I used 1G interface on motherboard. <br>
<br>
Problems: <br>
<br>
* <br>
<br>
After reboot, my 10G interface (eth5) is not connected to
the bridge (udev changes interface names) and thus no
packets go to network. As soon as i put eth5 to vmbr1234
everything works: ovs-vsct add-port vmbr1234 eth5 From
dmesg I can see that 10G interface has names: eth1 ->
eth5 and 1G appears as eth2->rename4->eth0 Despite
the fact that /etc/rcS.d/ I can see that udev is 02,
openvswitch 12 and networking 13th in startup row.
Awkward. <br>
* <br>
<br>
Also, two OVSIntPorts will not come “up” (storage88 and
storage84 - maybe numbers in OVSIntPort name?). <br>
<br>
<br>
Okay, after some manual configuration I got OVS running,
but: <br>
<br>
* <br>
<br>
Regular/normal ping will lost 4 packets from time to time.
For example, at the beginning 0-3 packets are lost
somewhere, I will hear reply after 4th packet. And then
same thing happens after 14th packet or so. <br>
* <br>
<br>
And within ovs 2.3.0 version I was able to create
OVSIntPort with “vmbr” name as well, now I need to add
different name to my Internal port (within one node). <br>
<br>
<br>
Solutions: <br>
<br>
<br>
* Downgraded i40e driver from 1.2.38 (downloaded from
Intel webpage) to 1.1.23 and no OVS is almost working.
Storage interfaces are still pain. Ping works correctly,
but no iscsi connections are made. <br>
<br>
<br>
Although udev is still a problem. <br>
<br>
_______________________________________________ <br>
pve-user mailing list <br>
<a moz-do-not-send="true" class="moz-txt-link-abbreviated"
href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a>
<br>
<a moz-do-not-send="true" class="moz-txt-link-freetext"
href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
<br>
</blockquote>
<br>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
pve-user mailing list
<a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a>
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
</pre>
</blockquote>
</div>
<div
title="MDH:SGk8YnI+PGJyPlNvbWUgbmV3IGluZm9ybWF0aW9uIGFib3V0IHRoaXMgdG9waWMuIFdlIGRpZCBzb21lIG5ldyB0ZXN0cyB3aXRoIHRoaXMgSW50ZWwgMTBHQmUgbmV0d29yayBjYXJkLjxicj48YnI+RGViaWFuIDcuOCwgd2l0aCBrZXJuZWwgNC4wLjEgYW5kIGl0IHNlZW1zIHRoYXQgSVB2NiBuZWln
aGJvciBzb2xpY2l0YXRpb24gaXMgd29ya2luZyBmaW5lIHZpYSBicmlkZ2VzLjxicj48YnI+SXQg
c2VlbXMgdGhhdCBMaW51cyBhbmQgaGlzIGRldmVsb3BlcnMgaGF2ZSB1c2VkIGFub3RoZXIgZHJp
dmVyLCB3aGljaCBJbnRlbCBkb2VzIG5vdCBwcm92aWRlOjxicj5gYGA8YnI+cm9vdEBkZWJpYW4g
fiAkIGV0aHRvb2wgLWkgZXRoNDxicj5kcml2ZXI6IGk0MGU8YnI+dmVyc2lvbjogMS4yLjYtazxi
cj5maXJtd2FyZS12ZXJzaW9uOiBmNC4yMiBhMS4xIG4wNC4yNSBlODAwMDE0M2ZgYGA8YnI+PGJy
Pjxicj48YnI+PGRpdiBjbGFzcz0ibW96LWNpdGUtcHJlZml4Ij5PbiAyOC4wNC4xNSAxNDo0NSwg
U3RlbiBBdXMgd3JvdGU6PGJyPjwvZGl2PjxibG9ja3F1b3RlIGNpdGU9Im1pZDo1NTNGNzJCQy4z
MDIwMjA1QGVlbmV0LmVlIiB0eXBlPSJjaXRlIj5IaSBhZ2Fpbgo8YnI+Cjxicj5ObyBwb2ludCBt
YWtpbmcgdWRldiBydWxlLCBiZWNhdXNlIGk0MGUgZHJpdmVyIGlzIG5vdCB3b3JraW5nIGluIG15
IAplbml2cm9ubWVudC4gR29pbmcgdG8gY29uZmlndXJlIExpbnV4IGJyaWRnZXMgb24gMUcgaW50
ZXJmYWNlIGFuZCByZXBvcnQgCmEgYnVnIGZvciBpNDBlIGRyaXZlci4KPGJyPgo8YnI+VHJpZWQg
YWxzbyBvbGRlciBPVlMgKHdoaWNoIHdvcmtlZCBmb3IgbWUgaW4gSmFudWFyeSkuIEFuZCBhbHNv
IG9sZGVzdCAKaTQwZSBkcml2ZXIgd2hpY2ggSSBmb3VuZCBhdCBJbnRlbCdzIHdlYnBhZ2UuCjxi
cj4KPGJyPlRoYW5rcyB0byBhbGwgYW5kIGFsbCB0aGUgYmVzdCEKPGJyPgo8YnI+T24gMjguMDQu
MTUgMTM6NTUsIEFsZXhhbmRyZSBERVJVTUlFUiB3cm90ZToKPGJyPjxibG9ja3F1b3RlIHR5cGU9
ImNpdGUiPkhpLAo8YnI+Cjxicj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0
eXBlPSJjaXRlIj5BbHRob3VnaCB1ZGV2IGlzIHN0aWxsIGEgcHJvYmxlbS4KPGJyPjwvYmxvY2tx
dW90ZT48L2Jsb2NrcXVvdGU+eW91IHNob3VsZCBiZSBhYmxlIHRvIG1hcCBtYWNhZGRyZXNzIHRv
IHNwZWNpZmljIGV0aFgmbmJzcDsgaW4KPGJyPgo8YnI+L2V0Yy91ZGV2L3J1bGVzLmQvNzAtcGVy
c2lzdGVudC1uZXQucnVsZXMKPGJyPgo8YnI+LS0tLS0gTWFpbCBvcmlnaW5hbCAtLS0tLQo8YnI+
RGU6ICJTdGVuIEF1cyIgJmx0O3N0ZW4uYXVzQGVlbmV0LmVlJmd0Owo8YnI+w4A6ICJNaWNoYWVs
IFJhc211c3NlbiIgJmx0O21pckBtaXJhcy5vcmcmZ3Q7LCAicHJveG1veHZlIiAmbHQ7cHZlLXVz
ZXJAcHZlLnByb3htb3guY29tJmd0Owo8YnI+RW52b3nDqTogTWFyZGkgMjggQXZyaWwgMjAxNSAx
MTozMDowMgo8YnI+T2JqZXQ6IFJlOiBbUFZFLVVzZXJdIExpbnV4IGJyaWRnZSwga3ZtLCBpcHY2
LCBpbnRlbCAxMGdiZQo8YnI+Cjxicj4KPGJyPgo8YnI+SGkKPGJyPgo8YnI+Cjxicj4KPGJyPgo8
YnI+Cjxicj4KPGJyPgo8YnI+b3BlbnZzd2l0Y2ggaXMgdGhlIHdheSB0byBnby4KPGJyPgo8YnI+
Cjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPgo8YnI+Cjxicj4KPGJyPkkgc3VyZSBob3BlIHNvLiA6
KQo8YnI+Cjxicj5PcGVuIHZTd2l0Y2ggaGFzIGJlZW4gaW4gbXkgbWluZCBmb3Igc29tZSBtb250
aHMgbm93LiBJ4oCZdmUgdGVzdGVkIGl0IGluIEphbnVhcnkgKG92cyB2ZXJzaW9uIDIuMy4wLTEp
IGFuZCBnb3QgaXQgdG8gd29yaywgYnV0IGFzIG91ciBjbHVzdGVyIGlzIHF1aXRlIGJpZywgSSBw
bGFubmVkIHRvIGdvIHRvIG92cyBpbiB0aGUgZnV0dXJlLgo8YnI+QW55d2F5IGl0IHNlZW1zIHRo
YXQgb24gdGhhdCBub2RlIE9wZW4gdlN3aXRjaCBpdCBpcyBub3Qgd29ya2luZyBhcyBmbHVlbnRs
eSBhcyBpdCB3b3JrZWQgd2l0aCBvdGhlciBub2RlIGluIEphbnVhcnkuIE9WUyBpcyAyLjMuMS0x
IGFuZCBub3cgSeKAmXZlIHVzZWQgMTBHIGludGVyZmFjZS4gVGhlbiBJIHVzZWQgMUcgaW50ZXJm
YWNlIG9uIG1vdGhlcmJvYXJkLgo8YnI+Cjxicj5Qcm9ibGVtczoKPGJyPgo8YnI+Jm5ic3A7Jm5i
c3A7Jm5ic3A7Jm5ic3A7ICoKPGJyPgo8YnI+QWZ0ZXIgcmVib290LCBteSAxMEcgaW50ZXJmYWNl
IChldGg1KSBpcyBub3QgY29ubmVjdGVkIHRvIHRoZSBicmlkZ2UgKHVkZXYgY2hhbmdlcyBpbnRl
cmZhY2UgbmFtZXMpIGFuZCB0aHVzIG5vIHBhY2tldHMgZ28gdG8gbmV0d29yay4gQXMgc29vbiBh
cyBpIHB1dCBldGg1IHRvIHZtYnIxMjM0IGV2ZXJ5dGhpbmcgd29ya3M6IG92cy12c2N0IGFkZC1w
b3J0IHZtYnIxMjM0IGV0aDUgRnJvbSBkbWVzZyBJIGNhbiBzZWUgdGhhdCAxMEcgaW50ZXJmYWNl
IGhhcyBuYW1lczogZXRoMSAtJmd0OyBldGg1IGFuZCAxRyBhcHBlYXJzIGFzIGV0aDItJmd0O3Jl
bmFtZTQtJmd0O2V0aDAgRGVzcGl0ZSB0aGUgZmFjdCB0aGF0IC9ldGMvcmNTLmQvIEkgY2FuIHNl
ZSB0aGF0IHVkZXYgaXMgMDIsIG9wZW52c3dpdGNoIDEyIGFuZCBuZXR3b3JraW5nIDEzdGggaW4g
c3RhcnR1cCByb3cuIEF3a3dhcmQuCjxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgKgo8YnI+
Cjxicj5BbHNvLCB0d28gT1ZTSW50UG9ydHMgd2lsbCBub3QgY29tZSDigJx1cOKAnSAoc3RvcmFn
ZTg4IGFuZCBzdG9yYWdlODQgLSBtYXliZSBudW1iZXJzIGluIE9WU0ludFBvcnQgbmFtZT8pLgo8
YnI+Cjxicj4KPGJyPk9rYXksIGFmdGVyIHNvbWUgbWFudWFsIGNvbmZpZ3VyYXRpb24gSSBnb3Qg
T1ZTIHJ1bm5pbmcsIGJ1dDoKPGJyPgo8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7ICoKPGJy
Pgo8YnI+UmVndWxhci9ub3JtYWwgcGluZyB3aWxsIGxvc3QgNCBwYWNrZXRzIGZyb20gdGltZSB0
byB0aW1lLiBGb3IgZXhhbXBsZSwgYXQgdGhlIGJlZ2lubmluZyAwLTMgcGFja2V0cyBhcmUgbG9z
dCBzb21ld2hlcmUsIEkgd2lsbCBoZWFyIHJlcGx5IGFmdGVyIDR0aCBwYWNrZXQuIEFuZCB0aGVu
IHNhbWUgdGhpbmcgaGFwcGVucyBhZnRlciAxNHRoIHBhY2tldCBvciBzby4KPGJyPiZuYnNwOyZu
YnNwOyZuYnNwOyZuYnNwOyAqCjxicj4KPGJyPkFuZCB3aXRoaW4gb3ZzIDIuMy4wIHZlcnNpb24g
SSB3YXMgYWJsZSB0byBjcmVhdGUgT1ZTSW50UG9ydCB3aXRoIOKAnHZtYnLigJ0gbmFtZSBhcyB3
ZWxsLCBub3cgSSBuZWVkIHRvIGFkZCBkaWZmZXJlbnQgbmFtZSB0byBteSBJbnRlcm5hbCBwb3J0
ICh3aXRoaW4gb25lIG5vZGUpLgo8YnI+Cjxicj4KPGJyPlNvbHV0aW9uczoKPGJyPgo8YnI+Cjxi
cj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsgKiBEb3duZ3JhZGVkIGk0MGUgZHJpdmVyIGZyb20g
MS4yLjM4IChkb3dubG9hZGVkIGZyb20gSW50ZWwgd2VicGFnZSkgdG8gMS4xLjIzIGFuZCBubyBP
VlMgaXMgYWxtb3N0IHdvcmtpbmcuIFN0b3JhZ2UgaW50ZXJmYWNlcyBhcmUgc3RpbGwgcGFpbi4g
UGluZyB3b3JrcyBjb3JyZWN0bHksIGJ1dCBubyBpc2NzaSBjb25uZWN0aW9ucyBhcmUgbWFkZS4K
PGJyPgo8YnI+Cjxicj5BbHRob3VnaCB1ZGV2IGlzIHN0aWxsIGEgcHJvYmxlbS4KPGJyPiZuYnNw
OyAKCjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo8
YnI+cHZlLXVzZXIgbWFpbGluZyBsaXN0Cjxicj5wdmUtdXNlckBwdmUucHJveG1veC5jb20KPGJy
Pmh0dHA6Ly9wdmUucHJveG1veC5jb20vY2dpLWJpbi9tYWlsbWFuL2xpc3RpbmZvL3B2ZS11c2Vy
Cjxicj48L2Jsb2NrcXVvdGU+Cjxicj4KPGJyPjxicj48ZmllbGRzZXQgY2xhc3M9Im1pbWVBdHRh
Y2htZW50SGVhZGVyIj48L2ZpZWxkc2V0Pjxicj48cHJlIHdyYXA9IiI+X19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KcHZlLXVzZXIgbWFpbGluZyBsaXN0CnB2
ZS11c2VyQHB2ZS5wcm94bW94LmNvbQpodHRwOi8vcHZlLnByb3htb3guY29tL2NnaS1iaW4vbWFp
bG1hbi9saXN0aW5mby9wdmUtdXNlcgo8L3ByZT4KCjwvYmxvY2txdW90ZT48YnI+"
style="height:0;width:0;max-height:0;max-width:0;overflow:hidden;font-size:0em;padding:0;margin:0;"></div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
pve-user mailing list
<a class="moz-txt-link-abbreviated" href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a>
<a class="moz-txt-link-freetext" href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
</pre>
</blockquote>
<br>
</body>
</html>