<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: Verdana; font-size: 10pt; color: #000000'>ok, I have installed yours debs, it's running without problem.<br><br>bnx2: Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.1.6 (Mar 7, 2011)<br>bnx2 0000:01:00.0: PCI INT A -> GSI 36 (level, low) -> IRQ 36<br>bnx2 0000:01:00.0: setting latency timer to 64<br>bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-mips-09-6.2.1a.fw<br>bnx2 0000:01:00.0: firmware: requesting bnx2/bnx2-rv2p-09-6.0.17.fw<br>bnx2 0000:01:00.0: eth1: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem d6000000, IRQ 36, node addr 00:22:19:33:cb:6f<br>bnx2 0000:01:00.1: PCI INT B -> GSI 48 (level, low) -> IRQ 48<br>bnx2 0000:01:00.1: setting latency timer to 64<br>bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-mips-09-6.2.1a.fw<br>bnx2 0000:01:00.1: firmware: requesting bnx2/bnx2-rv2p-09-6.0.17.fw<br>bnx2 0000:01:00.1: eth2: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem d8000000, IRQ 48, node addr 00:22:19:33:cb:71<br>bnx2 0000:02:00.0: PCI INT A -> GSI 32 (level, low) -> IRQ 32<br>bnx2 0000:02:00.0: setting latency timer to 64<br>bnx2 0000:02:00.0: firmware: requesting bnx2/bnx2-mips-09-6.2.1a.fw<br>bnx2 0000:02:00.0: firmware: requesting bnx2/bnx2-rv2p-09-6.0.17.fw<br>bnx2 0000:02:00.0: eth3: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem da000000, IRQ 32, node addr 00:22:19:33:cb:73<br>bnx2 0000:02:00.1: PCI INT B -> GSI 42 (level, low) -> IRQ 42<br>bnx2 0000:02:00.1: setting latency timer to 64<br>bnx2 0000:02:00.1: firmware: requesting bnx2/bnx2-mips-09-6.2.1a.fw<br>bnx2 0000:02:00.1: firmware: requesting bnx2/bnx2-rv2p-09-6.0.17.fw<br>bnx2 0000:02:00.1: eth4: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem dc000000, IRQ 42, node addr 00:22:19:33:cb:75<br>bnx2 0000:01:00.0: eth0: NIC Copper Link is Up, 1000 Mbps full duplex<br>bnx2 0000:01:00.1: eth1: NIC Copper Link is Up, 1000 Mbps full duplex<br><br><br># modinfo bnx2 <br>filename: /lib/modules/2.6.32-6-pve/kernel/drivers/net/bnx2.ko <br>firmware: bnx2/bnx2-rv2p-09ax-6.0.17.fw <br>firmware: bnx2/bnx2-rv2p-09-6.0.17.fw <br>firmware: bnx2/bnx2-mips-09-6.2.1a.fw <br>firmware: bnx2/bnx2-rv2p-06-6.0.15.fw <br>firmware: bnx2/bnx2-mips-06-6.2.1.fw <br>version: 2.1.6 <br><br>Wait and see ....<br><br><br><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>De: </b>"Alexandre DERUMIER" <aderumier@odiso.com><br><b>À: </b>"Dietmar Maurer" <dietmar@proxmox.com><br><b>Cc: </b>pve-devel@pve.proxmox.com<br><b>Envoyé: </b>Lundi 19 Septembre 2011 08:18:42<br><b>Objet: </b>Re: [pve-devel] bnx2 : tests with 131.12.1.el6 kernel<br><br><style>p { margin: 0; }</style><div style="font-family: Verdana; font-size: 10pt; color: #000000">sure, of course !<br><br><br><hr id="zwchr"><div style="color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>De: </b>"Dietmar Maurer" <dietmar@proxmox.com><br><b>À: </b>"Alexandre DERUMIER" <aderumier@odiso.com><br><b>Cc: </b>pve-devel@pve.proxmox.com<br><b>Envoyé: </b>Lundi 19 Septembre 2011 08:17:47<br><b>Objet: </b>RE: bnx2 : tests with 131.12.1.el6 kernel<br><br>
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Alexandre,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US">I just upload that update to the pvetest repository:</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"><a href="ftp://download1.proxmox.com/debian/dists/lenny/pvetest/binary-amd64/pve-kernel-2.6.32-6-pve_2.6.32-45_amd64.deb" target="_blank">ftp://download1.proxmox.com/debian/dists/lenny/pvetest/binary-amd64/pve-kernel-2.6.32-6-pve_2.6.32-45_amd64.deb</a></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"><a href="ftp://download1.proxmox.com/debian/dists/lenny/pvetest/binary-amd64/pve-firmware_1.0-14_all.deb" target="_blank">ftp://download1.proxmox.com/debian/dists/lenny/pvetest/binary-amd64/pve-firmware_1.0-14_all.deb</a></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US">Please can you test those packages instead?</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US">- Dietmar</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D" lang="EN-US"> </span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> Alexandre DERUMIER [mailto:aderumier@odiso.com]
<br>
<b>Sent:</b> Montag, 19. September 2011 08:07<br>
<b>To:</b> Dietmar Maurer<br>
<b>Cc:</b> pve-devel@pve.proxmox.com<br>
<b>Subject:</b> bnx2 : tests with 131.12.1.el6 kernel</span></p>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black">Hi Dietmar, i have succefusly build 131.12.1.el6 kernel (with 042stab037.1 openvz).<br>
<br>
now built-in bnx2 module works fine on squeeze and lenny.<br>
<br>
bnx2 driver is updated to version 2.1.6<br>
<br>
# modinfo bnx2<br>
filename: /lib/modules/2.6.32-6-pve/kernel/drivers/net/bnx2.ko<br>
firmware: bnx2/bnx2-rv2p-09ax-6.0.17.fw<br>
firmware: bnx2/bnx2-rv2p-09-6.0.17.fw<br>
firmware: bnx2/bnx2-mips-09-6.2.1a.fw<br>
firmware: bnx2/bnx2-rv2p-06-6.0.15.fw<br>
firmware: bnx2/bnx2-mips-06-6.2.1.fw<br>
version: 2.1.6<br>
<br>
So i'll test it on a non critical production server , with msi-x enabled.<br>
the crash bug is random, so i'll test it during many days/week to see if now it's working correctly.<br>
<br>
I have another server with 2.6.32-6-pve kernel and 2.0.23b bnx2 driver, with msi-x disable workaround.<br>
<br>
I'll keep you in touch if the crash occur again.<br>
<br>
<br>
<br>
<br>
<br>
</span></p>
<div class="MsoNormal" style="text-align:center" align="center"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black">
<hr id="zwchr" align="center" size="3" width="100%">
</span></div>
<div>
<p class="MsoNormal"><b><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">De:
</span></b><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">"Alexandre DERUMIER" <</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:aderumier@odiso.com" target="_blank"><span lang="EN-US">aderumier@odiso.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">><br>
<b>À: </b>"Dietmar Maurer" <</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:dietmar@proxmox.com" target="_blank"><span lang="EN-US">dietmar@proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">><br>
<b>Cc: </b></span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:pve-devel@pve.proxmox.com" target="_blank"><span lang="EN-US">pve-devel@pve.proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
<b>Envoyé: </b>Dimanche 18 Septembre 2011 18:16:07<br>
<b>Objet: </b>Re: [pve-devel] bnx2 driver crashing<br>
<br>
I had checked the bnx2 offical source code,<br>
<br>
bnx2: MSI-X hang on 5709 NICs -> nic dead<br>
<br>
is not apply yet.<br>
<br>
</span><span style="font-family:"Helvetica","sans-serif";color:black">I've verify previous proxmox kernel on same hardware, msi-x was working without problem (since 1 year).<br>
<br>
<br>
<br>
<br>
>>The redhat/debian driver does not support newer cards (that is why we include<br>
>>the sources from Broadcom).<br>
>>We had simply to many customers complaining that the driver does not work at all.<br>
<br>
Do you know witch broadcom model does not work with debian or redhat source kernel ?<br>
rhel6 is pretty new, sound strange than it not support new hardware.<br>
<br>
<br>
I have recent Dell servers,and broadcom cards( 5709) are working without problem with debian and redhat.<br>
<br>
<br>
<br>
I see a new kernel-2.6.32-131.12.1.el6.src.rpm kernel, I'll try to build it to see if it's work on squeeze and lenny.<br>
<br>
<br>
<br>
<br>
</span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">----- Mail original -----<br>
<br>
De: "Dietmar Maurer" <</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:dietmar@proxmox.com" target="_blank"><span lang="EN-US">dietmar@proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">><br>
À: "Alexandre DERUMIER" <</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:aderumier@odiso.com" target="_blank"><span lang="EN-US">aderumier@odiso.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">><br>
Cc: </span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:pve-devel@pve.proxmox.com" target="_blank"><span lang="EN-US">pve-devel@pve.proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
Envoyé: Dimanche 18 Septembre 2011 17:17:37<br>
Objet: RE: [pve-devel] bnx2 driver crashing<br>
<br>
<br>
<br>
> -----Original Message-----<br>
> From: Alexandre DERUMIER </span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:[mailto:aderumier@odiso.com]" target="_blank"><span lang="EN-US">[mailto:aderumier@odiso.com]</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
> Sent: Sonntag, 18. September 2011 10:13<br>
> To: Dietmar Maurer<br>
> Cc: </span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:pve-devel@pve.proxmox.com" target="_blank"><span lang="EN-US">pve-devel@pve.proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
> Subject: Re: [pve-devel] bnx2 driver crashing<br>
><br>
> so maybe debian and redhat add some patches to prevent it ?<br>
><br>
> found this on redhat (a lot of patches) :<br>
> [Broadcom 5.6 FEAT] Update bnx2 to 2.0.8+<br>
><br>
> </span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="https://bugzilla.redhat.com/show_bug.cgi?id=568601" target="_blank"><span lang="EN-US">https://bugzilla.redhat.com/show_bug.cgi?id=568601</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
><br>
> The following upstream patches have been applied to these rpms.<br>
</span><span style="font-family:"Helvetica","sans-serif";color:black">> 1. netdev: Remove redundant checks for CAP_NET_ADMIN<br>
> 2. bnx2: avoid compiler errors<br>
> 3. bnx2: EEH is failing without timout<br>
> 4. bnx2: protect tx_timeout_reset with rtnl_lock()<br>
> 5. bnx2: dump some state during tx_timeout()<br>
> 6. bnx2: print warning when unable to allocate<br>
> 7. bnx2: read firmware version from VPD<br>
> 8. bnx2: update version to 2.0.3<br>
> 9. bnx2: Refine VPD logic<br>
> 10. bnx2: reset_task is crashing the kernel 11. bnx2: Fix bnx2_netif_stop()<br>
> merge error 12. bnx2: Flush the register writes which setup the MSI-X 13. bnx2:<br>
> Refine statistics code 14. bnx2: Save statistics during reset 15. net: remove<br>
> HAVE_ leftovers 16. bnx2: Check BNX2_FLAG_USING_MSIX flag 17. bnx2: Need <br>
> to call cnic_setup_cnic_irq_info() after 18. bnx2: Adjust flow control water<br>
> marks 19. bnx2: Allow for user-specific multiple advertisement speed 20. bnx2:<br>
> Fix bug when saving statistics 21. bnx2: Update firmwares and update version to<br>
> 2.0.8<br>
><br>
<br>
Aren't those already included in current RHEL6 kernel?<br>
<br>
> To get the "2.0.8+" part, incorporate patches in RHEL6:<br>
> 1. bnx2: Fix netpoll crash<br>
> 2. bnx2: Use proper handler during netpoll<br>
> 3. bnx2: Update 5709 MIPS firmware mips = 5.0.0j15 rv2p = j10<br>
> 4. bnx2: Fix hang during rmmod bnx2<br>
> 5. bnx2: Always enable MSI-X on 5709<br>
<br>
And those apply to the original broadcom sources we use?<br>
<br>
</span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US">- Dietmar<br>
<br>
<br>
<br>
<br>
<br>
--<br>
<br>
--<br>
<br>
<br>
<br>
<br>
<br>
Alexandre Derumier<br>
Ingénieur système<br>
e-mail : </span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:aderumier@odiso.com" target="_blank"><span lang="EN-US">aderumier@odiso.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
Tél : +33 (0)3 20 68 88 90<br>
Fax : +33 (0)3 20 68 90 81<br>
45 Bvd du Général Leclerc<br>
59100 ROUBAIX - FRANCE<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
pve-devel mailing list<br>
</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="mailto:pve-devel@pve.proxmox.com" target="_blank"><span lang="EN-US">pve-devel@pve.proxmox.com</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"><br>
</span><span style="font-family:"Helvetica","sans-serif";color:black"><a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel" target="_blank"><span lang="EN-US">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel</span></a></span><span style="font-family:"Helvetica","sans-serif";color:black" lang="EN-US"></span></p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black" lang="EN-US"><br>
<br>
<br>
</span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black">--
</span></p>
<div>
<p><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
<table class="MsoNormalTable" align="left" border="0" cellpadding="0" cellspacing="3">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-element:frame;mso-element-frame-hspace:1.8pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
<br>
<img src="http://www.odiso.com/library/img/signature/logo-odiso-signaturemail.png" id="_x0000_i1026" src="http://www.odiso.com/library/img/signature/logo-odiso-signaturemail.png" border="0"></p>
</td>
<td style="padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="mso-element:frame;mso-element-frame-hspace:1.8pt;mso-element-wrap:around;mso-element-anchor-vertical:paragraph;mso-element-anchor-horizontal:column;mso-height-rule:exactly">
<strong><span style="font-size:10.5pt;font-family:"Verdana","sans-serif";color:darkorange">Alexandre</span></strong><strong><span style="font-size:10.5pt;font-family:"Verdana","sans-serif"">
<span style="color:dimgray">Derumier</span></span></strong><br>
<strong><span style="font-size:8.5pt;font-family:"Verdana","sans-serif";color:dimgray">Ingénieur système</span></strong><br>
<span style="font-size:7.5pt;font-family:"Verdana","sans-serif";color:dimgray">e-mail : <a href="mailto:aderumier@odiso.com" target="_blank">aderumier@odiso.com</a><br>
Tél : +33 (0)3 20 68 88 90<br>
Fax : +33 (0)3 20 68 90 81<br>
45 Bvd du Général Leclerc<br>
59100 ROUBAIX - FRANCE</span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"> </span></p>
</div>
</div>
</div>
</div>
</div><br><br><br>-- <br><div><span></span><p><br></p><table align="left" border="0" cellpadding="0">
<tbody>
<tr>
<td>
<br><img src="http://www.odiso.com/library/img/signature/logo-odiso-signaturemail.png" src="http://www.odiso.com/library/img/signature/logo-odiso-signaturemail.png"></td>
<td>
<span style="font-size:14px;font-family:verdana,geneva,sans-serif;"><strong><span style="color:#ff8c00;font-family:verdana,geneva,sans-serif;">Alexandre</span> <span style="color:#696969;">Derumier</span></strong></span><br>
<strong><span style="color:#696969;"><span style="font-size:11px;font-family:verdana,geneva,sans-serif;">Ingénieur système</span></span></strong><br>
<span style="color:#696969;font-size:10px;font-family:verdana,geneva,sans-serif;">e-mail : <a href="mailto:aderumier@odiso.com" target="_blank">aderumier@odiso.com</a><br>
Tél : +33 (0)3 20 68 88 90<br>
Fax : +33 (0)3 20 68 90 81<br>
45 Bvd du Général Leclerc<br>
59100 ROUBAIX - FRANCE</span></td>
</tr>
</tbody>
</table><br>
<div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><span></span><br></div></div><br>_______________________________________________<br>pve-devel mailing list<br>pve-devel@pve.proxmox.com<br>http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel<br></div><br><br><br>-- <br><div><span name="x"></span><p><br></p><table align="left" border="0" cellpadding="0">
<tbody>
<tr>
<td>
<br><img src="http://www.odiso.com/library/img/signature/logo-odiso-signaturemail.png"></td>
<td>
<span style="font-size:14px;font-family:verdana,geneva,sans-serif;"><strong><span style="color:#ff8c00;font-family:verdana,geneva,sans-serif;">Alexandre</span> <span style="color:#696969;">Derumier</span></strong></span><br>
<strong><span style="color:#696969;"><span style="font-size:11px;font-family:verdana,geneva,sans-serif;">Ingénieur système</span></span></strong><br>
<span style="color:#696969;font-size:10px;font-family:verdana,geneva,sans-serif;">e-mail : <a href="mailto:aderumier@odiso.com" target="_blank">aderumier@odiso.com</a><br>
Tél : +33 (0)3 20 68 88 90<br>
Fax : +33 (0)3 20 68 90 81<br>
45 Bvd du Général Leclerc<br>
59100 ROUBAIX - FRANCE</span></td>
</tr>
</tbody>
</table><br>
<div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><span name="x"></span><br></div></div></body></html>