<html><head></head><body>Another thing is that your cables must support DDR as well.<br><br><div class="gmail_quote">On July 7, 2015 3:07:00 PM CEST, Fabrizio Cuseo <f.cuseo@panservice.it> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<pre class="k9mail">I have found that the 400EX is a SDR card, while the 400EX-D is a DDR card. I don't know if is a firmware problem.<br /><br /><br /><a href="http://sup.xenya.si/sup/info/voltaire/HCAwebfinal.pdf">http://sup.xenya.si/sup/info/voltaire/HCAwebfinal.pdf</a><br /><br />HCA 400Ex/Ex-F<br />• Dual port 4X (10 Gbps) InfiniBand PCI-Express low <br />profile host channel adapter<br />HCA 400Ex-D<br />• Dual port 4X DDR (20 Gbps) InfiniBand PCI-Express <br />low profile host channel adapter<br />HCA 400<br />• Dual port 4X (10 Gbps) InfiniBand PCI/PCI-X low <br />profile host channel adapter<br /><br /><br /><br /><br />----- Messaggio originale -----<br />Da: "Michael Rasmussen" <mir@miras.org><br />A: "Fabrizio Cuseo" <f.cuseo@panservice.it>, "pve-user" <pve-user@pve.proxmox.com><br />Inviato: Martedì, 7 luglio 2015 12:01:03<br />Oggetto: Re: [PVE-User] Infiniband Mellanox cards and DDR<br /><br />AFAIK this card is a SDR card so DDR is not
possible. <br /><br /><br />On July 7, 2015 11:46:41 AM CEST, Fabrizio Cuseo <f.cuseo@panservice.it> wrote: <br /><br />Hallo. <br /><br />I am testing a Mellanox card (IBM Voltaire HCA 400Ex-D) with a cisco 4x DDR infiniband switch. <br /><br />The problem I have is that the cards (that seems to be 4X DDR) have a 10Gbit (SDR) link. <br /><br />--- <br />03:00.0 InfiniBand: Mellanox Technologies MT25208 [InfiniHost III Ex] (rev 20) <br />--- <br /><br />root@pve1:/etc/apt/sources.list.d# ibstat <br />CA 'mthca0' <br />CA type: MT25208 <br />Number of ports: 2 <br />Firmware version: 5.3.0 <br />Hardware version: 20 <br />Node GUID: 0x0008f104039814d0 <br />System image GUID: 0x0008f104039814d3 <br />Port 1: <br />State: Active <br />Physical state: LinkUp <br />Rate: 10 <br />Base lid: 6 <br />LMC: 0 <br />SM lid: 2 <br />Capability mask: 0x02510a68 <br />Port GUID: 0x0008f104039814d1 <br />Link laye<br /> r:<br />InfiniBand <br /><br />-------- <br /><br
/>root@pve1:/etc/apt/sources.list.d# ibportstate 6 0 <br />CA PortInfo: <br /># Port info: Lid 6 port 0 <br />LinkState:.......................Active <br />PhysLinkState:...................LinkUp <br />Lid:.............................6 <br />SMLid:...........................2 <br />LMC:.............................0 <br />LinkWidthSupported:..............1X or 4X <br />LinkWidthEnabled:................1X or 4X <br />LinkWidthActive:.................4X <br />LinkSpeedSupported:..............2.5 Gbps <br />LinkSpeedEnabled:................2.5 Gbps <br />LinkSpeedActive:.................2.5 Gbps <br />Mkey:............................<not displayed> <br />MkeyLeasePeriod:.................15 <br />ProtectBits:.....................0 <br /><br />----- <br /><br /><br />If I try to set the speed at DDR, I have this error: <br /><br />root@pve1:/etc/apt/sources.list.d# ibportstate 6 0 speed 2 <br />Initial CA PortInfo: <br /># Port info: Lid 6 port 0 <br
/>LinkState:.......................Active <br />PhysLinkState:...................LinkUp <br />Lid:.............................6 <br />SMLid:...........................2 <br />LMC:.............................0 <br />LinkWidthSupported:..............1X or 4X <br />LinkWidthEnabled:................1X or 4X <br />LinkWidthActive:.................4X <br />LinkSpeedSupported:..............2.5 Gbps <br />LinkSpeedEnabled:................2.5 Gbps <br />LinkSpeedActive:.................2.5 Gbps <br />Mkey:............................<not displayed> <br />MkeyLeasePeriod:.................15 <br />ProtectBits:.....................0 <br />ibportstate: iberror: failed: smp set portinfo failed <br /><br /><br />---- <br /><br />The switch reported this card in infiniband topology: <br /><br />MT25218 InfiniHostEx Mellanox Technologies <br /><br /><br />Someone have tested the cards ? <br /><br />Fabrizio Cuseo <br /><br /><br /><br /><br /><br /><br /><br /></pre></blockquote></div><br>
-- <br>
Sent from my Android phone with K-9 Mail. Please excuse my brevity.
<br>
----
This mail was virus scanned and spam checked before delivery.
This mail is also DKIM signed. See header dkim-signature.
<br>
</body></html>