[PVE-User] backup takes so long to finish

[Gilberto Nunes]

Well I don´t know exactly but perhaps the reason is because the VM is
hosted over LVM-on-iSCSI???
Just a idea...I am really lost here...Trying find a reason to explain all
the lost of performance...
I took all necessary cares about cables, switches, storage and now a simple
backup task takes so long to finish... I am stunned!...


2014-08-27 14:53 GMT-03:00 Iosif Peterfi <iosif.peterfi at gmail.com>:

> Probably there is the bottleneck. 1Gbit = 100MB/s. Probably your SAS might
> be faster than considering it uses SATA II 300 MB/s or SATA III 600 MB/s.
>
>
>
> On Wed, Aug 27, 2014 at 7:35 PM, Gilberto Nunes <
> gilberto.nunes32 at gmail.com> wrote:
>
>> >> Is the storage over iSCSI ?
>>
>> Yes! Standard iSCSI. I not enable trunk yet, I meant, bonding... You
>> know...
>>
>> >> Is the storage via 1GB link ?
>>
>> Yes... Switch gigaethernet, CAT6 and all NIC are gigaethernet as well...
>>
>>
>>
>>
>> 2014-08-27 14:33 GMT-03:00 Iosif Peterfi <iosif.peterfi at gmail.com>:
>>
>> Is the storage over iSCSI ? Is the storage via 1GB link ?
>>>
>>>
>>> On Wed, Aug 27, 2014 at 7:29 PM, Gilberto Nunes <
>>> gilberto.nunes32 at gmail.com> wrote:
>>>
>>>> Just for compare, the very same backup from same VM takes 50 minutes,
>>>> on previously scenario, I meant, run in a single IBM M4 server with SAS
>>>> disks...
>>>> Now, in the Storage and an IBM x3250 M4 server, with 128GB of memory,
>>>> takes 6 hours!
>>>> I can't understand why! So weird!
>>>>
>>>>
>>>>
>>>> 2014-08-27 14:21 GMT-03:00 Gilberto Nunes <gilberto.nunes32 at gmail.com>:
>>>>
>>>>> Well... This not justify all this low performance, since the VM
>>>>> previously ran on another IBM machine with single SAS and backup task ran
>>>>> nicely.
>>>>> Since the VM now running in high level enterprise Storage, I expected
>>>>> more performance, if I am not wrong with that...
>>>>>
>>>>>
>>>>> 2014-08-27 14:13 GMT-03:00 Iosif Peterfi <iosif.peterfi at gmail.com>:
>>>>>
>>>>> Maybe you will have better performance if you split them. So keep the
>>>>>> busiest database on IBM storage and put the others on USB. This way you
>>>>>> share the I/O load.
>>>>>>
>>>>>> Regards,
>>>>>> Iosif
>>>>>>
>>>>>>
>>>>>> On Wed, Aug 27, 2014 at 7:09 PM, Gilberto Nunes <
>>>>>> gilberto.nunes32 at gmail.com> wrote:
>>>>>>
>>>>>>> Unfortunately, I do not have such luxury by now... SSD is out of the
>>>>>>> question, for a moment...
>>>>>>> But I changed from USB device to SAS device, in hope to improve the
>>>>>>> I/O performance...  But no success...
>>>>>>> The VM itself, is running is SAS as well, since it hosted in an IBM
>>>>>>> Storage...
>>>>>>>
>>>>>>> I'm still search the cause of issue...
>>>>>>>
>>>>>>> Thank you BTW...
>>>>>>>
>>>>>>>
>>>>>>> 2014-08-27 14:04 GMT-03:00 Iosif Peterfi <iosif.peterfi at gmail.com>:
>>>>>>>
>>>>>>> Mitigate the I/O bottleneck by assigning different hard drives, even
>>>>>>>> consider using enterprise grade ssd.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Aug 27, 2014 at 6:55 PM, Gilberto Nunes <
>>>>>>>> gilberto.nunes32 at gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hum... At first moment, I thought I/O could being a trouble, since
>>>>>>>>> I was ran backup in USB devices.
>>>>>>>>> But now, I ran backup task on SAS disk! So performance and I/O is
>>>>>>>>> not an issue here...
>>>>>>>>> And, I can't shrink the file, because the entire disk is being
>>>>>>>>> used to all databases as I described before...
>>>>>>>>>
>>>>>>>>> If somebody else has any other advice, I will appreciate...
>>>>>>>>>  Thank you
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2014-08-27 13:47 GMT-03:00 Bart Lageweg | Bizway <bart at bizway.nl>:
>>>>>>>>>
>>>>>>>>>   High I/O when you backup ?
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Try https://pve.proxmox.com/wiki/Shrink_Qcow2_Disk_Files (when
>>>>>>>>>> you have a good backup!)
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> *Van:* pve-user [mailto:pve-user-bounces at pve.proxmox.com] *Namens
>>>>>>>>>> *Gilberto Nunes
>>>>>>>>>> *Verzonden:* woensdag 27 augustus 2014 18:47
>>>>>>>>>> *Aan:* pve-user at pve.proxmox.com
>>>>>>>>>> *Onderwerp:* [PVE-User] backup takes so long to finish
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hello
>>>>>>>>>>
>>>>>>>>>> I have a VM with Windows 2012 running nicely in PVE 3.2.
>>>>>>>>>>
>>>>>>>>>> This VM has a 300 GB disk size that was re-partition with 5 or 6
>>>>>>>>>> different parts, in order to allocate different databases...
>>>>>>>>>>
>>>>>>>>>> The issue is that the backup task takes 6 hours to generate a lzo
>>>>>>>>>> file with 13 GB size!
>>>>>>>>>>
>>>>>>>>>> However, I have another VM, which is Windows 2008 with disk 120
>>>>>>>>>> GB size.
>>>>>>>>>>
>>>>>>>>>> The backup makes 74 GB file of size, and takes approximately 30
>>>>>>>>>> minutes!!!
>>>>>>>>>>
>>>>>>>>>> I can't see why the first task took so long time to finish!!!
>>>>>>>>>>
>>>>>>>>>> Can anybody assist me??
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Gilberto Ferreira
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Gilberto Ferreira
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> _______________________________________________
>>>>>>>>> pve-user mailing list
>>>>>>>>> pve-user at pve.proxmox.com
>>>>>>>>> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Gilberto Ferreira
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> Gilberto Ferreira
>>>>>
>>>>
>>>>
>>>
>>
>>
>> Gilberto Ferreira
>>
>>
>

Gilberto Ferreira
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.proxmox.com/pipermail/pve-user/attachments/20140827/183489e9/attachment.htm>