[pve-devel] vzdump starts not running vm while stating backup

Thu Mar 26 19:37:58 CET 2015

Am 26.03.2015 um 16:27 schrieb Alexandre DERUMIER:
> Maybe it's a race between the qemu process start and begin of backup ?

No - i already tested: starting the VM with -S waited 20s and then 
started backup. Backup hangs after printing first line. I can then click 
resume - backup runs I click suspend. Backup stops / halts again.

> (maybe related to rbd ?)

Tested LVM too - same result. Absolutely no idea why it works for you. 
I'm always using virtio scsi.

Stefan

> Does it work if you launch the vm manually with -S.
>
> then after some seconds/minutes, launch manually the backup
>
> ----- Mail original -----
> De: "Stefan Priebe" <s.priebe at profihost.ag>
> À: "dietmar" <dietmar at proxmox.com>, "pve-devel" <pve-devel at pve.proxmox.com>
> Envoyé: Mercredi 25 Mars 2015 09:42:59
> Objet: Re: [pve-devel] vzdump starts not running vm while stating backup
>
> Am 25.03.2015 um 09:10 schrieb Dietmar Maurer:
>>>> No,, it works for me.
>>>
>>> OK will try to debug this.
>>>
>>> But it's correct that the kvm process is launched with -S ? for pause?
>>
>> yes (we don't want to start the VM).
>>
>
> gdb: Backtrace ust shows:
> (gdb) bt
> #0 0x00007f4978f63de1 in ppoll () from /lib/x86_64-linux-gnu/libc.so.6
> #1 0x00007f497fc26579 in ?? ()
> #2 0x0000000000000000 in ?? ()
>
> even with kvm debugging symbols installed.
>
> # thread apply all where shows:
>
> Thread 20 (Thread 0x7f49711de700 (LWP 25238)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497e0181ab in ceph::log::Log::entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #4 0x0000000000000000 in ?? ()
>
> Thread 19 (Thread 0x7f49709dd700 (LWP 25239)):
> #0 0x00007f49792296bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497de17f02 in CephContextServiceThread::entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #4 0x0000000000000000 in ?? ()
>
> Thread 18 (Thread 0x7f49701dc700 (LWP 25240)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497df01eb3 in DispatchQueue::entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f497df6cefd in DispatchQueue::DispatchThread::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 17 (Thread 0x7f496f9db700 (LWP 25241)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497df68728 in SimpleMessenger::reaper_entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f497df6d61d in SimpleMessenger::ReaperThread::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 16 (Thread 0x7f496f1da700 (LWP 25242)):
> #0 0x00007f49792296bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497ddfcf08 in SafeTimer::timer_thread() () from
> /usr/lib/librados.so.2
> #2 0x00007f497ddfde3d in SafeTimerThread::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 15 (Thread 0x7f496e9d9700 (LWP 25243)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497ddfe892 in Finisher::finisher_thread_entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #4 0x0000000000000000 in ?? ()
>
> Thread 14 (Thread 0x7f496e1d8700 (LWP 25244)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497df5839a in Pipe::writer() () from /usr/lib/librados.so.2
> #2 0x00007f497df647dd in Pipe::Writer::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 13 (Thread 0x7f496e0d7700 (LWP 25247)):
> #0 0x00007f4978f63d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1 0x00007f497df4d3fc in Pipe::tcp_read_wait() () from
> /usr/lib/librados.so.2
> #2 0x00007f497df4d690 in Pipe::tcp_read(char*, int) () from
> /usr/lib/librados.so.2
> #3 0x00007f497df5f61f in Pipe::reader() () from /usr/lib/librados.so.2
> #4 0x00007f497df648fd in Pipe::Reader::entry() () from
> /usr/lib/librados.so.2
> #5 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #6 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #7 0x0000000000000000 in ?? ()
>
> Thread 12 (Thread 0x7f496dfd6700 (LWP 25248)):
> #0 0x00007f49792296bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> ---Type <return> to continue, or q <return> to quit---
> #1 0x00007f497ddfcf08 in SafeTimer::timer_thread() () from
> /usr/lib/librados.so.2
> #2 0x00007f497ddfde3d in SafeTimerThread::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 11 (Thread 0x7f496d7d5700 (LWP 25249)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497ddfe892 in Finisher::finisher_thread_entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #4 0x0000000000000000 in ?? ()
>
> Thread 10 (Thread 0x7f496cfd4700 (LWP 25250)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497ddfe892 in Finisher::finisher_thread_entry() () from
> /usr/lib/librados.so.2
> #2 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #4 0x0000000000000000 in ?? ()
>
> Thread 9 (Thread 0x7f496c7d3700 (LWP 25251)):
> #0 0x00007f49792296bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497eba4b9b in ObjectCacher::flusher_entry() () from
> /usr/lib/librbd.so.1
> #2 0x00007f497ebb834d in ObjectCacher::FlusherThread::entry() () from
> /usr/lib/librbd.so.1
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 8 (Thread 0x7f496bfd2700 (LWP 25252)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497df5839a in Pipe::writer() () from /usr/lib/librados.so.2
> #2 0x00007f497df647dd in Pipe::Writer::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 7 (Thread 0x7f496bed1700 (LWP 25253)):
> #0 0x00007f4978f63d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1 0x00007f497df4d3fc in Pipe::tcp_read_wait() () from
> /usr/lib/librados.so.2
> #2 0x00007f497df4d690 in Pipe::tcp_read(char*, int) () from
> /usr/lib/librados.so.2
> #3 0x00007f497df5f61f in Pipe::reader() () from /usr/lib/librados.so.2
> #4 0x00007f497df648fd in Pipe::Reader::entry() () from
> /usr/lib/librados.so.2
> #5 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #6 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #7 0x0000000000000000 in ?? ()
>
> Thread 6 (Thread 0x7f496bdd0700 (LWP 25254)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497df5839a in Pipe::writer() () from /usr/lib/librados.so.2
> #2 0x00007f497df647dd in Pipe::Writer::entry() () from
> /usr/lib/librados.so.2
> #3 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5 0x0000000000000000 in ?? ()
>
> Thread 5 (Thread 0x7f496bccf700 (LWP 25255)):
> #0 0x00007f4978f63d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1 0x00007f497df4d3fc in Pipe::tcp_read_wait() () from
> /usr/lib/librados.so.2
> #2 0x00007f497df4d690 in Pipe::tcp_read(char*, int) () from
> /usr/lib/librados.so.2
> #3 0x00007f497df5f61f in Pipe::reader() () from /usr/lib/librados.so.2
> #4 0x00007f497df648fd in Pipe::Reader::entry() () from
> /usr/lib/librados.so.2
> #5 0x00007f4979224b50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #6 0x00007f4978f6e95d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #7 0x0000000000000000 in ?? ()
>
> Thread 4 (Thread 0x7f496bacd700 (LWP 25256)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497fca50a9 in ?? ()
> #2 0x0000000000000000 in ?? ()
>
> Thread 3 (Thread 0x7f496b2cc700 (LWP 25257)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497fca50a9 in ?? ()
> #2 0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x7f49299ff700 (LWP 25259)):
> #0 0x00007f4979229344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1 0x00007f497fca50a9 in ?? ()
> #2 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x7f497f7ae920 (LWP 25203)):
> #0 0x00007f4978f63de1 in ppoll () from /lib/x86_64-linux-gnu/libc.so.6
> #1 0x00007f497fc26579 in ?? ()
> #2 0x0000000000000000 in ?? ()
>
> Is there any debug code available for the backup?
>
> Stefan
> _______________________________________________
> pve-devel mailing list
> pve-devel at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-devel
>