<div dir="ltr"><div>> Also if you have no more VM under HA you can remove the HA resource
    config<br>
    ><br>
    > # rm /etc/pve/ha/resources.cfg<br><br></div>But if do this, in the future, when I realize that I need insert the previously node removed, it will work?<br><div>
    <br>
    <br>
    > But the errors from the CRM should _not_ be related to a stopping
    VM, I'm pretty sure there's another > cause for that :)<br><br></div><div>That's is what I am trying figure out.<br><br></div><div>
    <br>> If you have the logs from around the time the VM stopped look if
    something strange happened. <br><br></div><div>Well... This happen later of night and, seems to me that is happen when backup go...<br></div><div>I notice, in other PVE host, sometimes some randonly VM's just restart at night...<br></div><div>I any case, logs from proxmox are where difficult to get, mainly because the same of syslog system and I get a lot of garbage...<br></div><div>We have the /var/log/pve and /var/log;pveproxy/ but nothing useful at all....<br><br></div><div>I will try another approuch to solve this issues....<br><br></div><div>Thanks anyway....<br></div></div><div class="gmail_extra"><br><div class="gmail_quote">2016-02-05 12:08 GMT-02:00 Thomas Lamprecht <span dir="ltr"><<a href="mailto:t.lamprecht@proxmox.com" target="_blank">t.lamprecht@proxmox.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div text="#000000" bgcolor="#FFFFFF"><span class="">
    <br>
    <br>
    <div>On 02/05/2016 01:39 PM, Gilberto Nunes
      wrote:<br>
    </div>
    <blockquote type="cite">
      <div dir="ltr">
        <div>
          <div>
            <div>Sorry... I don'e mention it, but now, I have just one
              node and had disable the HA for that VM... There's no
              other VM.... Just one, with HA disable...<br>
            </div>
          </div>
        </div>
      </div>
    </blockquote>
    <br></span>
    Ah okay, now i understand.<br>
    <br>
    Can you try:<br>
    <br>
    # systemctl restart pve-ha-lrm<br>
    <br>
    Also if you have no more VM under HA you can remove the HA resource
    config<br>
    <br>
    # rm /etc/pve/ha/resources.cfg<br>
    <br>
    So the CRM won't start as it sees that no resource is configured. :)<br>
    <br>
    But the errors from the CRM should _not_ be related to a stopping
    VM, I'm pretty sure there's another cause for that :)<br>
    <br>
    If you have the logs from around the time the VM stopped look if
    something strange happened. It could also be that there was an error
    in the VM OS itself?<div><div class="h5"><br>
    <br>
    <blockquote type="cite">
      <div dir="ltr">
        <div>
          <div>
            <div><br>
            </div>
            BTW, here the outputs...<br>
            <br>
            # systemctl status pve-ha-lrm<br>
            <br>
            systemctl status pve-ha-lrm<br>
            ● pve-ha-lrm.service - PVE Local HA Ressource Manager Daemon<br>
               Loaded: loaded (/lib/systemd/system/pve-ha-lrm.service;
            enabled)<br>
               Active: active (running) since Wed 2016-01-20 08:12:07
            BRST; 2 weeks 2 days ago<br>
             Main PID: 1900 (pve-ha-lrm)<br>
               CGroup: /system.slice/pve-ha-lrm.service<br>
                       └─1900 pve-ha-lrm<br>
            <br>
            Jan 20 08:12:07 proxmox01 pve-ha-lrm[1900]: starting server<br>
            Jan 20 08:12:07 proxmox01 pve-ha-lrm[1900]: status change
            startup => wait_for_agent_lock<br>
            <br>
            <br>
            # ha-manager status<br>
            <br>
            ha-manager status<br>
            quorum OK<br>
            master proxmox01 (active, Fri Feb  5 10:37:56 2016)<br>
            lrm proxmox01 (active, Fri Feb  5 10:38:02 2016)<br>
            <br>
          </div>
          And the log attached<br>
          <br>
        </div>
        Thanks a lot<br>
        <div>
          <div><br>
            <br>
            <br>
            <br>
          </div>
        </div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">2016-02-05 10:15 GMT-02:00 Thomas
          Lamprecht <span dir="ltr"><<a href="mailto:t.lamprecht@proxmox.com" target="_blank">t.lamprecht@proxmox.com</a>></span>:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div text="#000000" bgcolor="#FFFFFF"> Hi,<br>
              <br>
              the obvious questions: what did you do before the error
              came to light? <br>
              <br>
              With this error the HA CRM cannot do any action (start,
              stop, migrate, ...)<br>
              <br>
              whats the output from<br>
              <br>
              # systemctl status pve-ha-lrm<br>
              <br>
              # ha-manager status<br>
              <br>
              on this node (or both nodes), be sure that pve-ha-lrm is
              started!<br>
              <br>
              Also if no obvious error is visible please append the logs
              with:<br>
              <br>
              # journalctl -u pve-ha-lrm -u pve-ha-crm <br>
              <br>
              You can redirect the output to an file and if yo<br>
              <br>
              journalctl -u pve-ha-lrm -u pve-ha-crm > out.log
              <div>
                <div><br>
                  <br>
                  <br>
                  <div>On 02/05/2016 01:04 PM, Gilberto Nunes wrote:<br>
                  </div>
                </div>
              </div>
              <blockquote type="cite">
                <div>
                  <div>
                    <div dir="ltr">
                      <div>
                        <div>
                          <div>
                            <div>Hello list<br>
                              <br>
                            </div>
                            In the past, I had a cluster with two nodes
                            plus storage with HA enabled...<br>
                          </div>
                          About 3 month, I note that the VM just stop,
                          from nothing at all....<br>
                        </div>
                        The PVE remain alive and storage too...<br>
                        <br>
                      </div>
                      I get this message in syslog:<br>
                      <br>
                      Feb  4 19:15:42 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 19:16:12 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 19:16:32 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 19:16:52 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 19:17:12 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 22:27:52 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      Feb  4 22:28:02 proxmox01 pve-ha-crm[1894]: got
                      unexpected error - can't open
                      '/etc/pve/nodes/proxmox01/lrm_status' - No such
                      file or directory<br>
                      <br>
                      <div>
                        <div>
                          <div>
                            <div>That's would be the reason for VM
                              stoped???<br clear="all">
                            </div>
                            <div>
                              <div><br>
                                <br>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                    <br>
                    <fieldset></fieldset>
                    <br>
                  </div>
                </div>
                <span>
                  <pre>_______________________________________________
pve-user mailing list
<a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
</pre>
                </span></blockquote>
              <br>
            </div>
            <br>
            _______________________________________________<br>
            pve-user mailing list<br>
            <a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a><br>
            <a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" rel="noreferrer" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
            <br>
          </blockquote>
        </div>
        <br>
        <br clear="all">
        <br>
        -- <br>
        <div>
          <div dir="ltr">
            <div>
              <div dir="ltr">
                <div>
                  <div dir="ltr">
                    <div>
                      <div dir="ltr">
                        <div>
                          <div dir="ltr">
                            <div>
                              <div dir="ltr">
                                <div>
                                  <div dir="ltr">
                                    <div><br>
                                    </div>
                                    <div>Gilberto Ferreira<br>
                                      <a href="tel:%2B55%20%2847%29%209676-7530" value="+554796767530" target="_blank">+55 (47) 9676-7530</a><br>
                                      Skype: gilberto.nunes36<br>
                                    </div>
                                    <br>
                                  </div>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
      <br>
      <fieldset></fieldset>
      <br>
      <pre>_______________________________________________
pve-user mailing list
<a href="mailto:pve-user@pve.proxmox.com" target="_blank">pve-user@pve.proxmox.com</a>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a>
</pre>
    </blockquote>
    <br>
  </div></div></div>

<br>_______________________________________________<br>
pve-user mailing list<br>
<a href="mailto:pve-user@pve.proxmox.com">pve-user@pve.proxmox.com</a><br>
<a href="http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user" rel="noreferrer" target="_blank">http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><br></div><div>Gilberto Ferreira<br>+55 (47) 9676-7530<br>Skype: gilberto.nunes36<br></div><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>