[PVE-User] NFS - Permission Denied

David Thompson david at digitaltransitions.ca
Tue Jul 24 22:54:39 CEST 2012

Hi all,

I have an Intel Modular Server deployment with 2 nodes on it with shared storage over NFS.

We export a share on our Promise VessRAID NAS over NFS to the 2 nodes. Recently, something happened in the environment that caused the 2 nodes to lose the connection to the storage array. We had to reboot the first node to bring everything back up. While the second nodes doesn't have anything critical on it, I thought I would look into the issue to see if I can see what was happening with it.

I can't see why its not remounting the nfs share since its now on the first node again after a reboot. I have looked through the logs and I see this error in the syslog:

Jul 24 14:37:39 node2 pvestatd[398136]: command '/usr/sbin/vzctl exec 201 /bin/cat /proc/net/dev' failed: exit code 8
Jul 24 14:37:39 node2 pvestatd[398136]: command '/usr/sbin/vzctl exec 202 /bin/cat /proc/net/dev' failed: exit code 8
Jul 24 14:37:39 node2 pvestatd[398136]: WARNING: command 'df -P -B 1 /mnt/pve/nfsData' failed: exit code 1

However if I do a df -H on the system, I get the following:

root at node2:/mnt/pve# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/pve-root   23G  1.3G   20G   7% /
tmpfs                  16G     0   16G   0% /lib/init/rw
udev                   16G  232K   16G   1% /dev
tmpfs                  16G   41M   16G   1% /dev/shm
/dev/mapper/pve-data   45G  181M   45G   1% /var/lib/vz
/dev/sda1             495M   56M  415M  12% /boot
/dev/fuse              30M   24K   30M   1% /etc/pve
df: `/mnt/pve/nfsData': Permission denied

I have tried stopping nfs-common and restarting the pvestatd daemon as well, however none of it seems to work to bring the volume backup and online on the second node. The only way I can see getting it back up and running would be to reboot the physical node, which I would rather not do if it can be avoided.

The server still sees the directory, however it doesn't seem to know who owns it or what the permissions on it should be:

root at node2:/mnt/pve# ls -al
ls: cannot access nfsData: Permission denied
total 8
drwxr-xr-x 3 root root 4096 Apr 19 14:00 .
drwxr-xr-x 3 root root 4096 Apr 10 09:50 ..
d????????? ? ?    ?       ?            ? nfsData

Does anyone have any knowledeable way for me to figure out how to get the external nfs share mounted on this node without having to reboot the entire node?



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://pve.proxmox.com/pipermail/pve-user/attachments/20120724/08207eac/attachment-0013.html>

More information about the pve-user mailing list