In order to upgrade the floor or walls, open Build mode (icon below the mini-map) and select the item you want to upgrade. A window will appear and it will show you what resources you need for the upgrade and there will be the button "upgrade".