In order to upgrade the floor or walls, open Build mode (icon below the mini-map) and select the item you want to upgrade. A window will appear which will show you what resources you need for the upgrade, and there will also be the "Upgrade" button.