If you haven’t reached a certain chapter in the Survivor’s Path, you won’t be able to enter the Factory (or visit the Settlement). But once you do, you’ll be able to find rare details in the main room and basement of the building ;)