If you haven't reached a certain chapter in the Survivor’s Path, then you will not be able to get inside the Factory itself (or visit the Settlement). But as soon as this happens, it becomes possible to find rare details in the main room and basement of the building ;)