A council leader says the factory was "at the heart of our town".