A settlement used to hold prisoners and use them for working in a remote location. Penal colony. A penal colony is a place where people are sent as punishment for their crimes, often to perform hard labor, in a distant or isolated area.