A settlement used to hold prisoners and use them for working in a remote location. Penal colony. A penal colony is a place where prisoners were sent to live and work, often in distant or isolated areas, as a form of punishment.