An agreement that large and small states established a two-house legislature under the US Constitution. Great Compromise. The Great Compromise was a historic agreement during the Constitutional Convention that created a two-house legislature, balancing the needs of both large and small states.