When expenses exceed revenue. Budget deficit. In history, a budget deficit is when a government spends more money than it collects in taxes.