While the people most impacted by the deal to avert the fiscal cliff are couples making more than $450,000 per year and individuals making more than $400,000 per year, everyone's taxes are going up nonetheless compared to 2012. The bill that passed the Senate and the House did not reinstate the payroll tax holiday that has been around for the past two years.