Yes, most pensions are subject to federal income tax

The money you receive from a pension is taxed as ordinary income by the federal government. That means it counts toward your total income for the year, and you owe federal tax on it at your regular tax rate — the same way you would on wages from a job.

The amount of tax you actually owe depends on how much your pension pays you, what other income you have, and which tax bracket you fall into. A pension of $20,000 a year will result in less federal tax than a pension of $60,000 a year. If you also have Social Security income, investment income, or part-time work, all of that gets added together when calculating your federal tax bill.

The one exception is a Roth IRA — contributions you made with after-tax dollars come out tax-free, though earnings on those contributions may be taxed depending on how long the account has been open and your age. Most traditional pensions, 401(k)s, and IRAs do not have this exception.

Key Takeaways

  • Pension income counts as ordinary income on your federal tax return, taxed at your regular income tax rate.
  • You may owe federal tax even if your pension is your only income, depending on the amount and your age.
  • Some pensions allow you to have taxes withheld automatically, which reduces what you owe when you file.
  • State and local taxes on pensions vary by location — some states do not tax pension income at all.
  • If you withdraw money from a traditional IRA or 401(k) before age 59½, you typically owe federal tax plus a 10 percent early withdrawal penalty.

How withholding works on pension payments

When your pension starts paying you, your employer or the pension plan administrator can withhold federal income tax from each payment. This works the same way withholding does on a paycheck — money is taken out before you receive it, and it goes toward your federal tax bill.

You control how much gets withheld by filling out a Form W-4P (Withholding Certificate for Pension or Annuity Payments). You can ask for no withholding, a flat dollar amount per payment, or a percentage of each payment. If you do not fill out a W-4P, the plan will usually withhold as if you are single with no dependents, which often means withholding more than you actually owe.

Withholding is optional — you can choose to have zero dollars withheld and pay your taxes when you file your return instead. However, if you do not withhold enough throughout the year, you may owe a penalty when you file. The safest approach is to withhold enough so that your total withholding covers what you expect to owe.

When you have to file a federal tax return

Whether you must file a federal return depends on your age and the total amount of income you receive. The threshold changes each year, so the exact number varies.

For 2024, if you are under 65 and your only income is a pension, you generally must file if your pension is more than $13,850. If you are 65 or older, the threshold is higher — around $15,450 — because you get an additional standard deduction. If you have other income (wages, Social Security, investment income), the thresholds are lower and the calculation is more complex.

Even if you are not required to file, you may want to file anyway. If you had taxes withheld from your pension and you do not owe any federal tax, filing allows you to get a refund of the money that was withheld. You have up to three years to file and claim a refund.

Taxes on early withdrawals from retirement accounts

If you withdraw money from a traditional IRA or 401(k) before you turn 59½, you owe federal income tax on the withdrawal plus a 10 percent early withdrawal penalty. That penalty is in addition to the regular income tax, not instead of it.

For example, if you withdraw $10,000 from a traditional IRA at age 50, you owe income tax on the full $10,000 plus $1,000 in penalties — before any withholding is applied. Some exceptions exist: withdrawals for a first-time home purchase (up to $10,000 lifetime), medical expenses, or disability may avoid the penalty, though you still owe income tax.

Roth IRAs have different rules. You can withdraw the money you contributed (not the earnings) at any age without penalty or tax. Earnings withdrawn before age 59½ are subject to the 10 percent penalty and income tax, with limited exceptions.

The difference between federal and state pension taxes

Federal tax and state tax are separate. Your pension is taxed by the federal government, but it may or may not be taxed by your state, depending on where you live.

Some states do not tax pension income at all — these include Florida, Illinois, Mississippi, Pennsylvania, and Tennessee, among others. Other states tax all pension income the same way the federal government does. A few states have middle-ground rules: they may exempt military pensions, public employee pensions, or pensions below a certain income level.

If you moved to a different state after you retired, you may owe taxes to your new state even if your old state did not tax pensions. The rules depend on where you live when you receive the pension payment, not where you worked or where the pension comes from. Check your state's tax website or speak with a tax professional if you are unsure whether your state taxes your pension.

How Social Security affects your pension taxes

If you receive both a pension and Social Security, the combination can push you into a higher tax bracket and may cause some of your Social Security to become taxable. This is one of the most confusing parts of retirement income taxation.

The federal government uses a formula called combined income to determine how much of your Social Security is taxable. Combined income includes your adjusted gross income, tax-exempt interest, and half of your Social Security benefits. If your combined income exceeds certain thresholds ($25,000 for single filers, $32,000 for married filing jointly), up to 85 percent of your Social Security becomes subject to federal tax.

This means that adding a pension to your income can trigger taxation of Social Security that would not have been taxed if you had only Social Security. There is no way to avoid this rule, but you can plan for it by adjusting your withholding or making estimated tax payments throughout the year.

What to do if you think you are paying too much in taxes

If you are having too much withheld from your pension, you can file a new W-4P to reduce the withholding. If you are not having enough withheld and you owe money at tax time, you can increase your withholding or make quarterly estimated tax payments.

A tax professional or your local IRS office can help you figure out the right withholding amount based on your specific situation. The IRS also offers a Tax Withholding Estimator on its website (irs.gov) that walks you through your income and calculates how much you should withhold.

Keep in mind that pension withholding is not the same as paying your full tax bill. Withholding is just money set aside during the year. When you file your return, the IRS calculates what you actually owe based on all your income, deductions, and credits. If you withheld more than you owe, you get a refund. If you withheld less, you owe the difference.

Frequently Asked Questions

Do I have to pay federal tax on my entire pension amount?

Yes, the full amount of your pension payment is subject to federal income tax. However, the actual tax you owe depends on your total income and tax bracket. You may also be able to reduce your taxable income through deductions or credits, which lowers the tax owed on your pension.

What happens if I do not have taxes withheld from my pension?

If you do not have taxes withheld and you owe federal tax when you file your return, you may owe a penalty for underpayment. To avoid this, you can either request withholding on your W-4P or make quarterly estimated tax payments to the IRS throughout the year.

Can I avoid federal tax on my pension by moving to another state?

No. Federal tax applies no matter where you live. Some states do not tax pension income, which can reduce your total tax burden, but you will still owe federal tax on your pension regardless of your state of residence.

Is my military pension taxed differently than a civilian pension?

Military pensions are taxed the same way as civilian pensions at the federal level — they count as ordinary income. However, some states offer special tax breaks for military pensions that they do not offer for civilian pensions, so your state tax treatment may differ.

What if my pension is very small — do I still owe federal tax?

It depends on the amount and your age. If your pension is below the filing threshold for your age group and you have no other income, you may not be required to file. However, if you had taxes withheld, you should still file to get a refund of that money.