You've spent years socking money away month after month, and now you're ready to access the cash you've accumulated in your IRA or 401(k). But withdrawing funds at the wrong time comes with consequences that you'll need to consider before you start tapping those accounts. With that in mind, here are a couple of reasons to consider waiting before taking money out of a retirement plan.Your IRA or 401(k) is supposed to serve as a source of retirement income, so the IRS doesn't want you to start withdrawing funds until you're at an age where you might conceivably retire.