Considering a career change to Nursing but am worried about my age and taking on more student loan debt

I'm 29 and currently work in IT. My job is a hybrid of networking, network troubleshooting and system administration. And the only reason I went for IT as my undergrad was because it was the only thing I could see myself doing, even though I barely squeaked through college.

But I've always felt a certain pull towards the healthcare industry, either as a doctor or nurse. When I watch medical dramas (not reflective of real life, I know), I find myself saying "I could do that". But I'm worried primarily about two things: a) my age; that I'm too old to get in to nursing now and that I should've thought about this when I was in high school or just starting college.

And b) that I'd be saddled with student loan debt yet again. Even if I pay off the rest of my balance in, say, five years, and then apply to a local nursing program, I'd be in my mid-30s as a student while everyone around me is in their early 20s.

So I guess I'm just looking for advice and am afraid that, even if I move up in the IT field, I might feel unfulfilled and wish I could've been a nurse. Am I too late to consider this career change?