Harrison's health isn't the only factor weighing into his decision though.
The 37-year-old has two sons who he loves to spend time with, so as you can imagine, he wasn't exactly thrilled when he saw the Steelers schedule for the first time on Thursday night.
The Steelers are the only team in the NFL this year that has to play on three major holidays and according to Harrison, that might factor into his final decision on whether or not to return.
"Retirement sounds better than ever when you realize you'd have to work on Thanksgiving, Christmas & New Year's," Harrison wrote on Instagram after the schedule was released.
He also added a very mad-faced emoji to his Instagram post.
A photo posted by James Harrison (@jhharrison92) onApr 14, 2016 at 7:03pm PDT
The Steelers are one of only six teams that will play on Thanksgiving and one of only four teams that will play on Christmas, so that's rough. The New Year's Day thing isn't that odd though, because every team will be playing that Sunday.
Harrison still hasn't made a final decision on whether or not he's going to play in 2016, and don't look for the Steelers to rush him.
Coach Mike Tomlin said in March that they're going to give him the time he needs.
"James is not going to shortchange himself," Tomlin said at the NFL owners meetings this week, via ESPN.com. "James is not going to shortchange the game of football. I believe him when he says he's going through a process to see his overall readiness and potential effectiveness. He knows what he's doing. He's been doing it a long time. He knows whether or not his body can do what he needs it to do. I respect that mentality."
Tomlin might also want to try and start convincing Harrison that holiday games are a good thing.