So, because I have an odd sense of humor... I called it back and played along. He said there is a problem with my case number, actually provided me with one (which was incredible since he didn't have my name) then asked how I file my taxes. When I apologized for not catching his name before answering, he hung up. I guess I will have to await legal action from the IRS :(