I believe the scam you're speaking of is an urban legend even though the news media (biggest spreader of urban legends) is reporting about it. From experience, credit card companies require a lot of identifying information, above and beyond a simple "yes," to approve a suspicious charge/purchase. I doubt much, if anything, can be accomplished with the simple statement you responded with. I wouldn't worry about it.
I got the call at 7:55 tonight, no message was left. Thanks to the new security program I put on my phone the call coming in had the number and the message "Potential Spam". I rejected the call and now after reading the posts the SCAMMER is now blocked.
I answered this call on my cell, with "Hello". Then a male voice responded "Hello". Then I said "Yes, who's calling?" Then, the caller immediately hung up on me! I am afraid this might be a scam that I've heard of, where they are trying to get a recording of my voice to paste to one of their offers getting my permission for something. I was caught off guard and answered the call because I know people in NY and thought it might be someone I know. Now I feel so foolish for not allowing my VM to screen the call!