You were wise. It's illegal to require payment of any kind for wining a prize, even if the contest is real. In this case is was a complete scam and you would just have been giving your credit card number to criminals.
But by answering this scumbag scammer's call---you became a "mark"--and will likely snag more calls from either this as*hole.....or anybody else they sell your contact information to.