if you gave them personal info that would allow them access to your account or charge it, then yes! Call your bank immediately and put a Fraud Alert on the card or account. They will instruct you on what to do at that point.
Just got a call today, got one yesterday. Says my entry won a 200 dollar gift card. Didn't stay on the line long enough to hear if they asked for more information