Sounds like all they wanted was for you to say yes on the phone.  This sounds like an adaption to the current scam where they use a recording of you saying the word yes to get access to your accounts.  http://www.cbsnews.com/news/beware-new-can-you-hear-me-scam/