I saw a report on Dr. Phil the other day about this. It is a scam and you should keep a close watch on your accounts. They say they take the "yes" given and reconstruct the call making it sound as if you are giving authorization.
http://www.cbsnews.com/news/beware-new-can-you-hear-me-scam/
Another person with a reading problem. That news article says "may, might, maybe". Since you claim to know so much how about giving us one concrete example of what they could possibly do with that one word, or even better give us one example of someone who was actually and truly scammed with that one word. You won't be able to because no one has ever been scammed that way.
They called 6x on Wednesday, 4x yesterday and 4x today. The recording says to press 1 if I don't want to be called again, but clearly that does nothing as they've continued to call. It's listed as being from Keenesburg, CO.