Have you tested it by calling someone you know and having that person blast a whistle into their phone while you listen on yours? It will be loud but limited in strength.
Phone systems do not transfer the full power of the sound of your whistle; the electronic circuitry can attenuate any loud noise. Then the speaker at the other end has to reproduce it.