How a bullet turns into a beep

Here's a minor mystery:

echo •

That last character is U+2022. Select that line with the mouse, right-click, and select Copy to copy it to the clipboard. Now go to a command prompt and paste it and hit Enter.

You'd expect a • to be printed, but instead you get a beep. What happened?

...