What happens when you delete?

I have often wondered what happens to the data/file we delete. Does the computer magically make it disappear or eject it after treating it with some chemicals just like the airline toilets?

If one were to believe this discussion then it does neither. From what I gather, the computer lets you overwrite just like the audio cassettes of yore.