The relative flow of the Schwarzschild vs. the proper time during the classical evolution of a collapsing shell in the Schwarzschild coordinates practically forces us to interpret black hole formation as a highly non-local quantum process in which a shell/anti-shell pair is created within the incipient horizon, thus canceling out the original collapsing shell exactly at the horizon. By studying quantum fields in the black hole background, we reveal similar non-local effects. Among other things, the outgoing member of the Hawking pair very quickly becomes entangled with the black hole geometry (and not its partner), which is in contrast with the usual assumption that the Hawking pair is maximally entangled according to the local geometry near the horizon. Also, an infalling wave affects the black hole geometry even before it crosses the horizon. Finally, we find that a particle takes a finite amount of time to tunnel in and out of the black hole horizon, and thus avoids infinite blue and redshift in processes happening exactly at the horizon. These findings strongly support the picture of a black hole as a macroscopic quantum object.