You're taking the word "bang" in the "Big Bang" literally.

Everything isn't moving away from the point where the big bang occurred - that "point" is simply getting bigger and outside of the "point simply doesn't exist.

There is no "beyond".