"Go back to where you belong." is the correct sentance.

you never have to "GO" back to where you are right now.
If you are where you are, please sit back on your butt or if you don't want to sit,
just take a hike. understood? buddy?