Explanation

They travel on horse-back means they travel on the back of a Horse. 

We use preposition on when we refer a position or surface.