The Policeman on Horseback (1961)

A soldier has his horse stolen on his wedding day and spends the first day of his honeymoon looking for it.