Real corsets can actually be pretty darn comfortable. I haven't tried riding a horse in one, but I occasionally put mine on with a tshirt over it to do housework. (Arthritis in my spine + bending = OW.)

That said, finding a real corset which fits you properly and not some flimsy plastic boned thing is often not easy and not cheap, so bras are probably a more accessible option.