Minecraft horses in the corner?

I have a problem with Minecraft and with the horses. When I put them in a fenced area, they always run into a corner and stop there. I sometimes lure them out with apples and redistribute them, but a few minutes later they're back in the corner. It's the same with untamed ones. Is there a reason and can I do something about it?

Just make several small enclosures in your large enclosure

Actually it should look like a big paddock, but it would be an alternative.

The horses, or actually all animals, just keep moving, always in a certain direction. Therefore I would place several fences in the paddock and then fasten the horses with lines

Hope could help = D

Thanks, the lines are a good idea!

Now I have piles in the ground and tied up the horses. Is hardly noticeable and looks much better than before.