Older horses that start pulling back are often losing their eyesight. Same if an older horse starts 'looking for something to spook at.'

Have his eyes checked first. Then go from there.

"Gypsy gold does not chink and glitter, it gleams in the sunshine and neighs in the dark."