Try sometimes going into your horse's stable and sit down quietly. Choose the time when it's peaceful and no commotion around. Let him watch you, don't try to call him, just sit there. He will come and look down at you with those dark, deep, warm eyes as if to say 'what's up, you?'. He might sniff you as if to check who you are, he might blow warm air into your face, his nose soft and testing, he might nuzzle your hair, rest his head on your shoulder, nudge you, lick your hands.
He won't ask any questions. He doesn't have to.