Take heart. It was no doubt the exceptional ability of his teacher that made it so easy for him.
I had a similar experience with my sons. The elder one literally rode further on every attempt and was riding right across the bumpy grass in my front yard after twenty minutes in the saddle. He has his own uni now.
The younger one managed a few metres that same day and was riding competently after the next session.