I have this problem since last year and I have tried everything that has been suggested in many sites including Forza Horizon forum. I can not believe that this very annoying issue has not been fixed yet.
This really forces me not to buy any other game from Microsoft. It is a pity because I like Forza Horizon but I am really upset with all the time spent trying to fix it.