Under "Show tabs from apps when snapping or pressing Alt + Tab" click on "Don't Show Tabs". you can still hold alt and tab to see all the windows you have open, but pressing alt+tab takes you to your last open window just like on windows 10. Idk why this feature is disabled by default.
Thanks a lot.
This reverted the behavior to the Default "Alt + Tab" behaviour we are accustomed to. :)