With Office 2024 and Window 11 24H2. No Outlook Classic listed.
Fix: Open System Settings. Goto Accounts. Goto Email & Accounts. Click Add Account and add in an exchange account.
At this point, you will see Outlook (classic) on the All Apps list. Click it and configure a profile in Outlook.
Crazy part - You can now go back and delete that account you manually created. The classic will remain and will also be available when logging on with other users/profiles.
Of note - Under HKCU\Software\Microsoft\Office\16.0, you will find Outlook Key folder. Same for HKLM.
Reason for this roundabout fix is that Outlook New does not support On-Prem Exchange. Also, the old Control Panel 'Mail' no longer exists to create the user profile.
EDIT: They've patched out the fix I'd found. If you go to @2Learn4Fun on the fourth tab of this thread, the link to D/L Outlook Classic (inlcuded here) does still work. You need to scroll down to the 'Install Classic' section and click on the download button. The install from store might or might not work. The reviews are questionable.