Using classic Outlook for Windows in business environments
The red X NEVER goes away!!! It is part of the button design. When working offline is enabled, the button is highlighted as in the second screenshot.
ONLINE OFFLINE
It will also say working offline in the status bar:
If Working offline is enabled, click the button *once* and wait a few minutes for it to reconnect.