Came here with the same problem on 19042.928.
Most of the other suggestions are destructive or will leave you dangerously undefended.
I set for better performance and the eject button works fine.
Flushing only took a few seconds and I had just overwritten ~20G.
The EJECTING_GET_OFF_THIS_DRIVE message is not getting to Defender if the drive is set to quick eject.
Maybe Defender is not listening in that case, which would seem reasonable - it's a readonly process.
If the drive is on laptop power, the performance setting is safe if you use eject.
BTW, in 19042.928, there is no safe to remove dialog. The drive symbol just disappears from the tray.
@stumit,
That does not solve the problem for me, it has been like this for about a year.
The only way that worked for me is by excluding the root Folder of the external drive in defender.
Keep in mind that recently, besides MsMpEng.exe there was another possible cause for people that use INTEL DSA, DSAService (32 bit) that prevented the ejection, so we need to check the event viewer to see the message on error 225 and check for the culprit, there could be other reasons too.
Not sure if they fixed that DSA problem in 19042.928, it was reported in FBH.