Alright, to remove the "Please sign in" button, simply do as follows.
First, at the top, click the three dots to get extra options and select "Options"
Then in the new window, uncheck the option for "Show files from Office.com" and the "Please sign in" button should go away like mine did.
Hope this helps!