The article located here: https://www.poremsky.com/windows/brown-file-drawer-icon-windows-11/ describes synch files with this box as "offline" but clarifies that Offline means "the file on the hard drive is a link to the online file". I believe this is incorrect and has led to a misinterpretation of the OPs problem. The brown box icon will appear if the FILE_ATTRIBUTE_OFFLINE is on and this should only be on if the file IS on the hard drive and is NOT a link but an actual file. However, it is most likely the OP has fallen victim to a recent shift in policy led by commercial desires in the cloud services industry (2010s-2020s) to drive customer data onto cloud services WITHOUT redundant files saved local to user's machines. Most services did this without the consent of their customers and many users found themselves realizing that most of their files were now only available to them through the cloud. User's can force files back onto local machines, but they often must do so in onerous ways, such as on a file-by-file basis. There was also a high risk of error during transfers of batches of files.
The brown file box logo described would have been applied to file attributes information during the bulk transfer as Windows OS realized large numbers of files previously local to machines were suddenly on file sharing services. If you are not connected to the internet you will not be able to see the file. However, if you decide that you want to eliminate your service contract with the cloud service company, you will soon learn that that is very, very hard to do without spending inordinate amounts of time file transferring and error checking.