FsLogix - Unclean logoff causing locked files until server reboot

Much R 101

Problem is described by M4deman under unclean-logoff-causing-locked-files-until-server-reboot

It seems to have something to do with the 2009 version.
The latest version of FSLogix is installed whats-new

Description

After a user logoff, the "System" Process (PID 4) locks the following folders:

C:\Users\local_username\AppData\Local\Microsoft\Credentials
C:\Users\local_username\AppData\Roaming\Microsoft\Credentials

The user is completely logged of, according to Task Manager.

In the FSLogix Profile Log file I can see the following:

[07:53:55.601][tid:00000c90.0000ce44][ERROR:00000020] Delete profile failed for sid S-1-5-21-3364776539-3721753400-1968955100-1179, Cleaning up manually. (Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird.)
The last sentence means that the process cannot access the file, because another process already uses it.

Also the whole "local_username" folder cannot be deleted:

[08:23:15.479][tid:00000c90.0000bcc4][WARN: 00000005] Failed to delete C:\Users\local_usename (Access is denied)
Access Denied

Does someone have any info on this behaviour?

Anonymous

2021-01-14T03:03:58.32+00:00

Hello @Much R

Did you check affected user has full control and Owner over their FSLogix Folder and the VHDX files ?

Thanks
Karlie
Much R 101 Reputation points

2021-02-02T08:02:21.997+00:00

Hello,

Where is my answer from yesterday?
Why was this deleted?

How can I open a ticket at Microsoft now?

Thank you
Anonymous

2021-02-02T08:16:39.607+00:00

Hello @Much R

sorry I was going to delete my comment as it wasn't helpful, and your comment is below mine, so it seems they were deleted together. I want to restore but it doesn't has this option.

FSLogix is supported for use with versions of Windows and Office that are still included in the Microsoft Support Lifecycle.

How to open a FSLogix Support Request
https://social.msdn.microsoft.com/Forums/en-US/14ea5f6f-760b-4ad2-83cf-23c3cbc1bcc4/how-to-open-a-fslogix-support-request?forum=FSLogix

Best regards
Karlie
Germain 11 Reputation points

2021-02-19T11:44:10.117+00:00

We are currently experiencing the same issue. The user VHDX is locked by system and can only be unlocked by rebooting the server.
Has Microsoft acknowledged this issue?

Currently using: 2.9.7654.46150
Bracko Ewald 31 Reputation points

2021-02-19T12:10:09.137+00:00

Did you activate the registry value HKEY_LOCAL_MACHINE\SOFTWARE\FSLogix\Apps\CleanupInvalidSessions (REG_DWORD, 0x1)?
Do you use Cloud Cache or not?

Also, maybe you can check with the frx command line tool if there are still some redirects pointing to the use VHDX file. You can then use that tool to delete them manually and detach the VHDX files afterwards using diskpart.
Marius Neuhaus 1 Reputation point

2021-03-09T10:31:38.737+00:00

Hello,

we have the same problem.
We use on-premise terminalserver.:
Windows Server 2019
Citrix 1912 CU2 LTSR
FSLogix 2.9.7621.30127

I've tried the CleanupInvalidSessions RegKey, but it doesn't effect.
We don't use Cloud Cache.
FSLogix Configuration only local and not per gpo.
The frx command line tool dont show redirects pointing to the use VHDX file.
Permission are set correct. Users work correctly with the containers.
Luckily the problem occurs only randomly and not at every logoff.

In the FSLogix Configuration we include the group domain-users and exclude the domain-administrators.
Could it be a Problem?

Best Regards,
Marius
itsupport 1 Reputation point

2021-05-26T12:40:37.147+00:00

When this happens are you left with multiple <USERNAME>.original folders? I've seen it go as high as <USERNAME>.original11 before I just manually delete all the folders.
Guido Racamato 26 Reputation points

2021-09-28T17:39:34.337+00:00

Hello Everyone, For the Group Policy Access Denied, once you get an affected user, could you please modify the following registry? There's no reboot required.

HKLM\SOFTWARE\Microsoft\Windows NT\CurrentVersion\ProfileService\References\<SID affected user>
REG_BINARY: RefCount
Value: 0
Jon McLeod 1 Reputation point

2021-11-19T14:56:08.267+00:00

This is the answer. Thank you.
Farooq 5 Reputation points

2024-02-14T12:02:36.9533333+00:00

We are having the same issue. We have an RDS environment and time to time users get logged in with Temporary profile, when I check the FSlogix logs I am seeing the following error - Failed to open virtual disk: \server\Profiles\S-1-5-21-26711-2174_user\Profile_user.vhd (The process cannot access the file because it is being used by another process.)
What we done to try resolve this or at least try find the cause and reduce downtime is, we have removed AV from all RDS host, we have created a script which logs out all users at midnight but issue is still occurring. We have a case opened with Microsoft but unfortunately there has been no resolution. Another issue we had is where users could not sign into their Outlook, teams, Office profile on the host. Has anyone else experiencing this issue and has anyone managed to resolve this? Any help or suggestion would be much appreciated.

107 answers

SMB Solutions Cloud Services Pty Ltd 31 Reputation points

2021-02-18T23:24:22.323+00:00

We are also now experiencing the same issue across multiple RD Servers and the only workaround we seem to have is to reboot the affected server which is problematic as we can have 30 users on the server and only 1 is impacted by the issue.

We need some kind of fix urgently (statement of the bleeding obvious)
Was this answer helpful?

2 people found this answer helpful.
SMB Solutions Cloud Services Pty Ltd 31 Reputation points

2021-07-23T08:49:17.453+00:00

We have deployed the latest release and our issue seems to be solved on all of our RDS servers.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Hoppe, Tim 6 Reputation points

2021-02-11T08:31:50.333+00:00

We are seeing the same issues!
We have a few hundred smaller environments, each with 1-10 Citrix VDAs and the issues occur randomly.
All of our machines are running Server 2016 (German), Citrix 1912 LTSR (99% are published Desktops) and the latest FSLogix Release (all profile and no office containers).

I will try to open a ticket with Microsoft today and hope that this increases the visibility on Microsoft's side.
Was this answer helpful?
Dlo 96 Reputation points

2021-02-11T12:00:23.877+00:00

What are your session timeouts and stuff for users? We have long timeouts and are going to try to shorten them to log users out sooner to see if that helps some.
Do you see folders in the user folder as well? As in user folders who logged out but nothing was cleaned up behind them to?

We even see the folders there if the VHD is unmounted sometimes. Really hoping they find some solutions for this.

Hoppe, Tim 6 Reputation points

2021-02-11T14:23:52.97+00:00

We have the following settings "Set time limit for active but idle Remote Desktop Services sessions" at 3 hours and "Set time limit for disconnected sessions" at 8 hours.

Under C:\Users we see quite a lot of "local_Username" that are days old and sometimes cannot be deleted because there are either files still open or apparently the folder does not exist anymore. The users have logged off long ago and the VHD was successfully removed. If the user connects to this VDA again the "local_Username#" will have a number next to it.
The second and worse case is if the whole user profile is stuck. Also, with "files still open" or "folder does not exist anymore" when trying to delete it. VHD was apparently successfully removed and cannot been seen in the disk manager, but the only way to fix this is to reboot and then do a clean-up.

Our support request has been opened and we've been assigned an engineer. Let's see how that goes!

Bracko Ewald 31 Reputation points

2021-02-11T14:28:46.07+00:00

Have you checked with the frx command line tool from fslogix if there are still remaining folder redirections pointing to the locked local_ folders?

Hoppe, Tim 6 Reputation points

2021-02-11T16:27:42.137+00:00

Actually never used the tool until now. There were no redirects left on both folders that I can and cannot delete.
Thanks for the hint!

Dlo 96 Reputation points

2021-02-12T12:09:15.543+00:00

What files do you see in these local_username folders?
Most of ours have some outlook logging files which we never turned on so we are looking into that as well to see if its causing an issue.
Microsoft called me yesterday and we worked on the issue a bit thats what we came up with so far.

Gianluca Melis 101 Reputation points

2021-05-06T09:30:23.6+00:00

servus!
Please make yourself a favor and do not waste time troubleshooting that!
I had 2 weeks of pure hell trying to fix that!
We had the exact same problem and it literally vanished after installing 2004 (2.9.7349.30108)
Now its working since 2 weeks with almost no errors. edit we have other minor errors regarding other things but never saw the same error again (yet) and the user can log on and off and work basically undisturbed
In order to install 2004, you need to fully uninstall 2009 and restart the server and then install 2004. Make a backup of your Regedit settings too! (in my case they were not deleted but better be sure!)
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Francois Rabinowicz 1 Reputation point

2021-02-10T17:04:36.567+00:00

We are having the same issue there with the last 3 versions of FSLogix.
We are currently working with latest one as recommended by Microsoft as we have a support ticket open with them since December with no luck.
One of the issue is they want a user with a server having the issue but we have no users that have time to loose doing nothin and we have to reboot the server, disconnecting everybody to fix the issue.
Releasing handles help sometimes but not always. We also had issue where with more than 5 users log on the server; Citrix PVS; it will freeze but was not happening for non Cloud Cache servers.

Right now, what we see is local_XXXXX folders not cleaned correctly as there is no more permissions on some folders after logoff.
I am not able to change the ownership of these folders to delete them manually. Not even SYSTEM.
Subfolders are random without permissions but for example AppData\Roaming\$Recycle.Bin is always without them.

We have stuck sessions on servers, not clean logoff and as soon as one user try to reconnect to the same server, it's finish. you have to reboot it.
Was this answer helpful?
Bracko Ewald 31 Reputation points

2021-02-10T18:29:35.903+00:00

Are the VHD(x) disks already detached? Have you checked with the frx command line tool from fslogix if there still exist redirections (frx list-redirects | find "[username]") to the "Local_xxx" folders of the affected users?
Those existing redirections should be the reason why you cannot delete those folders.
You can manually delete the redirections with that frx tool in this case. I prefer to use a small script where I just replace the username and run it to do that in one go per user.
Then you should be able to delete the "Local_xxx" folders.

Mihail Gusev 1 Reputation point

2021-02-11T11:59:08.037+00:00

I have the same issue, and there is now fslogix redirects for this users with stucked local folder, while they're logged off. Their VHDx disks already detached.

Bracko Ewald 31 Reputation points

2021-02-11T15:22:11.167+00:00

You can remove those redirections manually using the frx command line tool one by one. Have you tried to do that and then afterwards to delete the local_ folder for that user?

Mihail Gusev 1 Reputation point

2021-02-12T09:24:23.747+00:00

Sorry, I made a spelling mistake. I meant "there is no fslogix redirects". And yes, i've tried to remove those local_ folders, but as other people said, there are subfolders without permissions
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Dlo 96 Reputation points

2021-02-10T11:12:44.303+00:00

So from my earlier post on this to give a bit more info.

Our issue is a tiny bit different but the same. We have users that get stuck logging off of our Citrix environment.
They have 4 / 5 hung processes that are all Microsoft stuff. The issue got a tiny bit better with the latest versions of FSLogix as the user at least gets logged off a bit more where Citrix doesn't see the session but its still there with no user attached to it. Sometimes they have the VHD attached sometimes they don't which is nice.
Our session timeouts are pretty long like 8 hours before it logs off users. I am going to try a few changes to log off timers and a few other things.
We aren't sure if its a load thing or maybe a session timeout issue where if users are inactive for so long and stay disconnected is that when FSLogix runs into issues since we barely see this in our test environment and also our smaller delivery groups with less users.
We also use the NetApp in azure we may try swapping some profiles to blog storage to see if that helps as well.

Anyone else somewhat able to figure out the hung session issue or have other things to try?
Was this answer helpful?

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Dlo 96 Reputation points

2021-02-04T11:57:10.957+00:00

We have been having this issue for months and it randomly gets worse at times then we have to reboot our Citrix Session hosts running windows 10 multisession version in azure.
We have a case open with Microsoft as well and we also get users not able to log into their sessions as well like you guys get with the Group Policy issues and other random issues.
They have no clue what's going on yet and I asked for my case to be escalated as well.

We also have random files being deleted off our C:\ Root even one or two whole folders like the other user had in another thread on here. Trying to see if that is tied to FSLogix as well so far its seems to be.

I am wondering if its a load thing cause we have 4/5 Delivery groups in Citrix and it happens more to the ones that have more users. Way less to the ones that have less users.
We have been having this issue with the last 2/3 Versions of FSLogix as well. We upgraded hoping to resolve the issue.
Was this answer helpful?

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

FsLogix - Unclean logoff causing locked files until server reboot

107 answers

Your answer