I have same issue. I have 32 GB RAM and it appears that Windows 11 is using about 7-7.5 GB when idle. Although I also have custom pagefile setup on 7 drives (SSD) with min 1024 MB and max 10240 MB.
Processor 12th Gen Intel(R) Core(TM) i9-12900F 2.40 GHz
Installed RAM 32.0 GB (31.8 GB usable)
System type 64-bit operating system, x64-based processor
Graphics: Nvidia GeForce GTX 1660
Edition Windows 11 Pro
Version 23H2
OS build 22631.3235
Experience Windows Feature Experience Pack 1000.22687.1000.0