Hi there, I am John J.D., a fellow Microsoft user like you.
I understand your concern, and I'm here to help. There's no direct setting to resize the taskbar in Windows 11, however, you can adjust your display scale to make it more comfortable for you. Simply go to Settings (Win + I key) > System > Display. Under "Scale & layout," adjust the Scale value to the recommended or slightly higher setting. Try testing different scale percentages one at a time until you find the one that suits you best.
Let me know how it goes.
John J.D.