Once you visit the path, you can see some app shortcuts. You can right-click on a shortcut and select the Delete option. The Taskbar icon should disappear. If it asks you to confirm the deletion.

But with Windows 11, this area has been named Taskbar Corner Overflow. You can see icons of the Internet, Antivirus, Battery Status, etc in the Taskbar Corner Overflow. There is a way to customize ...