You can’t get rid of it, you can only hide it: Microsoft imposes controversial Windows Backup on users::Like it or not, the Windows Backup app installed in Windows 10 and Windows 11 is here to stay, with Microsoft calling it a "system component" that can't be
iCloud does, and if memory serves you can't remove that either. But like iCloud, you can simply not sign in.
You have to enable iCloud to upload to it. I've been uploading to local encrypted disks for years
So the same thing here.