As an Administrator, you configured the Group Policy "Configure the home page URL" under Administrative Templates\Microsoft Edge\Startup in both the home page and the new tab page.
The policy is applied to the user, but the home page button directs to the new tab page.
Microsoft Edge can be configured to open a custom home page or a new tab page.
You will find the configuration settings here: edge://settings/appearance in Microsoft Edge.
Set the additional policy Set the new tab page as the home page to Disabled in Microsoft Edge.