i signed up to a subscription on a scam site. if i change my credit card on apple pay will i still be charged?

As the title says, I used my Apple Pay function on my phone to sign up to a scam website (unwittingly of course). It has apparently got my authorisation to take money from me every week. I cancelled the subscription but it was through a bot and had not received any confirmation. Hundreds of bad reviews for the website saying it’s a scam. I just want to know if I change my credit card or block the merchant through my bank will they still be able to take money from me? Because I’m thinking once I get a new card, they will still be able to take the money. I’m a bit concerned, obviously, and would appreciate any help. Thanks!