How to get rid of floating black box with arrow on apple Iphone12

I’m guessing here. Are you talking about VoiceOver? If yes, triple press Side Button (or Home Button on non-Face ID device).

If that’s not VoiceOver, then maybe get a screenshot or photo to show what’s the box you are on about it?