Why is my Apple TV remote not connecting to my TV?

For some reason my Apple TV remote is not connecting to my TV. I tried charging it and restarting my TV but for some reason it still wont connect, same thing with the one on my phone. Should I get a new remote or what do you suggest?

[Re-Titled by Moderator]