It would be helpful to know what remote you have and where you live/what you have access to.

I've used this Logitech presentation remote for years and have never had any problems with it. It works no matter where I am pointing it. The one I have is about 10 years old and it still works. Logitech also has a newer, more expensive version with a rechargeable battery and some additional features (including a digital pointer, so you can use it when you are presenting remotely).

I also know a lot of academics rely on the Kensington presentation remote. I've used it at conferences or when I forgot my own presenter. I prefer the Logitech one, but this one is fine and gets the job done.