Is the IR remote supposed to forget alot?

I am very confused about the remote with my Roamio. I know it is IR also and that was cool, but it seems to go out of sync, or whatever, all the time. I will use the remote and all is well. Use it via IR a minute later and it works. 30 seconds later it doesn't and I have to point back at the box for it to "sync" again. Is this normal?