Remote won't stay in RF mode

The remote is paired to my Roamio and will work in RF mode for a little while after I hold the TiVo button + D but then it will switch back to IR mode and then back and forth every few seconds or minutes.

Anyone else have this problem or have any suggestions?

I've tried resetting the remote and removing the batteries.

Remote won't stay in RF mode