Always worth replacing the fob battery first as thats a quick fix. Doesnt matter if the one you have is new - even new button batteries can turn out to be a dud.
Replace in both key fobs, try each of them separately and report back on how you get on 👌
