This sounds like the same issue encountered here.
There are some bugs in Omniverse that are only present with Fabric Scene delegate enabled. As with the post I linked above, I’ve seen these with playing back animation from the sequencer.
Unfortunately I am not aware of any work around, though I have previously animated cameras by keyframing transforms without issue so it’s certainly been possible in the past. It may also be worthwhile reaching out to NVIDIA via their support network for more assistance, as Fabric Scene Delegate is an omniverse specific system.