We haven’t tried it, but based on experience with the Chaos-default 4.26 previews and with the 5.0 preview, it should work. You’ll definitely need to recompile the Cesium for Unreal plugin, though. I’d suggest following the developer setup guide to include it in your project rather than installing it in the Engine plugins directory via the marketplace.
You will have trouble with physics when using Chaos, though. In the Editor, physics meshes will be generated at runtime in the game thread, making things very slow. In shipping builds, you will have no physics at all.