You can fix this by adding the following line to your project’s .Build.cs file:
bEnableExceptions = true;
One of the third-party libraries used by Cesium for Unreal unfortunately makes the questionable choice to #include <windows.h> when exceptions are disabled. windows.h is notorious for defining a bunch of macros for common names, like min and max, and that leads to compiler errors in Unreal Engine header files. The easiest solution is to enable exceptions in your project.