I’m unfamiliar with that type of data would be coming from an ArcGIS server, so I’m not sure if we have direct support for that.
For rendering massive datasets like the buildings in New York City, we’ve been implementing a new open specification called 3D tiles. Using that format would be ideal for your project.