How to efficiently extract 3D coordinates for all pixels?

I think you may need to do some digging in the source code to get the depth buffer. There’s some discussion on this here: Postprocessing with normal and depth information and a more recent post here: How to Get DepthTexture of Current Scene?.

If you do figure out a straightforward way to extract it, it’d be great to post your solution here, or contribute a helper function of some kind to the library for this use case!