This is happening because there’s an initial overhead of loading the web workers used to compute the geometry asynchronously.
You could potentially work around this by using the Primitive API which allows you to create geometry synchronously, at the cost of some camera jitters while geometry is loading.