123 words
1 minute
Extracting Displacement Maps through Differentiable Rendering and Dynamic Tessellation

Abstract#

We introduce a Differentiable Rendering pipeline to leverage hardware tessellation when extracting displacement maps with respect to image-space gradients. This method allows us to use differentiable rendering to reconstruct displacement maps without the need for expensive remeshing steps. Instead, we define a dynamic tessellation level by analyzing the displacement texture throughout the optimization process. As such, our technique automatically understands where more subdivision is required, increasing efficiency by not tessellating low-curvature regions. We exemplify the use of our method to reconstruct mesh detail from sparse rendered views. Our results show that the use of tessellation allows us to save memory by requiring only a few vertices to be stored, and the ability to dynamically control density areas helps speeding up the optimization process.

Paper#