Inferring surface properties of oscillating fluids from video by inversion of physics models



Svyatoslav Korneev
Raja Bala
Christoforos Somarakis
Adrian Lew
Jonathan (Shengtai) Ju
Technical Publications
January 26th 2022


Measuring the shape, motion and physical properties of oscillating fluids is critical for understanding the physics of fluidic systems, as well as optimizing and controlling such systems in real time. Conventional surface measurement techniques such as profile analysis or stereo reconstruction are not effective for monitoring fluids in industrial process due to the presence of occluding structures, extreme heat, and complex light interactions at the fluid surface. We propose a video-based method comprising forward and inverse transforms. The forward transform employs a physics-based fluid surface model combined with a ray-traced renderer to map shape and motion parameters to synthetic video frames. The inverse transform uses machine learning models to recover surface parameters from video. The inverse models are trained on synthetic data generated by the forward transform. We illustrate the method on an industrial 3D printer for which we recover the motion and surface of a molten aluminum alloy oscillating inside a microscopic nozzle. The inverse transform is ill-posed, but can be regularized. We show that surface properties can be reliably inferred with either a suitably regularized non-parametric k-nearest neighbor regressor or a deep convolutional network whose results are less stable but faster to compute.   View the publication (pdf)


Price, R.; Korneev, S.; Lew, A.; Somarakis, C.; Bala, R. Inferring surface properties of oscillating fluids from video by inversion of physics models . Computational Imaging XX at the Electronic Imaging Symposium.; Online, CA USA. Date of Talk: 01/16/2022 at 2/1/2022 10:57:53 AM.

Additional information

Focus Areas

Our work is centered around a series of Focus Areas that we believe are the future of science and technology.

Licensing & Commercialization Opportunities

We’re continually developing new technologies, many of which are available for¬†Commercialization.


PARC scientists and staffers are active members and contributors to the science and technology communities.