Forward and Inverse Modeling of Depth-of-Field Effects in Background-Oriented Schlieren
Abstract
This paper reports a novel cone-ray model of background-oriented schlieren (BOS) imaging that accounts for depth-of-field effects. Reconstructions of the density field performed with this model are far more robust to the blur associated with a finite aperture than conventional reconstructions, which presume a thin-ray pinhole camera. Our model is characterized and validated using forward evaluations of simulated buoyancy-driven flow and both simulated and experimental BOS measurements of hypersonic flow over a sphere. Moreover, the model is embedded in a neural reconstruction algorithm, which is demonstrated with a total variation penalty and the compressible Euler equations. Our cone-ray technique dramatically improves the accuracy of BOS reconstructions: the shock interface is well-resolved in all our tests, irrespective of the camera’s aperture setting, which spans f-numbers from 22 down to 4.
References
[1] , Schlieren and Shadowgraph Techniques: Visualizing Phenomena in Transparent Media, Springer, Heidelberg, 2001, Chap. 10. https://doi.org/10.1007/978-3-642-56640-0
[2] , “A Review of Recent Developments in Schlieren and Shadowgraph Techniques,” Measurement Science and Technology, Vol. 28, No. 4, 2017, Paper 042001. https://doi.org/10.1088/1361-6501/aa5748
[3] , “Rainbow Schlieren and Its Applications,” Applied Optics, Vol. 23, No. 14, 1984, pp. 2449–2460. https://doi.org/10.1364/AO.23.002449
[4] , “Quantitative Rainbow Schlieren Deflectometry,” Applied Optics, Vol. 34, No. 19, 1995, pp. 3810–3825. https://doi.org/10.1364/AO.34.003810
[5] , “Background-Oriented Schlieren (BOS) Techniques,” Experiments in Fluids, Vol. 56, No. 3, 2015, pp. 1–17. https://doi.org/10.1007/s00348-015-1927-5
[6] , “Assessment and Application of Quantitative Schlieren Methods: Calibrated Color Schlieren and Background Oriented Schlieren,” Experiments in Fluids, Vol. 36, No. 2, 2004, pp. 309–325. https://doi.org/10.1007/s00348-003-0724-8
[7] , “A Comparison of Three Quantitative Schlieren Techniques,” Optics and Lasers in Engineering, Vol. 50, No. 1, 2012, pp. 8–17. https://doi.org/10.1016/j.optlaseng.2011.05.012
[8] , “A Comparative Study on the Use of Calibrated and Rainbow Schlieren Techniques in Axisymmetric Supersonic Jets,” Flow Measurement and Instrumentation, Vol. 66, April 2019, pp. 218–228. https://doi.org/10.1016/j.flowmeasinst.2019.01.007
[9] , “Density Measurements Using Near-Field Background-Oriented Schlieren,” Experiments in Fluids, Vol. 55, April 2014, pp. 1–11. https://doi.org/10.1007/s00348-014-1720-x
[10] , “3D Reconstruction of a Compressible Flow by Synchronized Multi-Camera BOS,” Experiments in Fluids, Vol. 58, No. 5, 2017, pp. 1–15. https://doi.org/10.1007/s00348-017-2325-y
[11] , “Experimental Study of a Co-Flowing Jet in ONERA’s F2 Research Wind Tunnel by 3D Background Oriented Schlieren,” Measurement Science and Technology, Vol. 28, No. 8, 2017, Paper 085302. https://doi.org/10.1088/1361-6501/aa7827
[12] , “Comparison of Three-Dimensional Density Distribution of Numerical and Experimental Analysis for Twin Jets,” Journal of Visualization, Vol. 24, Dec. 2021, pp. 1173–1188. https://doi.org/10.1007/s12650-021-00765-z
[13] , “Density Measurements Using the Background Oriented Schlieren Technique,” Experiments in Fluids, Vol. 37, No. 2, 2004, pp. 237–247. https://doi.org/10.1007/s00348-004-0807-1
[14] , “Computed-Tomographic Density Measurement of Supersonic Flow Field by Colored-Grid Background Oriented Schlieren (CGBOS) Technique,” Measurement Science and Technology, Vol. 22, No. 10, 2011, Paper 104011. https://doi.org/10.1088/0957-0233/22/10/104011
[15] , “Reconstruction of the Density Field Using the Colored Background Oriented Schlieren Technique (CBOS),” Optics and Lasers in Engineering, Vol. 50, No. 1, 2012, pp. 29–38. https://doi.org/10.1016/j.optlaseng.2011.07.012
[16] , “Hypersonic Shock-Wave/Boundary-Layer Interactions on the ROTEX-T Cone/Flare,” AIAA SciTech 2023 Forum, AIAA Paper 2023-1436, 2023. https://doi.org/10.2514/6.2023-1436
[17] , “Investigation of a High Speed Inlet/Isolator with Global Surface Measurements and Background Oriented Schlieren,” AIAA SciTech 2023 Forum, AIAA Paper 2023-0119, 2023. https://doi.org/10.2514/6.2023-0119
[18] , “Optical Investigation of Profile Losses in a Linear Turbine Cascade,” Proceedings of ASME Turbo Expo 2010, Vol. 44021, ASME Paper GT2010-23166, 2010. https://doi.org/10.1115/GT2010-23166
[19] , “Recent Developments in Background Oriented Schlieren Methods for Rotor Blade Tip Vortex Measurements,” Experiments in Fluids, Vol. 43, Aug. 2007, pp. 233–240. https://doi.org/10.1007/s00348-007-0328-9
[20] , “Blade-Tip Vortex Detection in Maneuvering Flight Using the Background-Oriented Schlieren Technique,” Journal of Aircraft, Vol. 51, No. 6, 2014, pp. 2005–2014. https://doi.org/10.2514/1.C032672
[21] , “Background-Oriented Schlieren Imaging for Full-Scale and In-Flight Testing,” Journal of the American Helicopter Society, Vol. 59, No. 1, 2014, pp. 1–9. https://doi.org/10.4050/JAHS.59.012002
[22] , “Instantaneous 3D Flame Imaging by Background-Oriented Schlieren Tomography,” Combustion and Flame, Vol. 196, Oct. 2018, pp. 284–299. https://doi.org/10.1016/j.combustflame.2018.06.022
[23] , “Time-Resolved Three-Dimensional Imaging of Flame Refractive Index via Endoscopic Background-Oriented Schlieren Tomography Using One Single Camera,” Aerospace Science and Technology, Vol. 97, Feb. 2020, Paper 105621. https://doi.org/10.1016/j.ast.2019.105621
[24] , “High-Speed Photography and Background Oriented Schlieren Techniques for Characterizing Tulip Flame,” Combustion and Flame, Vol. 245, Nov. 2022, Paper 112304. https://doi.org/10.1016/j.combustflame.2022.112304
[25] , “Measurement of Spray Characteristics Using the Background-Oriented Schlieren Technique,” Measurement Science and Technology, Vol. 24, No. 2, 2012, Paper 025303. https://doi.org/10.1088/0957-0233/24/2/025303
[26] , “Boundary Layer and Near Wake Measurements of a Two-Dimensional Airfoil with Background-Oriented Schlieren Method,” Experiments in Fluids, Vol. 64, No. 1, 2023, p. 7. https://doi.org/10.1007/s00348-022-03550-2
[27] , “Background-Oriented Schlieren with Natural Background for Quantitative Visualization of Open-Air Explosions,” Shock Waves, Vol. 24, No. 1, 2014, pp. 69–78. https://doi.org/10.1007/s00193-013-0465-4
[28] , “Three-Dimensional Shock Wave Reconstruction Using Multiple High-Speed Digital Cameras and Background-Oriented Schlieren Imaging,” Experiments in Fluids, Vol. 60, No. 6, 2019, p. 93. https://doi.org/10.1007/s00348-019-2738-x
[29] , “Megahertz-Rate Background-Oriented Schlieren Tomography in Post-Detonation Blasts,” Applied Optics, Vol. 61, No. 10, 2022, pp. 2444–2458. https://doi.org/10.1364/AO.449654
[30] , “High Magnification Telecentric Background Oriented Schlieren (BOS) and Its Application to a Supersonic Turbulent Boundary Layer,” AIAA SciTech 2023 Forum, AIAA Paper 2023-2437, 2023. https://doi.org/10.2514/6.2023-2437
[31] , Statistical and Computational Inverse Problems, Springer–Verlag GmbH, Berlin, Germany, 2006, Chap. 1. https://doi.org/10.1007/b138659
[32] , “Fast and Robust Volumetric Refractive Index Measurement by Unified Background-Oriented Schlieren Tomography,” Experiments in Fluids, Vol. 61, No. 3, 2020, pp. 1–17. https://doi.org/10.1007/s00348-020-2912-1
[33] , “X-Ray Computed Tomography,” Nature Reviews Methods Primers, Vol. 1, No. 1, 2021, p. 18. https://doi.org/10.1038/s43586-021-00015-4
[34] , “3D Forward and Back-Projection for X-Ray CT Using Separable Footprints,” IEEE Transactions on Medical Imaging, Vol. 29, No. 11, 2010, pp. 1839–1850. https://doi.org/10.1109/TMI.2010.2050898
[35] , “Non-Uniform Optical Transfer Functions in Particle Imaging: Calibration and Application to Tomographic Reconstruction,” Measurement Science and Technology, Vol. 24, No. 2, 2012, Paper 024009. https://doi.org/10.1088/0957-0233/24/2/024009
[36] , “Volumetric Reconstruction of LIF and PIV Light Fields Under Variable Index of Refraction Media,” International Symposium on Particle Image Velocimetry 2023, San Diego State Univ., Paper WP988S09X, 2023.
[37] , “Effect of Light-Collection Geometry on Reconstruction Errors in Abel Inversions,” Optics Letters, Vol. 25, No. 7, 2000, pp. 457–459. https://doi.org/10.1364/OL.25.000457
[38] , “Computed Tomography of Chemiluminescence: A 3D Time Resolved Sensor for Turbulent Combustion,” Ph.D. Thesis, Imperial College London, London, 2009. https://doi.org/10.25560/5477
[39] , “On the Quantification of Spatial Resolution for Three-Dimensional Computed Tomography of Chemiluminescence,” Optics Express, Vol. 25, No. 20, 2017, pp. 24,093–24,108. https://doi.org/10.1364/OE.25.024093
[40] , “Flame Emission Tomography Based on Finite Element Basis and Adjustable Mask,” Optics Express, Vol. 29, No. 25, 2021, pp. 40,841–40,853. https://doi.org/10.1364/OE.443643
[41] , “PIV/BOS Synthetic Image Generation in Variable Density Environments for Error Analysis and Experiment Design,” Measurement Science and Technology, Vol. 30, No. 8, 2019, Paper 085302. https://doi.org/10.1088/1361-6501/ab1ca8
[42] , “Application of Particle Image Velocimetry and the Background-Oriented Schlieren Technique in the High-Enthalpy Shock Tunnel Göttingen,” Shock Waves, Vol. 21, No. 3, 2011, pp. 233–241. https://doi.org/10.1007/s00193-011-0314-2
[43] , “Assessment of Three-Dimensional Density Measurements from Tomographic Background-Oriented Schlieren (BOS),” Measurement Science and Technology, Vol. 31, No. 11, 2020, Paper 114002. https://doi.org/10.1088/1361-6501/ab955a
[44] , “Three-Dimensional Density Measurements of a Heated Jet Using Laser-Speckle Tomographic Background-Oriented Schlieren,” Experimental Thermal and Fluid Science, Vol. 142, April 2023, Paper 110819. https://doi.org/10.1016/j.expthermflusci.2022.110819
[45] , “The Supersonic Blunt-Body Problem—Review and Extension,” Journal of the Aerospace Sciences, Vol. 25, No. 8, 1958, pp. 485–496. https://doi.org/10.2514/8.7744
[46] , “Supersonic Flow Past a Family of Blunt Axisymmetric Bodies,” NASA TR-R-1, 1959.
[47] , “The Background Oriented Schlieren Technique: Sensitivity, Accuracy, Resolution and Application to a Three-Dimensional Density Field,” Experiments in Fluids, Vol. 43, Aug. 2007, pp. 241–249. https://doi.org/10.1007/s00348-007-0331-1
[48] , “A Direct Approach for Instantaneous 3D Density Field Reconstruction from Background-Oriented Schlieren (BOS) Measurements,” Experiments in Fluids, Vol. 57, No. 1, 2016, pp. 1–21. https://doi.org/10.1007/s00348-015-2100-x
[49] , “Estimating Density, Velocity, and Pressure Fields in Supersonic Flows Using Physics-Informed BOS,” Experiments in Fluids, Vol. 64, No. 1, 2023, p. 14. https://doi.org/10.1088/1361-6501/ac5437
[50] , “An Evaluation of Optical Flow Algorithms for Background Oriented Schlieren Imaging,” Experiments in Fluids, Vol. 46, No. 3, 2009, pp. 467–476. https://doi.org/10.1007/s00348-008-0572-7
[51] , “Wavelet-Based Optical Flow Analysis for Background-Oriented Schlieren Image Processing,” AIAA Journal, Vol. 59, No. 8, 2021, pp. 3209–3216. https://doi.org/10.2514/1.J060218
[52] , “Recent Progress in Digital Image Correlation,” Experimental Mechanics, Vol. 51, Sept. 2011, pp. 1223–1235. https://doi.org/10.1007/s11340-010-9418-3
[53] , “Dot Tracking Methodology for Background-Oriented Schlieren (BOS),” Experiments in Fluids, Vol. 60, Nov. 2019, pp. 1–13. https://doi.org/10.1007/s00348-019-2793-3
[54] , “Assessment and Application of Optical Flow in Background-Oriented Schlieren for Compressible Flows,” Experiments in Fluids, Vol. 64, No. 1, 2023, p. 11. https://doi.org/10.1007/s00348-022-03553-z
[55] , Machine Vision: Theory, Algorithms, Practicalities, Morgan Kaufmann, Burlington, MA, 2004, Chap. 18. https://doi.org/10.1016/C2010-0-66926-4
[56] , “Determining Optical Flow,” Artificial Intelligence, Vol. 17, Nos. 1–3, 1981, pp. 185–203. https://doi.org/10.1016/0004-3702(81)90024-2
[57] , “An Iterative Image Registration Technique with an Application to Stereo Vision,” Proceedings DARPA Image Understanding Workshop, Morgan Kaufmann Publishers Inc., San Francisco, CA, 1981, pp. 121–130.
[58] , “Fast and Accurate PIV Computation Using Highly Parallel Iterative Correlation Maximization,” Experiments in Fluids, Vol. 50, No. 4, 2011, pp. 1169–1182. https://doi.org/10.1007/s00348-011-1054-x
[59] , “Massively Parallel Lucas Kanade Optical Flow for Real-Time Video Processing Applications,” Journal of Real-Time Image Processing, Vol. 11, April 2016, pp. 713–730. https://doi.org/10.1007/s11554-014-0423-0
[60] , “Refractivity of Combustion Gases,” Combustion and Flame, Vol. 40, Jan. 1981, pp. 213–219. https://doi.org/10.1016/0010-2180(81)90124-3
[61] , “Ray Tracing in Non-Constant Media,” Eurographics Workshop on Rendering Techniques, Springer, Berlin, 1996, pp. 225–234. https://doi.org/10.1007/978-3-7091-7484-5_23
[62] , “Acquisition of Transparent Refractive Media,” Ph.D. Thesis, Univ. of British Columbia, Vancouver, 2012. https://doi.org/10.14288/1.0052220
[63] , “Volumetric Emission Tomography for Combustion Processes,” Progress in Energy and Combustion Science, Vol. 94, Jan. 2023, Paper 101024. https://doi.org/10.1016/j.pecs.2022.101024
[64] , “Distributed Ray Tracing,” Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, Assoc. for Computing Machinery, New York, 1984, pp. 137–145. https://doi.org/10.1145/964965.808590
[65] , “Chemical Species Tomography of Turbulent Flows: Discrete Ill-Posed and Rank Deficient Problems and the Use of Prior Information,” Journal of Quantitative Spectroscopy and Radiative Transfer, Vol. 172, March 2016, pp. 58–74. https://doi.org/10.1016/j.jqsrt.2015.09.011
[66] , “Analysis of Discrete Ill-Posed Problems by Means of the L-Curve,” SIAM Review, Vol. 34, No. 4, 1992, pp. 561–580. https://doi.org/10.1137/1034115
[67] , “Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks,” SIAM Journal on Scientific Computing, Vol. 43, No. 5, 2021, pp. A3055–A3081. https://doi.org/10.1137/20M1318043
[68] , “When and Why PINNs Fail to Train: A Neural Tangent Kernel Perspective,” Journal of Computational Physics, Vol. 449, Jan. 2022, Paper 110768. https://doi.org/10.1016/j.jcp.2021.110768
[69] , “CoIL: Coordinate-Based Internal Learning for Tomographic Imaging,” IEEE Transactions on Computational Imaging, Vol. 7, Nov. 2021, pp. 1400–1412. https://doi.org/10.1109/TCI.2021.3125564
[70] , “PhySG: Inverse Rendering with Spherical Gaussians for z Material Editing and Relighting,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Inst. of Electrical and Electronics Engineers, New York, 2021, pp. 5453–5462. https://doi.org/10.1109/CVPR46437.2021.00541
[71] , “IntraTomo: Self-Supervised Learning-Based Tomography via Sinogram Synthesis and Prediction,” Proceedings of the IEEE/CVF International Conference on Computer Vision, Inst. of Electrical and Electronics Engineers, New York, 2021, pp. 1960–1970. https://doi.org/10.1109/ICCV48922.2021.00197
[72] , “NeAT: Neural Adaptive Tomography,” ACM Transactions on Graphics, Vol. 41, No. 4, 2022, pp. 1–13. https://doi.org/10.1145/3528223.3530121
[73] , “Voxel-Free Neural Volume Reconstruction Technique for Volumetric Flame Reconstructions,” Aerospace Science and Technology, Vol. 133, Feb. 2023, Paper 108107. https://doi.org/10.1016/j.ast.2023.108107
[74] , “FluidNeRF: A Scalar-Field Reconstruction Technique for Flow Diagnostics Using Neural Radiance Fields,” AIAA SciTech 2023 Forum, AIAA Paper 2023-0412, 2023. https://doi.org/10.2514/6.2023-0412
[75] , “Investigation of a Neural Implicit Representation Tomography Method for Flow Diagnostics,” Measurement Science and Technology, Vol. 35, No. 5, 2024, Paper 056007. https://doi.org/10.1088/1361-6501/ad296a
[76] , “Physics-Informed Background-Oriented Schlieren of Turbulent Underexpanded Jets,” AIAA SciTech 2023 Forum, AIAA Paper 2023-2441, 2023. https://doi.org/10.2514/6.2023-2441
[77] , “Homogeneous Buoyancy Driven Turbulence Data Set,” Los Alamos National Lab. TR LA-UR-14-20669, 2014. https://doi.org/10.7281/T1VX0DPC
[78] , “A Public Turbulence Database Cluster and Applications to Study Lagrangian Evolution of Velocity Increments in Turbulence,” Journal of Turbulence, Vol. 9, Jan. 2008, Paper N31. https://doi.org/10.1080/14685240802376389
[79] , “Flow Characterization of the UTSA Hypersonic Ludwieg Tube,” Aerospace, Vol. 10, No. 5, 2023, p. 463. https://doi.org/10.3390/aerospace10050463
[80] , “Design and Preliminary Calibration of the UTSA Mach 7 Hypersonic Ludwieg Tube,” AIAA Aviation 2019 Forum, AIAA Paper 2019-2859, 2019. https://doi.org/10.2514/6.2019-2859
[81] , “Construction of a Mach 7 Ludwieg Tube at UTSA,” AIAA Aviation 2020 Forum, AIAA Paper 2020-2998, 2020. https://doi.org/10.2514/6.2020-2998
[82] , “Preliminary Testing of the UTSA Mach 7 Ludwieg Tube,” AIAA Aviation 2021 Forum, AIAA Paper 2021-2979, 2021. https://doi.org/10.2514/6.2021-2979
[83] , “Reconstructing Hypersonic Flow over a Bluff Body from Experimental Background-Oriented Schlieren Data,” AIAA SciTech 2024 Forum, AIAA Paper 2024-2493, 2024. https://doi.org/10.2514/6.2024-2493
[84] , “SU2: An Open-Source Suite for Multiphysics Simulation and Design,” AIAA Journal, Vol. 54, No. 3, 2016, pp. 828–846. https://doi.org/10.2514/1.J053813
[85] , “Color Gradient Background-Oriented Schlieren Imaging,” Experiments in Fluids, Vol. 57, June 2016, pp. 1–14. https://doi.org/10.1007/s00348-016-2183-z
[86] , “Physics-Informed Neural Networks with Hard Constraints for Inverse Design,” SIAM Journal on Scientific Computing, Vol. 43, No. 6, 2021, pp. B1105–B1132. https://doi.org/10.1137/21M1397908
[87] , “New Transform to Project Axisymmetric Deflection Fields Along Arbitrary Rays,” Measurement Science and Technology, Vol. 33, No. 3, 2022, Paper 035201. https://doi.org/10.1088/1361-6501/ac3f83
[88] , “Shock Location in Front of a Sphere as a Measure of Real Gas Effects,” Journal of Applied Physics, Vol. 27, No. 2, 1956, pp. 169–174. https://doi.org/10.1063/1.1722329
[89] , “Development of Background-Oriented Schlieren for NASA Langley Research Center Ground Test Facilities,” 53rd AIAA Aerospace Sciences Meeting, AIAA Paper 2015-1691, 2015. https://doi.org/10.2514/6.2015-1691
[90] , “Measurement Sensitivity and Resolution for Background Oriented Schlieren During Image Recording,” Journal of Visualization, Vol. 16, Aug. 2013, pp. 201–207. https://doi.org/10.1007/s12650-013-0170-5
[91] , “Flow Field Tomography with Uncertainty Quantification Using a Bayesian Physics-Informed Neural Network,” Measurement Science and Technology, Vol. 33, No. 6, 2022, Paper 065305. https://doi.org/10.1088/1361-6501/ac5437