SOURCE-LINKED INTELLIGENCE

From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation

arXiv · AI, language, vision and robotics · article · Aug 28, 2026 · UTC

Vision foundation models are capable of generalizing across 3-dimensional (3D) scenes with high-fidelity estimates; their empirical success can be attributed to training on large-scale datasets of perspective images. However, when transferred to wide field-of-view (FoV) images, such as those captured by fisheye cameras, they return erroneous outputs due to a covariate shift stemming from the radial distortion on the image pixels. We propose a method to generalize vision foundation models to fisheye cameras. The crux of our method lies in a set of learnable parameters, termed Distortion Extende

Read original source ↗ Open in workspace

recordType

paper

region

Global