TY - GEN
T1 - PAY ATTENTION TO WHERE YOU LOOKED
AU - Berian, Alex
AU - Wu, Jhih Yang
AU - Brignac, Daniel
AU - Daba, Natnael
AU - Mahalanobis, Abhijit
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Novel view synthesis (NVS) has advanced with generative modeling, enabling photorealistic image generation. In few-shot NVS, where only a few input views are available, existing methods often assume equal importance for all input views relative to the target, leading to suboptimal results. We address this limitation by introducing a camera-weighting mechanism that adjusts the importance of source views based on their relevance to the target. We propose two approaches: a deterministic weighting scheme leveraging geometric properties like Euclidean distance and angular differences, and a cross-attention-based learning scheme that optimizes view weighting. Additionally, models can be further trained with our camera-weighting scheme to refine their understanding of view relevance and enhance synthesis quality. This mechanism is adaptable and can be integrated into various NVS algorithms, improving their ability to synthesize high-quality novel views. Our results demonstrate that adaptive view weighting enhances accuracy and realism, offering a promising direction for improving NVS.
AB - Novel view synthesis (NVS) has advanced with generative modeling, enabling photorealistic image generation. In few-shot NVS, where only a few input views are available, existing methods often assume equal importance for all input views relative to the target, leading to suboptimal results. We address this limitation by introducing a camera-weighting mechanism that adjusts the importance of source views based on their relevance to the target. We propose two approaches: a deterministic weighting scheme leveraging geometric properties like Euclidean distance and angular differences, and a cross-attention-based learning scheme that optimizes view weighting. Additionally, models can be further trained with our camera-weighting scheme to refine their understanding of view relevance and enhance synthesis quality. This mechanism is adaptable and can be integrated into various NVS algorithms, improving their ability to synthesize high-quality novel views. Our results demonstrate that adaptive view weighting enhances accuracy and realism, offering a promising direction for improving NVS.
KW - attention
KW - few-shot
KW - Novel view synthesis
UR - https://www.scopus.com/pages/publications/105035600156
UR - https://www.scopus.com/pages/publications/105035600156#tab=citedBy
U2 - 10.1109/ICIPW68931.2025.11386009
DO - 10.1109/ICIPW68931.2025.11386009
M3 - Conference contribution
AN - SCOPUS:105035600156
T3 - 2025 IEEE International Conference on Image Processing Workshops, ICIPW 2025 - Proceedings
SP - 245
EP - 250
BT - 2025 IEEE International Conference on Image Processing Workshops, ICIPW 2025 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2025 IEEE International Conference on Image Processing Workshops, ICIPW 2025
Y2 - 14 September 2025 through 17 September 2025
ER -