Image Matching: Local Features & Beyond
CVPR 2022 Workshop
- 13:00-13:15 Welcome session
- 13:15-14:00 SuperPoint and SuperGlue: Lessons Learned (Tomasz Malisiewicz, Meta) ZOOM
- 14:00-14:45 Large-scale 3D reconstruction Deployment - Successes, Challenges, Open Problems (Aleš Hrabalík, Capturing Reality/Epic Games) LIVE
- 14:45-15:00 First coffee break + poster session
WORKSHOP PAPER TALKS
- 15:00-15:10 Unstructured Object Matching using Co-Salient Region Segmentation (Alin-Ionut Popa, Amazon) LIVE
- 15:10-15:20 Nerfels: Renderable Neural Codes for Improved Camera Pose Estimation (Daniel DeTone, Meta) LIVE
- 15:20-15:30 Feature Query Networks: Neural Surface Description for Camera Pose Refinement (Hugo Germain, Ecole des Ponts ParisTech) LIVE (video)
- 15:30-15:40 Learning Co-segmentation by Segment Swapping for Retrieval and Discovery (Xi Shen, École des Ponts ParisTech) ZOOM (video)
- 15:40-15:50 DA-AE: Disparity-Alleviation Auto-Encoder Towards Categorization of Heritage Images for Aggrandized 3D Reconstruction (Dikshit Hegde, KLE Tech. Univ.) ZOOM (video)
- 15:50-16:00 Detecting and Suppressing Marine Snow for Underwater Visual SLAM (Lars Martin Hodne & Eirik Leikvoll, NTNU) LIVE
- 16:00-16:10 A case for using rotation invariant features in state of the art feature matchers (Georg Bökman, Chalmers) LIVE (video)
- 16:10-16:25 Second coffee break + poster session
- 16:25-16:35 Challenge intro
- 16:35-16:45 1st place: Shuai Wu (-), Yuki Kashiwaba (Iterra Solutions Inc), Hongjian Song (South China University of Technology) Canming Wang (-) ZOOM
- 16:45-16:55 3rd place: Jian Xu, Kai Huang, Wen Sun, Gaotong Yu, Zhicheng Wang, Kejian Wu (NReal.ai) ZOOM (video - upload soon)
- 16:55-17:05 5th place: Dongli Tan, Jiangjiang Liu, Xingyu Chen, Qi Zhang, Tong Wu, Ruixin Zhang, Chao Chen, Yunhang Shen, Chunhua Shen, Rongrong Ji (Youtu Lab, Xiamen University, Nankai University) ZOOM (video - upload soon)
- 17:05-17:15 7th place: Hyeokjoon Kwon, Seungho Back (Nearthlab) LIVE
17:15-17:25 2nd place: Hongkai Chen (HKUST) ZOOM Declined
- 17:25-17:XX Discussion & wrap-up
The Fourth Workshop on Image Matching: Local Features and Beyond will be held at CVPR 2022 on June 20, 2022 (afternoon, Central Standard Time, USA). The workshop will once again feature an open challenge which will be announced in the following weeks. Further details will be announced before the conference.
Traditional, keypoint-based formulations for image matching are still
very competitive on tasks such as Structure from Motion (SfM), despite
recent efforts on tackling pose estimation with dense networks. In
practice, many state-of-the-art pipelines still rely on methods that
stood the test of time, such as SIFT or RANSAC.
In this workshop, we aim to encourage novel strategies for image
matching that deviate from and advance traditional formulations, with
a focus on large-scale, wide-baseline matching for 3D reconstruction
or pose estimation. This can be achieved by applying new technologies
to sparse feature matching, or doing away with keypoints and
Topics include (but are not limited to):
- Formulations of keypoint extraction and matching pipelines with deep networks.
- Application of geometric constraints into the training of deep networks.
- Leveraging additional cues such as semantics and mono-depth estimates.
- Methods addressing adversarial conditions where current methods fail (weather changes, day versus night, etc.).
- Attention mechanisms to match salient image regions.
- Integration of differentiable components into 3D reconstruction frameworks.
- Connecting local descriptors/image matching with global descriptors/image retrieval.
- Matching across different data modalities such as aerial versus ground.
- Large-scale evaluation of classical and modern methods for image matching, by means of our open challenge.
- New perception devices such as event-based cameras.
- Other topics related to image matching, structure from motion, mapping, and re-localization, such as privacy-preserving representations.
The last two editions were livestreamed on YouTube and remain available: 2020, 2021.
Czech Technical University
Czech Technical University
University of British Columbia
- Unstructured Object Matching using Co-Salient Region Segmentation, by Ioana-Sabina Stoian (Amazon), Ionut C Sandu (Amazon), Daniel Voinea (Amazon), Alin-Ionut Popa (Amazon).
- Nerfels: Renderable Neural Codes for Improved Camera Pose Estimation, by Gil Avraham (Monash University), Julian Straub (Facebook Reality Labs), Tianwei Shen (Facebook), Tsun-Yi Yang (Facebook), Hugo Germain (Ecole des Ponts ParisTech), Chris Sweeney (Facebook Reality Labs), Vasileios Balntas (Facebook Reality Labs), David Novotny (Facebook AI Research), Daniel DeTone (Facebook), Richard Newcombe (Facebook)
- Feature Query Networks: Neural Surface Description for Camera Pose Refinement, by Hugo Germain (Ecole des Ponts ParisTech)x, Daniel DeTone (Facebook), Geoffrey M Pascoe (Facebook), Tanner Schmidt (Facebook Reality Labs), David Novotny (Facebook AI Research), Richard Newcombe (Facebook), Chris Sweeney (Facebook Reality Labs), Richard Szeliski (The University of Washington), Vasileios Balntas (Facebook Reality Labs)
- Learning Co-segmentation by Segment Swapping for Retrieval and Discovery, by Xi Shen (École des Ponts ParisTech), Alexei A Efros (UC Berkeley), Armand Joulin (Facebook AI Research), Mathieu Aubry (École des ponts ParisTech)
- DA-AE: Disparity-Alleviation Auto-Encoder Towards Categorization of Heritage Images for Aggrandized 3D Reconstruction, by Dikshit Hegde (KLE Technological University), Tejas Anvekar (KLE Technological University), Ramesh Tabib (KLE Technological University), Uma Mudenagudi (KLE Technological University)
- Detecting and Suppressing Marine Snow for Underwater Visual SLAM, by Lars Martin Hodne (Norwegian University of Science and Technology), Eirik Leikvoll (Norwegian University of Science and Technology), Mauhing Yip (Norwegian University of Science and Technology), Andreas L Teigen (Norwegian University of Science and Technology), Annette Stahl (Norwegian University of Science and Technology), Rudolf Mester (Norwegian University of Science and Technology)
- A case for using rotation invariant features in state of the art feature matchers, by Georg Bökman (Chalmers University of Technology), Fredrik Kahl (Chalmers)
- April 25, 2022: Announcing accepted papers.
- April 5, 2022: Moved the paper decisions date to April 15 to give more time to reviewers. Thanks for your participation!
- April 4, 2022: Announcing the 2022 Image Matching Challenge, which has moved to Kaggle! Opening today, and running for two months until June 2.
- February 23, 2022: CVPR has extended the camera-ready deadline for workshop papers, so we have pushing the deadline by a few days, from March 28 to April 4.
- January 17, 2022: The workshop has been renewed! We are sending out our new call for papers. The 2022 edition of the challenge will be announced in a few weeks.
- June 28, 2021: The conference is over! Thanks for your participation, and hope to see you next year. Slides have been uploaded here.
- June 21, 2021: Announcing the IMC challenge winners, and tentative schedule (top of this page). See you this Friday!
- March 11, 2021: Announcing our invited speakers: Professors Marc Pollefeys and Davide Scaramuzza.
- March 3, 2021: Announcing our call for papers. The challenge will be open in about ~1mo.
- January 29, 2021: Updating website to announce the third (2021) edition of the workshop. Details on the workshop, challenge, and call for papers to follow soon.
- Paper submission deadline: April 4, 2022.
- Notification to authors: April 15, 2022.
- Camera-ready deadline: April 19, 2022 (hard deadline on April 20!).
- Challenge submission deadline: TBA (see challenge website)
- Workshop date: June 20, 2022, afternoon (exact schedule TBA)
(All dates are at 11:59PM, Pacific Time.)
Please reach us with any questions at email@example.com.