Author : : Xuelian Cheng, Yiran Zhong, Mehrtash Harandi, Tom Drummond, Zhiyong Wang, Zongyuan Ge
Abstract : The self-attention mechanism, successfully employed with the transformer structure is shown promise in many computer vision tasks including image recognition, and object detection. Despite the surge, the use of the transformer for the problem of stereo matching remains relatively unexplored. In this paper, we comprehensively investigate the use of the transformer for the problem of stereo matching, especially for laparoscopic videos, and propose a new hybrid deep stereo matching framework (HybridStereoNet) that combines the best of the CNN and the transformer in a unified design. To be specific, we investigate several ways to introduce transformers to volumetric stereo matching pipelines by analyzing the loss landscape of the designs and in-domain/cross-domain accuracy. Our analysis suggests that employing transformers for feature representation learning, while using CNNs for cost aggregation will lead to faster convergence, higher accuracy and better generalization than other options. Our extensive experiments on Sceneflow, SCARED2019 and dVPN datasets demonstrate the superior performance of our HybridStereoNet.
2. EASNet: Searching Elastic and Accurate Network Architecture for Stereo Matching(arXiv)
Author : Qiang Wang, Shaohuai Shi, Kaiyong Zhao, Xiaowen Chu
Abstract : Recent advanced studies have spent considerable human efforts on optimizing network architectures for stereo matching but hardly achieved both high accuracy and fast inference speed. To ease the workload in network design, neural architecture search (NAS) has been applied with great success to various sparse prediction tasks, such as image classification and object detection. However, existing NAS studies on the dense prediction task, especially stereo matching, still cannot be efficiently and effectively deployed on devices of different computing capabilities. To this end, we propose to train an elastic and accurate network for stereo matching (EASNet) that supports various 3D architectural settings on devices with different computing capabilities. Given the deployment latency constraint on the target device, we can quickly extract a sub-network from the full EASNet without additional training while the accuracy of the sub-network can still be maintained. Extensive experiments show that our EASNet outperforms both state-of-the-art human-designed and NAS-based architectures on Scene Flow and MPI Sintel datasets in terms of model accuracy and inference speed. Particularly, deployed on an inference GPU, EASNet achieves a new SOTA 0.73 EPE on the Scene Flow dataset with 100 ms, which is 4.5 faster than LEAStereo with a better quality model
View original post here:
Use cases of Stereo Matching part9(Machine Learning + AI) - Medium
- Predictive Analytics And Machine Learning Market: A ... - Fagen wasanni - August 4th, 2023 [August 4th, 2023]
- Photonic Neural Networks: Revolutionizing Machine Learning and AI - Fagen wasanni - August 4th, 2023 [August 4th, 2023]
- Growing Concerns Over Bias in Powerful AI and Machine Learning ... - Fagen wasanni - August 4th, 2023 [August 4th, 2023]
- Machine learning prediction and classification of behavioral ... - Nature.com - August 4th, 2023 [August 4th, 2023]
- Predicting BRAFV600E mutations in papillary thyroid carcinoma ... - Nature.com - August 4th, 2023 [August 4th, 2023]
- Johns Hopkins makes major investment in the power, promise of ... - The Hub at Johns Hopkins - August 4th, 2023 [August 4th, 2023]
- Postdoctoral Fellowship: Pathogenesis of High Consequence ... - Global Biodefense - August 4th, 2023 [August 4th, 2023]
- Apple's Commitment to Generative AI and Machine Learning - Fagen wasanni - August 4th, 2023 [August 4th, 2023]
- Richmond could become AI and machine learning tech hub - The Daily Progress - August 4th, 2023 [August 4th, 2023]
- Platform Reduces Barriers Biologists Face In Accessing Machine ... - Bio-IT World - August 4th, 2023 [August 4th, 2023]
- A comparative study of predicting the availability of power line ... - Nature.com - August 4th, 2023 [August 4th, 2023]
- Preventing Bias In Machine Learning - Texas A&M Today - Texas A&M University Today - August 4th, 2023 [August 4th, 2023]
- 3 Cheap Machine Learning Stocks That Smart Investors Will Snap ... - InvestorPlace - August 4th, 2023 [August 4th, 2023]
- Research Analyst/ Associate/ Fellow in Machine Learning and ... - Times Higher Education - August 6th, 2023 [August 6th, 2023]
- AI and Machine Learning: The New Frontier in Global Anti-Money ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- Harnessing the Power of AI and Machine Learning: Growth ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- Harnessing the Power of AI and Machine Learning for Enhanced ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- Use cases of Stereo Matching part8(Machine Learning + AI) - Medium - August 6th, 2023 [August 6th, 2023]
- Use cases of Stereo Matching part7(Machine Learning + AI) - Medium - August 6th, 2023 [August 6th, 2023]
- How machine learning can expand the Landscape of Edge AI. | TDK - TDK Corporation - August 6th, 2023 [August 6th, 2023]
- Machine Learning-Trained Autonomy Tested By XQ-58 For Skyborg - Aviation Week - August 6th, 2023 [August 6th, 2023]
- Artificial Intelligence and Machine Learning in Packaging Robotics ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- 86-year old Hammett equation gets a machine learning update - Chemistry World - August 6th, 2023 [August 6th, 2023]
- Q & A: How A.I. and machine learning are transforming the lending ... - Digital Journal - August 6th, 2023 [August 6th, 2023]
- The Rise of AI and Machine Learning in Global E-Commerce ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- Machine learning-based technique for gain and resonance ... - Nature.com - August 6th, 2023 [August 6th, 2023]
- Machine learning for the development of diagnostic models of ... - Nature.com - August 6th, 2023 [August 6th, 2023]
- AI and the Heart: How Machine Learning is Changing the Face of ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- The Hidden Impact of AI in Photography and How Machine Learning ... - Cryptopolitan - August 6th, 2023 [August 6th, 2023]
- Machine learning identifies physical signs of stroke - Open Access Government - August 6th, 2023 [August 6th, 2023]
- Machine-learning for the prediction of one-year seizure recurrence ... - Nature.com - August 6th, 2023 [August 6th, 2023]
- Automated Machine Learning: Revolutionizing Predictive Analytics ... - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- Tim Cook says AI, machine learning are part of virtually every product Apple is building - CryptoSlate - August 6th, 2023 [August 6th, 2023]
- AI GNNs: Transforming the Landscape of Machine Learning - Fagen wasanni - August 6th, 2023 [August 6th, 2023]
- 3 Cheap Machine Learning Stocks That Smart Investors Will Snap Up Now - InvestorPlace - August 6th, 2023 [August 6th, 2023]