Augmented Reality Damage Detection App
A prominent automotive brand was introduced to us by our contacts at Google, with the task of exploring how artificial intelligence could be utilized to assess vehicle damage. Our objective was to create an augmented reality mobile application capable of scanning vehicle damage and providing repair or replacement cost estimates. Furthermore, our client asked for a 3D design of a portable controlled environment that could employ advanced technologies for more accurate damage assessment. The project presented numerous challenges, the most significant being the need to identify damage on vehicles of varied shapes and sizes. Although our client possessed a substantial amount of data (photos of damaged vehicles), there was minimal standardization, and the images were predominantly low resolution. We developed a hybrid React Native mobile app that first scans the VIN to identify the vehicle’s make, model, and year. The user is then prompted to scan the vehicle's exterior to identify any visible damage. If damage is found, our machine learning model assesses both its severity and specific location on the vehicle. Based on the make, model, year, severity of the damage, and its location, the app determines whether the dent, scratch, or scuff can be repaired or requires replacement. Finally, we provide a score for the vehicle along with an estimated cost for the repairs.