Deep learning model to classify hail damage claims
Automobile insurance companies are seeing huge increase in claims from hail-storm damages for more than 10 years now. As the hail damage claims rise, the National Insurance Crime Bureau warns of fraud. So there is an urgent need from insurance companies to deploy a solution which can detect fraud and optimize insurance claims during the hail-storm season.
To meet the above requirement, develop and deploy an advanced NN model to classify dents caused by hail-storm along with body panel for different automobile makes and models. Some of the challenges are given below :
- Detect dents accurately while reducing false positives like an actual gap between the doors or curves of panel design
- Detect small hailstorm dents which could be only a few pixels in the image, while noise should not be classified as false positives
- Data was obtained from previously available hailstorm dent images and a custom labeling tool was used to increase speed of labeling using many automation techniques with manual correction facilities
Data Capture Method
- A drive-in tunnel with Cameras placed to front, back, sides and top view separately was
- Custom lighting conditions reduced ambient lighting problems
NN Model Selection Considerations
- Data pre-processing was kept to minimum so that the features of dent was kept as natural as possible and enhanced where possible
- De-noising - Noise is generally considered to be a random variable with zero mean. Consider a noisy pixel, p= p0+n where p0 is the true value of pixel and n is the noise in that pixel. You can take a large number of the same pixels (say N) from different images and compute their average. Ideally, you should get p=p0 since mean of noise is zero. This property was used to remove the noise from the image.
- Intensity Correction - Intensity of the image had to be corrected based on the lightning conditions. This was done using Point operators (pixel transforms) and Neighborhood (area-based) operators
- Random Crop - Random cropping prevents a CNN from over fitting to specific features by changing the apparent features in an image. Random crop helps to increase the variety of training dent images and it helps the system to learn more variety dent features
- Horizontal flipping - Horizontal flipping doubles the variation in an image with specific orientations. It helps in detecting dents in both orientations.
- Rotation (Random or Fixed) - Rotation helps us to get the view of the object from different dimensions using rotation matrix. Some car images in real world will differ in orientation due to the parking faults or camera calibration issues. This problem reduces as we apply random rotation in the training set.
- Random Scaling - Random scaling produces the object images across all scales and this augmentation helps us to detect the dents across various scales.
- Perspective projection - Perspective projection helps us to retrieve bird eye view of the image. This will help us to get a more accurate view from the top of the dents.
- Shearing - Shearing, is another bounding box transformation, done with the help of the transformation matrix. Some Dents may not be properly visible due to the position of the car or camera. This will produce lot of negatives and this can be solved using shearing
Machine Learning Workflow
Model – Architecture (3a)
Evaluation & Fine Tuning of Model
- Trained with 150,000 dent images
- Tested with 30,000
- Accuracy of model – 95.04%