FastDup Software, (C) copyright 2022 Dr. Amir Alush and Dr. Danny Bickson.
2023-07-24 15:37:16 [INFO] Going to loop over dir frames
2023-07-24 15:37:16 [INFO] Found total 4791 images to run on, 4791 train, 0 test, name list 4791, counter 4791
FastDup Software, (C) copyright 2022 Dr. Amir Alush and Dr. Danny Bickson.utes
2023-07-24 15:46:41 [INFO] Going to loop over dir /tmp/crops_input.csv
2023-07-24 15:46:41 [INFO] Found total 4908 images to run on, 4908 train, 0 test, name list 4908, counter 4908
2023-07-24 15:46:54 [INFO] Found total 4908 images to run ontimated: 0 Minutes
Finished histogram 1.056
Finished bucket sort 1.071
2023-07-24 15:46:54 [INFO] 74) Finished write_index() NN model
2023-07-24 15:46:54 [INFO] Stored nn model index file work_dir/nnf.index
2023-07-24 15:46:54 [INFO] Total time took 13135 ms
2023-07-24 15:46:54 [INFO] Found a total of 154 fully identical images (d>0.990), which are 1.57 %
2023-07-24 15:46:54 [INFO] Found a total of 553 nearly identical images(d>0.980), which are 5.63 %
2023-07-24 15:46:54 [INFO] Found a total of 7904 above threshold images (d>0.900), which are 80.52 %
2023-07-24 15:46:54 [INFO] Found a total of 492 outlier images (d<0.050), which are 5.01 %
2023-07-24 15:46:54 [INFO] Min distance found 0.581 max distance 1.000
2023-07-24 15:46:54 [INFO] Running connected components for ccthreshold 0.960000
.0
########################################################################################
Dataset Analysis Summary:
Dataset contains 4908 images
Valid images are 100.00% (4,908) of the data, invalid are 0.00% (0) of the data
Similarity: 19.01% (933) belong to 28 similarity clusters (components).
80.99% (3,975) images do not belong to any similarity cluster.
Largest cluster has 128 (2.61%) images.
For a detailed analysis, use `.connected_components()`
(similarity threshold used is 0.9, connected component threshold used is 0.96).
Outliers: 6.58% (323) of images are possible outliers, and fall in the bottom 5.00% of similarity values.
For a detailed list of outliers, use `.outliers()`.