During duplicate records detection and recognition in large number of data sets

detection precision is low and cost of detecting is high because source of data are complicated and there are too many feature attributes.To solve these problems

an optimal feature selection method based on fuzzy clustering in groups is proposed.It deals with attributes of records in groups so as to reduce dimensions of attributes recorded effectively and obtain representative records in groups.It detects approximately duplicate records in groups by a computing method which compares with similarity.By theory analysis and experiments

it shows that identification precision and detection efficiency of this method are higher and it can solve recognition problem of approximately duplicate records in large number of data sets better.