Get a list of everyone who has sent you an email, and the count of emails they've sent you. Remove their emails by sender, not email by email.