Timeline for How are large sites handling duplicate contact scanning?
Current License: CC BY-SA 4.0
7 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Feb 3, 2023 at 20:26 | comment | added | TwoMice | Yes petednz very interested. Sounds like some potential for a generalizable solution (insert caveat here etc.) | |
Feb 3, 2023 at 20:08 | answer | added | Andy Burns | timeline score: 2 | |
Feb 3, 2023 at 19:20 | comment | added | petednz - fuzion♦ | we did some work so that a Sch Job runs once a day, builds a Group based on all the matching rules (3 of them) which we wanted to use for a Dedupe, and added a feature so that you can specify a Group to dedupe from (as well as against) so it becomes much more specific, runs more quickly. I can ask Jitendra to explain share more if interested | |
Feb 3, 2023 at 13:52 | comment | added | TwoMice | Petednz, non-technical site admins will answer with "The problem is that the browser times out, and meanwhile my site is frozen." My impression is that in most cases it's an N-squared problem caused by searching on a large group (or full db) against the full db. More complex dedupe rules make it worse, but even simple rules will hit this problem at larger values of N. | |
Feb 3, 2023 at 8:56 | answer | added | Fabian | timeline score: 3 | |
Feb 2, 2023 at 18:26 | comment | added | petednz - fuzion♦ | Is the issue that running it is too slow, or gives too many results? | |
Feb 2, 2023 at 15:35 | history | asked | TwoMice | CC BY-SA 4.0 |