It's now possible to have a scanner configuration without any prefilters. No threshold logic is applied, only the configured fields are used to search.
On the other hand is it now possible to have a scanner with only a prefilter.

New field BLOCK_SIZE which specifies the bulk size of data which gets loaded. This is used in the case of a cache rebuild, the data to scan for duplicates gets loaded in the thru BLOCK_SIZE specified size.

Feld DB_FIELD_NAME removed
Created fields for defaultvalues city,zip,... to use in duplicatesearchconfig
Custom fields added in subProcess to have them added to the index

(cherry picked from commit 42dd4194)

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit caac232e)

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit c708b72d)

The Cache rebuilding has been changed. The values to check for duplicates are now loaded using the entities api instead of pure sql. If the cache for all duplicates of a scanner gets rebuilt, it's now done in blocks. This ensures that even while wokring on huge recordsets, the ressources are enough. It sure may take some time to check huge recordsets...
The flag "Use external Webservice" has been removed from the view because no native api to a duplicate scanning service exists, therefore this is unnecessary right now. The config of the resultfields has been removed aswell, if no external service is used, it's enough to work with the id which is always in the index's response.
The configuration of the indexfields has been changed, no manual connection between entity and db field is necessary because no sql is used any more. Instead, the fields can be selected via dropdown which offers the entity fields to select.
Some refactoring
Changes on the docks to reflect the changed datastructure of some arrays

The possibility to configure an external duplicate has been removed from the views because no default external service integration exists. Reactivate later maybe..

Removed unnecessary log outputs
Wrong behaviour removed. If a valid prefilter exists but the filterpatternfields contain no value, the indexsearch got triggered nonetheless. The results which have been found on the base of the prefilter had been defined as duplicates which was wrong.
Code examples have been added to the important functions like ScanForDuplicates or RebuildDuplicatesCache

The editview has been integrated in the general duplicatescanner editview.

-> each consumer to ObjectTree can define several object types/ids which should be displayed

The Indexfieldconfig now contains the correct fields which are necessary to run the search.
The fields now can be configured via the client. Those infos are now used to dynamically load the configured fields an their values which are then internally used to run the prefilter as well as the real duplicate search.
NEXT UP => Configuring of the result fields. There's light at the end of the tunnel.