If a person is added, a scan for duplicates is triggered automatically. if a matching cluster exists the new record gets added, otherwise a new cluster gets created
The field, which is currently used by the demo duplicatescan (firstname) is now another type because the phonetic matcher creates seemingly wrong searchresults. If the scan for duplicates or the indexsearch results in seemingly unrelated results, set the indexFieldType to TEXT_NO_STOPWORDS.

refactorings

# Conflicts:
#	language/_____LANGUAGE_EXTRA/_____LANGUAGE_EXTRA.aod
#	language/_____LANGUAGE_de/_____LANGUAGE_de.aod
#	language/_____LANGUAGE_en/_____LANGUAGE_en.aod
#	neonView/OfferEdit_view/OfferEdit_view.aod
#	neonView/PrivatePersonPreview_view/PrivatePersonPreview_view.aod
#	neonView/SalesprojectEdit_view/SalesprojectEdit_view.aod

Feld DB_FIELD_NAME removed
Created fields for defaultvalues city,zip,... to use in duplicatesearchconfig
Custom fields added in subProcess to have them added to the index

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit 3e5544d3)

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit f79a987f)

QuickEntry fix

See merge request xrm/basic!67

(cherry picked from commit 42dd4194)

QuickEntry

See merge request xrm/basic!66

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit caac232e)

Quick entry

See merge request xrm/basic!65

S.Listl authored 5 years ago and Sebastian Listl committed 5 years ago

(cherry picked from commit c708b72d)

fix classification admin

See merge request xrm/basic!64

Johannes Hörmann authored 5 years ago and Johannes Hörmann committed 5 years ago

(cherry picked from commit 35a435d0)

# Conflicts:
#	.liquibase/Data_alias/basic/2019.2.1/changelog.xml
#	aliasDefinition/Data_alias/Data_alias.aod
#	entity/BulkMail_entity/BulkMail_entity.aod
#	entity/CampaignAddParticipants_entity/CampaignAddParticipants_entity.aod
#	entity/CampaignStep_entity/CampaignStep_entity.aod
#	entity/DuplicateScanConditionConfig_entity/DuplicateScanConditionConfig_entity.aod
#	entity/DuplicateScan_entity/DuplicateScan_entity.aod
#	entity/DuplicateScan_entity/entityfields/external_service_usage_allowed/valueProcess.js
#	entity/Organisation_entity/Organisation_entity.aod
#	entity/Organisation_entity/recordcontainers/db/conditionProcess.js
#	entity/Person_entity/Person_entity.aod
#	entity/Person_entity/recordcontainers/db/conditionProcess.js
#	entity/SerialLetter_entity/SerialLetter_entity.aod
#	language/_____LANGUAGE_de/_____LANGUAGE_de.aod
#	neonView/ActivityFilter_view/ActivityFilter_view.aod
#	neonView/AttributeEdit_view/AttributeEdit_view.aod
#	neonView/AttributeTree_view/AttributeTree_view.aod
#	neonView/BulkMailPreview_view/BulkMailPreview_view.aod
#	neonView/CampaignCostChart_view/CampaignCostChart_view.aod
#	neonView/ClassificationAdminEdit_view/ClassificationAdminEdit_view.aod
#	neonView/DocumentTemplateEdit_view/DocumentTemplateEdit_view.aod
#	neonView/DocumentTemplateLinkList_view/DocumentTemplateLinkList_view.aod
#	neonView/EmailEdit_view/EmailEdit_view.aod
#	neonView/EmployeeFilter_view/EmployeeFilter_view.aod
#	neonView/FacebookTimeline_view/FacebookTimeline_view.aod
#	neonView/LetterEdit_view/LetterEdit_view.aod
#	neonView/OfferFilter_view/OfferFilter_view.aod
#	neonView/Options1_View/Options1_View.aod
#	neonView/Options2_View/Options2_View.aod
#	neonView/OrderEdit_view/OrderEdit_view.aod
#	neonView/OrderFilter_view/OrderFilter_view.aod
#	neonView/PermissionDetailPreview_view/PermissionDetailPreview_view.aod
#	neonView/PrivatePersonPreview_view/PrivatePersonPreview_view.aod
#	neonView/SalesprojectMilestoneInfo_view/SalesprojectMilestoneInfo_view.aod
#	neonView/SalesprojectScoreCard_view/SalesprojectScoreCard_view.aod
#	neonView/SalutationFilter_view/SalutationFilter_view.aod
#	neonView/TimetrackingAnalyses_view/TimetrackingAnalyses_view.aod
#	neonView/TurnoverChartForecast_view/TurnoverChartForecast_view.aod
#	neonView/TwitterTimeline_view/TwitterTimeline_view.aod
#	process/DuplicateScanner_lib/process.js

The function ScanForDuplicates has been refactored and is now much more easy to use because it does much more stuff inside to have an easier api.
"RebuildDuplicatesCache" and "ScanForDuplicates" have been refactored.
The fields used in the prefilter don't have to be configured manually by the user. Instead, the fields defined by the prefilter now get added automatically to the list of fields to be used. In the case, that the field has been added via the users config anyways, it doesn't get added by code to ensure that each field is mentioned exactly once.
To reflect these changes, the javadoc including the example of ScanForDuplicates and RebuildDuplicates has been updated.
 Until it's possible to load values from a consumed entity dynamically via code, the possibility to select entity fields from consumed entities via ui has been removed. See ticket #1044577. Now only "native" fields directly from the base entity can be selected.
 Since the entity fields are now used in the configuration of the duplicate search, no db fields have to be configured any more. The field has been removed from liquibase

The Cache rebuilding has been changed. The values to check for duplicates are now loaded using the entities api instead of pure sql. If the cache for all duplicates of a scanner gets rebuilt, it's now done in blocks. This ensures that even while wokring on huge recordsets, the ressources are enough. It sure may take some time to check huge recordsets...
The flag "Use external Webservice" has been removed from the view because no native api to a duplicate scanning service exists, therefore this is unnecessary right now. The config of the resultfields has been removed aswell, if no external service is used, it's enough to work with the id which is always in the index's response.
The configuration of the indexfields has been changed, no manual connection between entity and db field is necessary because no sql is used any more. Instead, the fields can be selected via dropdown which offers the entity fields to select.
Some refactoring
Changes on the docks to reflect the changed datastructure of some arrays

The possibility to configure an external duplicate has been removed from the views because no default external service integration exists. Reactivate later maybe..

Removed unnecessary log outputs
Wrong behaviour removed. If a valid prefilter exists but the filterpatternfields contain no value, the indexsearch got triggered nonetheless. The results which have been found on the base of the prefilter had been defined as duplicates which was wrong.
Code examples have been added to the important functions like ScanForDuplicates or RebuildDuplicatesCache

Refactorings

Documentation
Example code to show the usage of the webservice callback