Salesforce Deduplication

Merge duplicate Salesforce records using the SOAP API. The losing records are deleted and their related records (child relationships, activities, attachments) are automatically reparented to the master. Supported types: Account, Contact, Lead, Individual.

Architecture

A deduplication pipeline reads a list of duplicate pairs, iterates over them, and calls the Salesforce SOAP merge API for each pair.

The source task is up to you — read a file from local disk, subscribe to a NATS stream, accept webhook calls, or use any other input task. The examples below use object_store to read a local file of duplicate pairs.

Merge from file

Read a JSON file containing duplicate pairs and merge each one.

The input file contains an array of objects, each with the master and duplicate record IDs:

[
  {"sobject_type": "Account", "master_id": "001000000000001", "duplicate_id": "001000000000002"},
  {"sobject_type": "Account", "master_id": "001000000000003", "duplicate_id": "001000000000004"}
]

flow:
  name: salesforce_dedup
  tasks:

    - object_store:
        name: read_duplicates
        operation: read
        path: file:///data/salesforce/duplicates.json

    - iterate:
        name: iterate

    - salesforce_soapapi_merge:
        name: merge
        credentials_path: /etc/sfdc/credentials.json
        sobject_type: "{{event.data.sobject_type}}"
        master_record_id: "{{event.data.master_id}}"
        record_ids_to_merge:
          - "{{event.data.duplicate_id}}"

    - log:
        name: audit

Merge with field overrides

Override specific fields on the master record during merge. Useful when the losing record has more accurate data for certain fields.

- salesforce_soapapi_merge:
    name: merge_contacts
    credentials_path: /etc/sfdc/credentials.json
    sobject_type: Contact
    master_record_id: "{{event.data.master_id}}"
    record_ids_to_merge:
      - "{{event.data.dup_1}}"
      - "{{event.data.dup_2}}"
    master_field_overrides:
      Email: "{{event.data.preferred_email}}"
      Phone: "{{event.data.preferred_phone}}"
    allow_duplicate_save: true

Up to two duplicate records can be merged into the master in a single call. The allow_duplicate_save flag bypasses Salesforce duplicate detection rules that might otherwise block the merge.

Output

Each merge produces a JSON result:

{
  "success": true,
  "merged_record_ids": ["001000000000002"],
  "updated_related_ids": ["003000000000001", "006000000000001"]
}

Credentials

See Credentials for format details.