Skip to main content
HT
HerbDev Technical Consulting

Integration Rescue Consulting

When Systems Stop Talking, I Find Out Why

Missing orders, duplicate imports, failing files, and vendors pointing at each other are business problems before they are technical ones. I trace the connection from source to receiving system, identify where it breaks, and help make the recovery dependable.

Projects typically start around $2,500. Start with a specific failure or a bounded assessment.

Discuss an Integration

Find the failure across the whole connection

I investigate APIs, EDI, flat files, CSV, FTP/SFTP, webhooks, databases, batch jobs, and legacy applications. That includes data transformation, mapping, validation, logging, retries, idempotency, and reconciliation—not just whether the network request succeeded.

An example of a traceable integration

Source System → Export → Validation → Transformation → Duplicate Check → Transmission/API → Receiving System → Acknowledgement → Reconciliation → Logging/Alerting. Each stage answers a different question about the data. The exact design depends on what both systems support.

  1. STEP 01

    Source System

    Identify the authoritative records and stable transaction IDs so everyone knows what should be sent.

  2. STEP 02

    Export

    Capture the intended batch, record count, and export boundary; distinguish a complete export from a partial file.

  3. STEP 03

    Validation

    Check required fields, formats, totals, and file integrity; use checksums or hashes where appropriate.

  4. STEP 04

    Transformation

    Map fields, codes, dates, and units into the receiving system’s format without silently losing meaning.

  5. STEP 05

    Duplicate Check

    Track transaction identity and processing state. Idempotency makes a repeated delivery safe instead of creating another business transaction.

  6. STEP 06

    Transmission / API

    Send through the agreed API, webhook, EDI transport, FTP/SFTP, or other connection and record the attempt.

  7. STEP 07

    Receiving System

    Distinguish successful transport from successful import. Capture record-level acceptance and rejection where available.

  8. STEP 08

    Acknowledgement

    Obtain evidence that the receiving application accepted the transaction; a file-upload receipt alone may not be enough.

  9. STEP 09

    Reconciliation

    Compare expected and accepted transaction IDs, record counts, and business totals. Investigate missing or mismatched records.

  10. STEP 10

    Logging / Alerting

    Keep an audit trail, route exceptions to a failure queue, and alert the person responsible for recovery.

Retries should recover work, not repeat it

A timeout can mean that a transaction failed—or that it succeeded but the reply never arrived. Retrying blindly can create duplicates. I look for stable transaction IDs, durable processing records, and a way to check the receiving system before replaying uncertain work.

How an integration rescue starts

Projects typically start around $2,500. If the scope is unclear, begin with a fixed-price Legacy Systems Assessment starting at $1,500. You do not need to commit to replacing the core system.

Show Me the Problem

Legacy systems consulting →   Need ongoing technical leadership? →

Manage browser learning data

“Remove my test data” clears all AI 101 and ML 101 scores, reviews, project checklists and rating selections, plus saved vocabulary and recent history in this browser. Test entries cannot be separated from other learning progress. Cookie preferences, security protections, submitted feedback, contact emails and past analytics are kept.