Re: Theory Question/Discussion regarding Replication Tools
Date: Mon, 3 Apr 2023 11:53:29 -0700
Message-ID: <7e45a343-9ae3-91f4-3562-857a14744c40_at_gmail.com>
Chris,
I've worked with organizations who modified their downstream analytic
environments as the intermediate or temporary solution to unify
different information, while they worked on the far larger project to
move everything upstream to common systems.
This recognizes that the immediate critical requirement is for global
strategic information for decision-making, because day-to-day activities
can usually be managed for a few years using the systems acquired along
with the acquired company, until everyone can be consolidated onto the
same operation applications in the long-term. Building data maps for the
ETL/ELT processes from the disparate operational environments to the
downstream analytic environments helps inform the organization on what
each acquired component org might be missing, which also provides input
for the eventual consolidation.
As the eventual consolidated operational system(s) are deployed
gradually, and the ETL/ELT feeds to the downstream analytics evolve
accordingly, then the downstream analytics can also temporarily include
reporting to compare and verify correctness and identify anomalies from
the migrations.
I do believe that replication for the reasons you describe might develop
into a crutch, providing temporary accommodation for differences which
does not lead to a permanent solution. The approach above leads to a
solution, but continual bandaiding by adding more replication does not
lead to a viable permanent solution.
If the replication is just a stop-gap leading to the long-term solution,
then all is good. But if the replication is viewed as the long-term
solution, or if the long-term solution is fuzzy or non-existent, then
I'd be worried.
Hope this helps...
-Tim
On 4/3/2023 11:29 AM, Chris Taylor wrote:
> Find myself in an interesting position where multiple databases need
> to be kept in sync with transactions. Primarily caused by corporate
> acquisitions.
>
> Having dealt with replication in the past with both Goldengate and
> IBM's QRep, is it just me, or is replication a "band-aid/bandage" for
> a bad design when multiple end points need to be kept in sync?
>
> Seems to me replication is what you slap-on to feed a data mart, or a
> postgres or a Snowflake when you don't have some kind of central hub
> that is responsible for sending those transactions to their
> appropriate end points.
>
> I'm curious what solutions what you guys have seen and if any of your
> platforms are using a central type hub to send transactions out to
> different end points when those end points are databases such as
> Oracle, Postgres, Snowflake?
>
> Am I crazy, or is everyone else? :D
>
> Thanks,
> Chris
>
-- http://www.freelists.org/webpage/oracle-lReceived on Mon Apr 03 2023 - 20:53:29 CEST