Questions tagged [integration]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
0 answers
77 views

How to structure an ERP system in a modular way, with module hierarchy and where do application layers stand in this?

I built an asset management system (a web application) using C# ASP.NET in MVC structure. My project is built upon the ASP.NET Boilerplate template, which includes 5 layers by default. These layers ...
Emre Can Serteli's user avatar
2 votes
2 answers
418 views

Process many types of work in parallel, but sequential for each type of work

Imagine there is a stream of requests for about 500 types of work. There can be say 5 workers in parallel. One type of work should be executed by at most one worker at the same time. The requests for ...
tm1701's user avatar
  • 89
0 votes
1 answer
274 views

Is it reasonable to pass file URLs to microservices instead of the file contents?

In microservices oriented architecture, service A receives a file and stores it. Later Service A has to pass the data in the file to Service B. We have a choice to send the data, as: batches of rows ...
Asad Iqbal's user avatar
0 votes
2 answers
102 views

Integration pattern: API vs events

I need to design the architecture of a CRM "platform" that integrates 5-6 legacy CRMs. One important feature is to show customer records stored in other CRMs in one single dashboard. The ...
Glasnhost's user avatar
  • 233
0 votes
1 answer
231 views

Solution architecture for a Kafka streaming to website system

Not sure if this is the correct forum for this question - but I could really use some advice. I need to design a system (within certain constraints). The system must implement the following logic: A ...
Mulciber Coder's user avatar
0 votes
1 answer
57 views

REST Service-to-Service communication contract classes

Given two systems A and B that communicate with a Request-Response protocol (REST services). Where should the entities representing the request and response bodies reside? N.B.: The entities above ...
Chris's user avatar
  • 161
1 vote
0 answers
44 views

Looking for the right design (pattern?) for my webapp and external APIs intgerations

I'm working on a simple CRM (Customer Relationship Management) webapp (Flask and Peewee ORM) and I found myself in a situation where I believe that I should have used a design pattern that I may not ...
Pathong's user avatar
  • 11
-2 votes
2 answers
376 views

What happens after the ETL process?

I have thousands of .csv files with the same structure and, in most of the cases, some column values are the same ones recurring. Each file represents a report on some structures, with numeric ...
BoardsOfConsulting's user avatar
0 votes
1 answer
208 views

Designing Integration event application

We have a microservice that integrates with a third party system via REST API to handle appointment booking for our customer. It takes advantage of the event-driven model. Our microservice emits out ...
user2884707bond's user avatar
-2 votes
1 answer
902 views

Good idea to use source control with my Lambda functions?

So, I have this legacy project I am starting to hump into with my team. This is a AWS Lambda Python application (a bunch of Micro-services that inform various front-ends). So, when I asked how they ...
Ignacio Oroná's user avatar
-3 votes
2 answers
3k views

Sending JSON in body of an email

Basically, in our scenario, data has to be sent from a WordPress form to Dynamics 365. My current approach is putting it into an email body in JSON format, that is then extracted and further processed ...
Khadim Ali's user avatar
0 votes
0 answers
443 views

Integrating HTTP / Webhooks with Message Queues

I'm working at a project which integrates several Applications mostly SaaS Applications. The SaaS solutions have all the possibilities to hook into the internal event system with webhooks. The ...
Gulliva's user avatar
  • 111
1 vote
0 answers
137 views

Asynchronous communication with legacy system

Background My task is to create new system (X) for realtime work tracking for internal use. You should think it like an app that you have opened on a separate monitor/ on phone all day and you are ...
Pettan's user avatar
  • 11
1 vote
3 answers
776 views

Microservice integration with an external legacy system

We are decomposing a monolithic legacy system into microservices. As we do so, we can't completely remove reliance on some of the data in the legacy system that's required for each microservice. ...
DaveO's user avatar
  • 136
-3 votes
1 answer
80 views

what is event based data integration? [closed]

Please help me to understand what is event based data integration in simple layman term with some examples? How it is different from other form of data integration. Some sample use cases will be ...
Rajneesh Shukla's user avatar
0 votes
1 answer
163 views

Integrating with real-time data from multiple devices with accelerometer

I am designing a MVP for a simple gamification system for a trampoline park(s). External company is providing bracelets for customers, then collecting this data in their own web app, where they ...
Celebes's user avatar
  • 67
1 vote
2 answers
1k views

How to deal with bad third party APIs in a microservices architecture?

I'm currently in the process of transforming a monolithic application to a microservices based architecture. The monolith is dependent on third party services (as in other departments) for its data. ...
abstract christmas tree's user avatar
-3 votes
2 answers
163 views

Options for managing a multi-purpose web service?

I have a web service that serves two purposes. On a weekly basis, it syncs records from the GIS DB to a workorder management system's database. On a continual basis, it serves up the records to a ...
User1974's user avatar
1 vote
2 answers
3k views

Bidirectional sync between two databases with differing schemas

I'm embarking upon a project where the goal is to create a bidirectional sync mechanism between two database systems with differing schemas. One is a custom CRM app build on MongoDB, the other is ...
Journeyman's user avatar
8 votes
3 answers
1k views

How to handle database errors after a successful 3rd party payments API response?

The specific scenario in my case involves PayPal but it could easily be any other external system. According to a lot of sources on the Internet, including the official documentation, a basic PayPal ...
Avius's user avatar
  • 387
5 votes
1 answer
703 views

How to "state of the art" integrate multiple sub-modules with duplicate dependencies?

I am currently working on a project which will consist of multiple sub-modules. Each sub-module is developed and unit-tested in its own repository. All sub-modules have to be integrated in one main-...
mezorian's user avatar
-1 votes
1 answer
203 views

How to handle major changes (cross-cutting concerns) in REST API?

Let's say we have a REST API application A consumed by other 30 applications. Application "A" uses a cross-cutting security implementation using a Security NuGet package 1.0. All minor/major changes ...
Adolfo Perez's user avatar
2 votes
0 answers
109 views

How to design generic bug-tracker integration? [closed]

I'm looking for ideas on how to design a "generic" bug-tracker integration architecture for Kiwi TCMS (opensource test case management system). Background: at the moment we support integration with ...
Alexander Todorov's user avatar
4 votes
0 answers
223 views

How to authenticate third-party callbacks that don't support authentication

I'm working on a project that integrates with a third-party service via API, and the third-party uses callbacks to update us on the status of the operations being performed. These callbacks can be hit ...
Omar Rida's user avatar
3 votes
1 answer
1k views

How to handle 3rd party system API timeout

in my company we are using different 3rd party systems, for example: a CRM, where we sync information about the customer; the goal is having a 1 to 1 syncronization. a transactional email system, ...
lmarx's user avatar
  • 141
1 vote
0 answers
25 views

Multiple SaaS Solution Integrations with On Prem Systems

I am looking at a couple of SaaS Policy Solutions and want to integrate those with an On Prem Policy System. I am listing some goals below and approach I am considering. I am looking for any input ...
Elim Garak's user avatar
1 vote
1 answer
59 views

Metadata evolution considerations?

As application evolves, so does the metadata. What are the top considerations for transitioning into a more refined metadata schema? Two example cases, which in my opinion are quite archetypal. Case ...
Roman Susi's user avatar
  • 1,773
1 vote
2 answers
306 views

Integration between REST API and database

I have a scenario where: I have a REST API to manage resources, for instance workspaces. This REST API is closed in the sense that cannot be altered. I want to CRUD workspaces but save additional ...
soares's user avatar
  • 21
1 vote
0 answers
29 views

How would I go about developing an interface that would allow integration of 6 other models?

I am new to programming, I have been trying to get my head around this. Context My project is about defining investment packages for various construction projects within a country based around an ...
user295188's user avatar
3 votes
2 answers
352 views

Legacy modernisation - Parallel systems vs Extending Original application?

We are in the process of modernizing an existing legacy application and as part of that we are replacing a proprietary off-the-shelf product that is deeply integrated with the application - with a new ...
nesh_s's user avatar
  • 141
3 votes
3 answers
293 views

How can I inform my team when components are ready for integration?

My team is developing a system with embedded and Windows components. Currently we have seperate repositories for the Windows and embedded platforms. The rest of the team have concerns that there is ...
Gusdor's user avatar
  • 748
-2 votes
1 answer
380 views

Finding an angle using angular velocity read from a gyro

I'm making a self-stabilizing camera mount for a Digital Systems project using Arduino. I plan to read angular position from a gyrospcope and adjust servos on the mount accordingly to keep it level. ...
mbgaudynski's user avatar
0 votes
1 answer
102 views

CRM and external systems: How to associate data with contacts?

This question is about Dynamics CRM but is valid for every system that allows merging entities. Having data related to a contact in multiple external systems, how would you know which contact the ...
Jan Sommer's user avatar
-1 votes
1 answer
261 views

What is the most appropriate standard for modeling B2B integration

This question might seem too broad, but I really need help with this. I am required to choose a standard or notation to model an integration between two business processes, one of which is external. ...
dzenesiz's user avatar
  • 159
2 votes
4 answers
2k views

What is a "streaming app", exactly?

I'm trying to get past all the hipster, pie-in-the-sky buzzwording and address a very simple, fundamental question: What is a streaming application? According to the Kafka site "Kafka is used for ...
smeeb's user avatar
  • 4,870
1 vote
1 answer
124 views

Is there a better way of communicating between systems?

I work for a software company that makes business information systems for a large enterprise. We do systems for invoicing, payment, planning, etc. The enterprise uses SAP for their core system, and ...
d.a.vorm's user avatar
  • 179
1 vote
2 answers
308 views

Data integration from heterogeneous sources

A client has requested that we build a platform for integrating data from partner to their central data store. This will not be "Big Data" scale. The data from each partner will be accessible through ...
Elad Lachmi's user avatar
6 votes
4 answers
2k views

How and when to choose between Data Consolidation/Data Integration and Data Synchronisation?

I am having some confusion as to how to decide what to choose between Data Consolidation/Data Integration and Data Synchronisation? I know that: Data Consolidation/Data Integration: refers to the ...
Jason Donnald's user avatar
1 vote
3 answers
464 views

Reasons NOT to use email for system integration

I do system integration for critical and time sensitive systems. We have two standard ways we can build these system integrations. One is a simple (and cheap) email ingestion tool built into our ...
Ben's user avatar
  • 181
0 votes
2 answers
215 views

Advice on using middleware to phase out legacy ERP system

I would like to know if any of you have any experiences and advice you'd like to share about middleware systems? A little background first: the company I work for is based entirely on a closed ...
DDL-SDW's user avatar
  • 19
0 votes
1 answer
3k views

Why do most payment gateways use synchronous integration?

This question comes to my mind having just lost some money while ordering Pizza. Most internet merchants (atleast in India) use synchronous page redirection for integration with Banks and payment ...
Kshitiz Sharma's user avatar
6 votes
3 answers
4k views

How to programmatically control a GUI application?

I have a couple of users who have a User Interface for an application that they must use to do their job. The UI can be cumbersome to navigate to perform some time critical tasks. This UI does not ...
GinjaNinja's user avatar
3 votes
1 answer
143 views

Simple messaging pattern to replace shared DB? [closed]

There are two modules A and B using the same DB. A imports B as a JAR. I read that messaging patterns can replace the tightly coupled solution of using a shared DB but I am not sure which message ...
Michael's user avatar
  • 213
1 vote
1 answer
67 views

How to call a team activity where members are in charge of interconnecting systems?

I'm talking of members of a team in charge of dealing with external providers, cloud services, social services, marketing services and so on... They are not building the core application but they ...
koalaok's user avatar
  • 503
1 vote
0 answers
200 views

Appropriate Design for MDM Solution

Design Problem: A department aligned system (an application/UI and database, which we'll call System A) is used to manage both customer information and customer transactional data like orders, charges,...
rro's user avatar
  • 279
3 votes
1 answer
750 views

How to design error monitoring for batch jobs with multiple and diverse steps?

I'm working on a software to integrate an e-commerce store and the company ERP. All the integration steps are run as a unique batch job, every 5 minutes. Things are working under production, but I'm ...
user149702's user avatar
2 votes
2 answers
450 views

How system integration happens with an ESB?

Assume I have two different software sub systems and I need to interconnect them through an Enterprise Service Bus. What sort of modifications do I need to make in the existing systems to integrate ...
DesirePRG's user avatar
  • 187
1 vote
1 answer
78 views

Developing an application where a chunk of the code is used by both the app the tests

I'm developing a web app in PHP where part of the code I'm developing for it will also be used in the tests. I'm not sure how to handle this. That code in question is an abstraction to communicate ...
Jodes's user avatar
  • 849
0 votes
1 answer
56 views

Testing strategy for coupled systems

We have 2 coupled applications: a ReadOnly view and an Admin management view. The ReadOnly view is updated by changes from the Admin view. Each application is owned by different teams. Each ...
dulac's user avatar
  • 101
24 votes
9 answers
7k views

How do you scale your integration testing?

I am investigating techniques and strategies for scaling our growing number of integration tests on our current product, so that they can (humanly) remain part of our development, and CI process. At ...
Jezz Santos's user avatar