Questions tagged [integration]
The integration tag has no usage guidance.
79
questions
1
vote
0
answers
56
views
How to structure an ERP system in a modular way, with module hierarchy and where do application layers stand in this?
I built an asset management system (a web application) using C# ASP.NET in MVC structure. My project is built upon the ASP.NET Boilerplate template, which includes 5 layers by default. These layers ...
- 111
2
votes
2
answers
335
views
Process many types of work in parallel, but sequential for each type of work
Imagine there is a stream of requests for about 500 types of work. There can be say 5 workers in parallel. One type of work should be executed by at most one worker at the same time. The requests for ...
- 89
0
votes
1
answer
202
views
Is it reasonable to pass file URLs to microservices instead of the file contents?
In microservices oriented architecture, service A receives a file and stores it. Later Service A has to pass the data in the file to Service B. We have a choice to send the data, as:
batches of rows ...
- 265
0
votes
2
answers
91
views
Integration pattern: API vs events
I need to design the architecture of a CRM "platform" that integrates 5-6 legacy CRMs.
One important feature is to show customer records stored in other CRMs in one single dashboard. The ...
- 223
0
votes
1
answer
185
views
Solution architecture for a Kafka streaming to website system
Not sure if this is the correct forum for this question - but I could really use some advice.
I need to design a system (within certain constraints).
The system must implement the following logic:
A ...
0
votes
1
answer
56
views
REST Service-to-Service communication contract classes
Given two systems A and B that communicate with a Request-Response protocol (REST services).
Where should the entities representing the request and response bodies reside?
N.B.: The entities above ...
- 161
1
vote
0
answers
41
views
Looking for the right design (pattern?) for my webapp and external APIs intgerations
I'm working on a simple CRM (Customer Relationship Management) webapp (Flask and Peewee ORM) and I found myself in a situation where I believe that I should have used a design pattern that I may not ...
- 11
-2
votes
2
answers
321
views
What happens after the ETL process?
I have thousands of .csv files with the same structure and, in most of the cases, some column values are the same ones recurring. Each file represents a report on some structures, with numeric ...
0
votes
1
answer
171
views
Designing Integration event application
We have a microservice that integrates with a third party system via REST API to handle appointment booking for our customer. It takes advantage of the event-driven model. Our microservice emits out ...
- 111
-2
votes
1
answer
837
views
Good idea to use source control with my Lambda functions?
So, I have this legacy project I am starting to hump into with my team. This is a AWS Lambda Python application (a bunch of Micro-services that inform various front-ends). So, when I asked how they ...
- 107
-3
votes
2
answers
2k
views
Sending JSON in body of an email
Basically, in our scenario, data has to be sent from a WordPress form to Dynamics 365. My current approach is putting it into an email body in JSON format, that is then extracted and further processed ...
- 153
0
votes
0
answers
364
views
Integrating HTTP / Webhooks with Message Queues
I'm working at a project which integrates several Applications mostly SaaS Applications. The SaaS solutions have all the possibilities to hook into the internal event system with webhooks. The ...
- 111
1
vote
0
answers
126
views
Asynchronous communication with legacy system
Background
My task is to create new system (X) for realtime work tracking for internal use. You should think it like an app that you have opened on a separate monitor/ on phone all day and you are ...
- 11
1
vote
3
answers
700
views
Microservice integration with an external legacy system
We are decomposing a monolithic legacy system into microservices. As we do so, we can't completely remove reliance on some of the data in the legacy system that's required for each microservice.
...
- 136
-3
votes
1
answer
75
views
what is event based data integration? [closed]
Please help me to understand what is event based data integration in simple layman term with some examples?
How it is different from other form of data integration.
Some sample use cases will be ...
0
votes
1
answer
161
views
Integrating with real-time data from multiple devices with accelerometer
I am designing a MVP for a simple gamification system for a trampoline park(s).
External company is providing bracelets for customers, then collecting this data in their own web app, where they ...
- 67
1
vote
2
answers
1k
views
How to deal with bad third party APIs in a microservices architecture?
I'm currently in the process of transforming a monolithic application to a microservices based architecture. The monolith is dependent on third party services (as in other departments) for its data. ...
-3
votes
2
answers
161
views
Options for managing a multi-purpose web service?
I have a web service that serves two purposes.
On a weekly basis, it syncs records from the GIS DB to a workorder management system's database.
On a continual basis, it serves up the records to a ...
- 97
1
vote
2
answers
3k
views
Bidirectional sync between two databases with differing schemas
I'm embarking upon a project where the goal is to create a bidirectional sync mechanism between two database systems with differing schemas. One is a custom CRM app build on MongoDB, the other is ...
- 347
8
votes
3
answers
1k
views
How to handle database errors after a successful 3rd party payments API response?
The specific scenario in my case involves PayPal but it could easily be any other external system.
According to a lot of sources on the Internet, including the official documentation, a basic PayPal ...
- 377
5
votes
1
answer
612
views
How to "state of the art" integrate multiple sub-modules with duplicate dependencies?
I am currently working on a project which will consist of multiple sub-modules.
Each sub-module is developed and unit-tested in its own repository.
All sub-modules have to be integrated in one main-...
- 69
-1
votes
1
answer
197
views
How to handle major changes (cross-cutting concerns) in REST API?
Let's say we have a REST API application A consumed by other 30 applications. Application "A" uses a cross-cutting security implementation using a Security NuGet package 1.0. All minor/major changes ...
- 167
2
votes
0
answers
103
views
How to design generic bug-tracker integration? [closed]
I'm looking for ideas on how to design a "generic" bug-tracker integration architecture for Kiwi TCMS (opensource test case management system).
Background: at the moment we support integration with ...
4
votes
0
answers
217
views
How to authenticate third-party callbacks that don't support authentication
I'm working on a project that integrates with a third-party service via API, and the third-party uses callbacks to update us on the status of the operations being performed. These callbacks can be hit ...
- 49
3
votes
1
answer
1k
views
How to handle 3rd party system API timeout
in my company we are using different 3rd party systems, for example:
a CRM, where we sync information about the customer; the goal is having a 1 to 1 syncronization.
a transactional email system, ...
- 141
1
vote
0
answers
25
views
Multiple SaaS Solution Integrations with On Prem Systems
I am looking at a couple of SaaS Policy Solutions and want to integrate those with an On Prem Policy System.
I am listing some goals below and approach I am considering. I am looking for any input ...
- 119
1
vote
1
answer
58
views
Metadata evolution considerations?
As application evolves, so does the metadata. What are the top considerations for transitioning into a more refined metadata schema?
Two example cases, which in my opinion are quite archetypal.
Case ...
- 1,773
1
vote
2
answers
287
views
Integration between REST API and database
I have a scenario where:
I have a REST API to manage resources, for instance workspaces. This REST API is closed in the sense that cannot be altered.
I want to CRUD workspaces but save additional ...
- 21
1
vote
0
answers
29
views
How would I go about developing an interface that would allow integration of 6 other models?
I am new to programming, I have been trying to get my head around this.
Context
My project is about defining investment packages for various construction projects within a country based around an ...
- 11
3
votes
2
answers
332
views
Legacy modernisation - Parallel systems vs Extending Original application?
We are in the process of modernizing an existing legacy application and as part of that we are replacing a proprietary off-the-shelf product that is deeply integrated with the application - with a new ...
- 141
3
votes
3
answers
293
views
How can I inform my team when components are ready for integration?
My team is developing a system with embedded and Windows components. Currently we have seperate repositories for the Windows and embedded platforms.
The rest of the team have concerns that there is ...
- 738
-2
votes
1
answer
364
views
Finding an angle using angular velocity read from a gyro
I'm making a self-stabilizing camera mount for a Digital Systems project using Arduino. I plan to read angular position from a gyrospcope and adjust servos on the mount accordingly to keep it level.
...
0
votes
1
answer
98
views
CRM and external systems: How to associate data with contacts?
This question is about Dynamics CRM but is valid for every system that allows merging entities.
Having data related to a contact in multiple external systems, how would you know which contact the ...
- 170
-1
votes
1
answer
251
views
What is the most appropriate standard for modeling B2B integration
This question might seem too broad, but I really need help with this.
I am required to choose a standard or notation to model an integration between two business processes, one of which is external.
...
- 159
2
votes
4
answers
2k
views
What is a "streaming app", exactly?
I'm trying to get past all the hipster, pie-in-the-sky buzzwording and address a very simple, fundamental question:
What is a streaming application?
According to the Kafka site
"Kafka is used for ...
- 4,830
1
vote
1
answer
124
views
Is there a better way of communicating between systems?
I work for a software company that makes business information systems for a large enterprise. We do systems for invoicing, payment, planning, etc. The enterprise uses SAP for their core system, and ...
- 179
1
vote
2
answers
301
views
Data integration from heterogeneous sources
A client has requested that we build a platform for integrating data from partner to their central data store. This will not be "Big Data" scale.
The data from each partner will be accessible through ...
- 205
6
votes
4
answers
2k
views
How and when to choose between Data Consolidation/Data Integration and Data Synchronisation?
I am having some confusion as to how to decide what to choose between Data Consolidation/Data Integration and Data Synchronisation? I know that:
Data Consolidation/Data Integration: refers to the ...
- 161
1
vote
3
answers
438
views
Reasons NOT to use email for system integration
I do system integration for critical and time sensitive systems. We have two standard ways we can build these system integrations. One is a simple (and cheap) email ingestion tool built into our ...
- 181
0
votes
2
answers
205
views
Advice on using middleware to phase out legacy ERP system
I would like to know if any of you have any experiences and advice you'd like to share about middleware systems?
A little background first: the company I work for is based entirely on a closed ...
- 19
0
votes
1
answer
3k
views
Why do most payment gateways use synchronous integration?
This question comes to my mind having just lost some money while ordering Pizza. Most internet merchants (atleast in India) use synchronous page redirection for integration with Banks and payment ...
- 817
6
votes
3
answers
4k
views
How to programmatically control a GUI application?
I have a couple of users who have a User Interface for an application that they must use to do their job. The UI can be cumbersome to navigate to perform some time critical tasks.
This UI does not ...
- 350
3
votes
1
answer
137
views
Simple messaging pattern to replace shared DB? [closed]
There are two modules A and B using the same DB. A imports B as a JAR. I read that messaging patterns can replace the tightly coupled solution of using a shared DB but I am not sure which message ...
- 213
1
vote
1
answer
66
views
How to call a team activity where members are in charge of interconnecting systems?
I'm talking of members of a team in charge of dealing with external providers, cloud services, social services, marketing services and so on...
They are not building the core application but they ...
- 493
1
vote
0
answers
199
views
Appropriate Design for MDM Solution
Design Problem:
A department aligned system (an application/UI and database, which we'll call System A) is used to manage both customer information and customer transactional data like orders, charges,...
- 279
3
votes
1
answer
720
views
How to design error monitoring for batch jobs with multiple and diverse steps?
I'm working on a software to integrate an e-commerce store and the company ERP. All the integration steps are run as a unique batch job, every 5 minutes. Things are working under production, but I'm ...
- 33
2
votes
2
answers
447
views
How system integration happens with an ESB?
Assume I have two different software sub systems and I need to interconnect them through an Enterprise Service Bus.
What sort of modifications do I need to make in the existing systems to integrate ...
- 187
1
vote
1
answer
78
views
Developing an application where a chunk of the code is used by both the app the tests
I'm developing a web app in PHP where part of the code I'm developing for it will also be used in the tests. I'm not sure how to handle this. That code in question is an abstraction to communicate ...
- 839
0
votes
1
answer
56
views
Testing strategy for coupled systems
We have 2 coupled applications: a ReadOnly view and an Admin management view.
The ReadOnly view is updated by changes from the Admin view.
Each application is owned by different teams. Each ...
- 101
24
votes
9
answers
7k
views
How do you scale your integration testing?
I am investigating techniques and strategies for scaling our growing number of integration tests on our current product, so that they can (humanly) remain part of our development, and CI process.
At ...
- 349