Questions tagged [migration]
For questions about migration of data from one source to another (e.g. a database migration from MySQL to SQL Server), or the migration of code from one language (version) to another, e.g. from Java 7 to Java 8 or from Java to Python.
113
questions
1
vote
2
answers
253
views
Migration pattern for logic too complex to cover it with SQL
When you create migration in EF Core you can spice it up with arbitrary SQL query. Yet there is a limit to it -- maybe the migration is too complex in technical sense (i.e the SQL cannot handle it) or ...
- 1,534
0
votes
1
answer
85
views
Referencing objects created during seeding by ID
I'm building a software that allows users to extract analytics from a data source. A subset of data periodically is extracted from the data source and stored in a separate database for ease of access (...
- 111
1
vote
2
answers
264
views
Synchronize data between old on premise application and new cloud system
Scenario/Context
There is an old monolithic desktop application (running locally) which uses ODBC to connect to SQL database (on premise). This desktop application should be replaced with a new web ...
- 119
3
votes
1
answer
133
views
Strategies for Adapting SQL-Based Data Retrieval to a Newly Introduced REST API in a Short Timeline
I'm in a pickle following a recent executive decision by our parent company. They have elected to abstract away our SQL data warehouse, transitioning to a REST API for data retrieval. The purported ...
- 61
0
votes
1
answer
67
views
sql migration - decoupling deployment from execution
We have a .NET c# solution that uses AliaSQL to run database migrations / to build the backend. I have a situation where we need to write some SQL Server logic that will
copy records from Table A to ...
- 571
0
votes
2
answers
307
views
Workflow for Writing Database Migrations for a Team
I am wondering what some possible workflows are for writing database migrations for a team of developers. We seem to run into a problem where one person writes a migration, names it and gives it a ...
- 109
0
votes
1
answer
267
views
Decoupling modules of a monolith
As part of an migration from .NET Framework to .NET Core we're looking to decouple elements of our monolith into more manageable modules. Ideally following a clean architecture/DDD/microservice ...
- 103
-1
votes
1
answer
154
views
Microservice decomposition into reusable microservice from a set of monolithic applications
So for my Masterthesis i have to decompose a set of monolithic industrial applications into microservices. The aim is to decompose the monoliths in to services that are as much reusable as possible. I ...
- 1
1
vote
1
answer
249
views
An effective database migration pattern for many instances of the same app over a long period of time
How do you handle migrations to your database after a long period of time?
I'm using fluent migrator, and after some months or years, the number of migrations could be (and has been in previous ...
- 144
0
votes
1
answer
240
views
A bug was found in my code. Should I migrate the application as planned, or focus on patching the bug?
While testing my iOS application against the latest version, I've discovered a bug. For the purpose of this question, I am omitting the details of the bug.
I was planning to migrate the application to ...
- 2,063
-4
votes
1
answer
45
views
Create the database using schema migration for the first time? [closed]
what is the best practice when creating a database schema for the first time? Do I need to write schema migrations, or create it from the DBMS tools?
- 169
1
vote
1
answer
130
views
Dealing with queries on versioned data
I have a dataset stored in ElasticSearch, only for searching purposes (the source of truth is external).
Each index has an associated schema and there are associated queries.
From time to time, the ...
- 127
21
votes
5
answers
1k
views
How can there be so much "business logic" for a company that they cannot drop their old COBOL/mainframe code? [closed]
Something which has always confused me is this. I keep hearing about how these big, old corporations which were around in the 1950s (for example) and early on started using COBOL-coded business logic ...
- 319
-1
votes
1
answer
225
views
New frontend for legacy code
How would you engineer this:
You have a legacy application that is a big ball of mud and a monolith. This application is "impossible" to change to look good on mobile devices.
The management ...
- 59
0
votes
0
answers
73
views
To merge software solutions or not?
Software A is a Node/Express application using a MongoDB database. It is accessed mostly via RESTful endpoint by a mobile app built in RN and an admin dashboard via React web app. It also has a ...
- 109
5
votes
3
answers
481
views
Rebuilding a legacy application : What about the data model?
I am currently rebuilding from scratch a product catalogue (to feed a shopping website).
The existing legacy system is heterogenous, Long story short : The some products are stored in a FileMaker ...
- 75
0
votes
1
answer
72
views
Best way to migrate to new versions of librairies with breaking changes
(I orignally posted my question on StackOverflow and figured maybe this would be a better place to ask)
I provide details on the librairies I'm working with because it helps understand my issue but it ...
- 111
2
votes
1
answer
692
views
Is it considered as best practice to use migration scripts for one-off large data manipulation over a table?
I have inherited a project via laravel that uses its database migration mechanism coming from the framework. The application has the following table named actions:
action_log_id SERIAL PK
user_id INT
...
2
votes
2
answers
765
views
Isn't data migration a major benefit of MongoDB compared to the commonly used relational databases?
I was reading an old answer which was recently updated, and noticed that the author doesn't quote the simplicity of data migration as a benefit of MongoDB. I always thought that the major benefit of a ...
- 136k
-3
votes
1
answer
81
views
Strategies in cloud migration [closed]
A few months ago I found a presentation with slides about the benefits of migrating to the cloud. I think that the presentation was maybe quite old but I think that it started with arguing that ...
- 8,078
1
vote
2
answers
2k
views
Live data migration - double read vs double write
Pretty often I have a need to migrate the location where some data is stored - to a new column, a new table, or even a new data store. And usually this needs to be done with no down-time. I can see ...
- 139
-4
votes
2
answers
50
views
Partially Automated Migration of Monolith to MicroService
I am struggling to find some methods / concepts or even implementations of partially automated processes to split a monolith into microservices. Of cause I do not expect any solution that will make ...
- 1
3
votes
1
answer
178
views
Front-end migration in an Agile process
In our organisation, we're planning on migrating a Single-Page Application (with a complex back-end) to another Front-end technology (Angular to React). We'd like to procede with an Agile mindset by ...
- 139
0
votes
1
answer
240
views
Should I skip some migrations on production in case of migrating a legacy database that has not been generated via migration script?
I have a complex PostgreSQL database structure that is consisted with views, materialized views and foreign wrappers.
The database schema is manually updated without any sort of migration script, ...
3
votes
2
answers
275
views
For Evolutionary Database Tools like Flyway or LiquidBase, it is better to integrate the tool or left it as a stand alone step in the CI process?
Although I believe my question is language and DB agnostic, I will provide the specifics technologies in this case study because it might help understanding my question (sorry for my English).
It's ...
- 155
3
votes
0
answers
61
views
Moving application control flow from NiFi to code
We currently have an application that is nominally written in Java/Spring boot, but all of the control flow is in NiFi.
For example, there are the following layers in the java application:
...
- 303
0
votes
0
answers
23
views
Should I do migration testing if the new library needs a different testing suite?
I'm using a pretty old library to make server requests which is not properly tested and it not really matching nowadays requirements, so the plan is to migrate to a new one over the next release. So ...
- 515
0
votes
1
answer
200
views
Should we do data migration from Oracle via the microservices, or should we do direct data migration from Oracle to Azure SQL DBs?
We are replacing a legacy application that runs on a single Oracle DB, and the decision has been made to replace it with a microservices-based application running on Azure SQL.
Do we do data ...
6
votes
4
answers
650
views
Am I right in writing our own database migration/versioning software?
I have started work on writing a tool to version the database schemas we use at work and enable migrations under version control. My first research into existing tools turned out to be too cursory due ...
- 191
0
votes
2
answers
525
views
Referencing Database Primary Keys from Codebase
I don't have a lot of experience with these kind of issues, but I feel I need to consult on this issue. The current codebase I'm working on is using what I consider to be a questionable technique to ...
- 109
4
votes
1
answer
443
views
How to ease the pain of lack of diffs when using database migrations?
The pain that I've often felt when creating database migration files, is best described in this Speakerdeck: Sane Database Change Management with Sqitch.
Paste entire function to new "up" ...
1
vote
0
answers
54
views
dealing with state data in an incremental migration from large legacy application
I have a very large monolithic legacy application that I am tasked with breaking into many context-bounded applications on a different architecture. My management is pushing for the old and new ...
- 111
0
votes
1
answer
380
views
Architecture for File migration from FTP to cloud service
We are building a new application for a client to manage their cases. They are already using their existing system in which they are storing files associated to the cases in an FTP folder. There is an ...
- 121
0
votes
1
answer
51
views
Descriptive short term for a field that has been set to read-only in anticipation of removal?
I'm currently writing a design to add the possibility to mark a field or attribute for an entity as read-only in preparation for imminent removal. The idea is that, once the field has been thus marked ...
- 111
4
votes
3
answers
2k
views
Should I merge database migrations together before release?
During the development process many migrations may appear. Is there any point to keep them instead of merging them all together?
Let's take a look into a simple example.
During development we ...
- 151
5
votes
1
answer
328
views
What to do with historical SVN branches after switching to GitFlow?
I am part of a team that has recently moved from an SVN repository to a Git repository, and have started using GitFlow.
As I understand it, this means that in a perfect world, the minimum number of ...
- 161
2
votes
2
answers
653
views
Migrating from legacy database schema, rewrite legacy or sync to new
We're currently in the process of designing our new version of an existing application. This new version will not reuse any existing code as the old code is over 10 years old and tightly coupled.
...
- 131
2
votes
4
answers
2k
views
What is the operational benefit to separating database migrations and code deployments?
Should Database migrations be in included in the same deployment project as the code?
If they are not included in the same deployment, the Database deployment package and the Code deployment package ...
- 165
0
votes
2
answers
593
views
Migrating an Application from SQL to NoSQL [closed]
I am faced with taking a mvce's for SQL which happens to be the WideWorldImporters Database from Microsoft and migrating it to a NoSQL on mongodb.
The system in question may use certain fractions of ...
- 109
2
votes
1
answer
247
views
Recommended methodologies for refactoring a large ISAM based DB structure to a RDBMS?
I'm meeting quite a challenge. We have an old grown software with mostly Delphi applications, and an underlying ISAM database server (ADS)1, used with a lot of free tables and manually programmed ...
- 1,542
0
votes
1
answer
191
views
How to prepare test case for System Migration of legacy system while existing functionality is unclear?
I am migrating a legacy system from Oracle Form to Web Application. The migration is conducted with code study and interview.
As the requirement is to migrate the existing system to Web application ...
- 349
4
votes
2
answers
3k
views
How to approach the understanding, documentation and validation of legacy code [duplicate]
I've been tasked with studying a Python code, which runs on an orchestrator, which schedule the launch of the code in correspondence of some events. The code imports some modules, and it's basically ...
- 231
2
votes
1
answer
182
views
Gap between Code base and Production application
Background
I joined a company as a solutions architect less than a year ago, with a main task of consolidating, and modernizing legacy code resulting from 90+ company acquisitions over the past 20+ ...
- 604
5
votes
5
answers
737
views
Is it a fallacy to say that system migrations don't suit an agile methodology as the requirements are known up front?
I saw a project manager recently stand up at an Bank's internal staff meeting and say:
We're running this system migration not using an agile methodology. We know the requirements up front so agile ...
- 4,829
-3
votes
1
answer
158
views
Should I rebuild to use latest tech?
I am a full stack developer in a very small company.
It has a custom built ERP software using PHP 4 (no framework). Currently, it works fine from the business point of view except for some bugs here ...
- 11
0
votes
1
answer
122
views
Are there established techniques for incrementally migrating the data of an existing application to a new application?
I'm working on a project in which we are incrementally replacing an existing application. By incrementally I mean some features will be developed and shipped in the new application, and those features ...
- 345
3
votes
3
answers
544
views
Designing new system to replace legacy: Would you start with a new database and maintain both independently until the switch? [closed]
We have a legacy system which will eventually be deprecated, at which point we will switch to using a new system.
What are the pros and cons of maintaining separate databases for the old and new ...
3
votes
5
answers
3k
views
Convert a team from VB.Net to C#.Net
I am currently running a team of 5 VB.Net developers and have decided to make a switch to C#. The team builds and maintains around 20 different applications that run our whole platform, so the code-...
- 141
2
votes
1
answer
1k
views
What are the best practices to ensure that Code Migrations work well in a team environment where there are multiple databases?
We're just starting off with using Entity Framework Code First approach and I'm playing with the Code Migrations system.
So we were wondering, are the migration files intended to be treated as ...
- 2,790
13
votes
1
answer
1k
views
Sharing parts of a monorepo
We currently have a complex and inefficient build system consisting of many SVN and Git repos (about 50% each), including one which is a git submodules repo.
We also have homemade scripts that manage ...
- 239