0

We have jobs running on-premises, many of which directly query our (on-prem) database. At the start of these jobs a new record is created in the database, and the record id is returned so that it may be referenced in future queries. We’ve recently started running other jobs in the cloud, but we have yet to run jobs that require a database connection. Due to security constraints, communication between sites is restricted and we are only able to initiate pushes/pulls from on-prem.

What can we do to enable these jobs that need to propagate data to (and receive a response from) our on-prem database? Is a message queue an appropriate solution here (ie instead of querying the database directly, submit queries to a message queue in the cloud, and periodically poll the queue from on-prem, popping off messages as they're received)? I don't have much experience with databases and I have zero knowledge of message queues so when I looked into this I'm having trouble filtering for what's relevant to this issue.

New contributor
byte_zero is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct.
1

That sounds like your policy is there to prevent data leakage, and your proposal is a way of making a run around the security policy? If a job requires data from the on-prem database, and you're not allowed to leak data from on-prem into the cloud, then you cannot run that job in the cloud.

Your Answer

byte_zero is a new contributor. Be nice, and check out our Code of Conduct.

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.