Questions tagged [kubernetes]
The kubernetes tag has no usage guidance.
47
questions
0
votes
0
answers
34
views
Is there any Layer approach for multicluster communication instead of service mesh approach?
We are investigating on communication between our clusters (AWS and GCP mostly) and we investigating solutions like Istio and linkerd. but the things is all of them connects each cluster to another ...
- 101
-2
votes
2
answers
166
views
How do I build my application with high throughput in mind? (Need guidance)
I am building a Spring boot REST API app that is part of a microservice architecture project. What I am planning:
My app listens for events from two other services and after some business logic, ...
- 1
0
votes
1
answer
51
views
how about using kubernetes statefulset to mapping the snowflake datacener id and worker id
I am developing a distribution id project, now using the twitter snowflake id as the fundation of the distribution id. In kubernetes cluster, to fetch the uniq and non-conflict datacenter id and ...
- 103
0
votes
0
answers
52
views
isolating user run scripts on docker without performance impact
Scenario:
We have a application (web based), in a small part of this application a users is able to create a small python script to mutate (in memory) data. Currently all of these scripts (if it is ...
- 383
0
votes
2
answers
196
views
Fault tolerance in aggregated distributed state
I have a scheduling system that is horizontally scaled, and stores shared state in a redis key.
The purpose of the system is to implement something similar to classic rate limiting, but a bit ...
- 21
0
votes
0
answers
76
views
Batch Processing to use multiple pods
We have a frontend application in React and a backend application in .NET Core which were deployed in a single Kubernetes cluster of 3 pods (it can autoscale). Before the application, we have a load ...
1
vote
2
answers
102
views
What is the starting point of a geo-distributed server farm?
Scenario:
A web application that wants to implement geographically high availability (HA), has multiple web servers in different cities around the globe. Each server is connected to a database in the ...
- 121
-2
votes
1
answer
91
views
How does one monitor the monitoring tools of a cluster?
We have a DB Service (Apache Druid) running along with prometheus,druid-exporter and Grafana deployments all being managed in the same namespace using k8s. We often see our prometheus or Grafana ...
- 45
0
votes
0
answers
92
views
How to manage configurations for on-premise kubernetes services?
I have a series of .NET kubernetes services that all need to retrieve dynamically a series of configurations from a database, since the deployment of this infrastructure is going to be on-prem for ...
- 207
0
votes
1
answer
492
views
Implementing active/standby pattern with Kubernetes
I have a replicaset with two pods in an onpremise kubernetes. Is it possible to setup an active standby setup so only one pod receive requests and the second one stay in standby mode and takes ...
- 183
0
votes
0
answers
96
views
sync over async in K8S
We build up a microservice architecture which is called from above by a REACT SPA. All is deployed in the AWS Cloud, that is to say in an AWS EKS (K8S). We have at most 600 users in parallel.
Do you ...
- 101
1
vote
1
answer
85
views
How to improve this synchronous job execution design?
Here is the design step by step:
User opens a webpage
Inputs few details in the form
Click submit
Request goes to API server
API server creates a pod in Kubernetes
Pod executes a script and stores ...
- 135
1
vote
4
answers
3k
views
Multithreaded processing of single REST requests
Background:
We're providing an API that provides information about all users within a given group. Our API is a high level facade over another low-level REST API.
To gather those information we first ...
- 213
0
votes
1
answer
274
views
Needed suggestions for key-value storage in Kubernetes
We have a requirement to store key value pairs (KVP) in Kubernetes and looking for possible options here. The requirements are as below:
KVP are small sized - 200 characters together.
KVP are short ...
- 101
0
votes
0
answers
43
views
Handling competing requests for the same "id" in different Kubernetes PODs
I have the following problem, I am implementing a delivery management service and a single order can be competed between N deliveryboys, this service is being executed on Kubernetes with 5 PODs of ...
-2
votes
1
answer
395
views
Ho do I implement Database per Service pattern in Kubernetes?
Assuming I wanted to implement the Database per Service pattern or one of its related patterns like Private-Tables-, Schema- or Database-server-per-service (https://microservices.io/patterns/data/...
Domino
0
votes
1
answer
44
views
How to check for docker specific code and APIs in an application for later migration to containerd?
So I have a couple of Java RESTful microservices, and since the past few years I have basically been using Docker to build them and deploy them over to a Kubernetes cluster.
Our team is upgrading ...
0
votes
0
answers
61
views
Do datacenters have conditions that might throttle component clock speed (either intentionally or automatically)?
Here is the question.
On a 2.2 GHz processor with 6 physical threads and 6 hyperthreads, I see performance on the order of 3-10s for a particular job involving OpenCV.
I do not specify that the ...
- 109
0
votes
0
answers
261
views
Managing concurrent TCP connections with Go, Docker and Kubernetes
I need to consume several APIs concurrently. In order to do that I decided to containerize each API client code and manage them using Kubernetes. Some of those APIs need to be "walked". They ...
- 101
0
votes
1
answer
56
views
How to design an application for stalling file processing?
I have an application that is receiving a live stream of files, I am using active MQ for listening to the file arrival in s3. As soon as the file arrives in s3 my application downloads the file and ...
- 1
-1
votes
2
answers
166
views
Delaying pods creation or recreating pods until tasks in other pods are completed
I need some help with better kubernetes resource deployment.
Essentially, I've 2 components. C1 and C2.
My task is to not deploy C2 pods or any resources until the tasks which are running in C1 are ...
- 1
2
votes
1
answer
2k
views
Kubernetes cronjobs - triggering one after another completes - best practice?
I have a micro-service based system running in kubernetes bare-metal. The key aspects are:
download data from a datasource nightly and add to a database
get any new data from the database, run a ML ...
- 21
0
votes
0
answers
43
views
Kubernetes auto scaling
We are currently in the process of doing an infrastructure overhaul.
A bit of background of what our business model currently is:
We are an aggregator of bills and payment services for businesses. ...
-2
votes
2
answers
147
views
Should servers exit with 0 or 1 in case of caught errors?
What is the best practice in case a service has an error which we caught and handled?
Do we exit code 1 or 0?
- 297
1
vote
2
answers
310
views
AWS Kubernetes - MySQL DB instance - RDS or Docker Mysql Image
We're trying to migrate to either a cheap hosting or aws Kubernetes to cut costs. Our website is a game site and has around 100 users. The servers include 2 mysql db, 2 tomcat server and a management ...
- 111
3
votes
1
answer
1k
views
Routing Kubernetes to Different Versions of an API
At a previous job, we had a lot of excessive issues with versioning of our APIs, to the point where we had whole server farms for our services that were running specific versions for specific ...
- 570
0
votes
1
answer
93
views
Distributed processing of a large number of queues
I have a rather basic application hosted on Kubernetes, which connects to a Mongo database.
The app has a wallet feature. A user can put money in their wallet using real-world payments (e.g. via ...
- 397
0
votes
3
answers
505
views
Is microservices architecture a good candidate for a pipeline?
I have a monolithic application which can be divided into multiple steps and different steps have variable scaling requirement, however the input of the next step is the output of the current step. ...
- 269
1
vote
0
answers
37
views
Supplying Kubernetes pods with data from a persistent volume and writing back
To keep it simple, I have this service that stores data in a persistent volume. There are pods that are created by an API which use a subset of the stored data to perform an operation and generate new ...
- 111
-3
votes
1
answer
2k
views
How to implement time triggered batch processing in a K8s/Java Spring Boot environment?
Environment:
Kubernetes Cluster with Spring Boot microservices.
One microservice contains a database with a date in one column of a read-only table.
Problem/Requirement:
When the date is reached, an ...
- 95
2
votes
0
answers
91
views
Initializing Cassandra schema
Recently I have started working on a project in which we are using Cassandra. It's a quite a new project, so we haven't decided how to initialize the schema.
We are using Docker and Kubernetes. I've ...
- 129
-1
votes
1
answer
197
views
Show a service's status to the user
Some design thoughts on an application that is mostly event driven using kubernetes and docker.
The application is a web based application, a single page one. It shows updates from the back-end such ...
- 477
2
votes
2
answers
896
views
Kubernetes Cron Job is expensive?
I have to implement a feature in an existing application, which requires calling an API every minute. My app's microservices runs in Kubernetes environment.
To achieve this, my first thought is ...
- 220
-2
votes
1
answer
77
views
What are the benefits of running Apache Spark on Kubernetes?
When running Apache Spark one submits jobs to a Cluster Manager. The cluster manager is delegated with the task of accepting / declining requests for resources. The cluster manager could either be ...
- 121
0
votes
2
answers
783
views
How to manage kubernetes configmap values in version control across environments?
I am looking for a way to automate deployment of configmaps to our dev/qa/prod environments. Right now our applications rely on kubernetes configmap/secrets that we manually apply in the cluster using ...
- 283
0
votes
0
answers
553
views
Sending and receiving data from a Kubernetes Job
I'm working on this containerized API where in two steps (one asynchronous and one synchronous) the user can interact with the output generated by the first step trough a front-end service.
I wasn't ...
- 111
0
votes
1
answer
636
views
What's a good liveness probe for a Hangfire background job server?
We're in the process of moving everything to K8s and one of our applications is a small .NET Core 2.2 console app that runs a Hangfire background job server. At the moment the app runs as a Windows ...
- 187
1
vote
1
answer
3k
views
Microservices and 3rd party APIs
I recently joined a team who is trying to use "microservice" pattern for their new application. They've already started to implement API's. In the end it should be an API for both mobile and web UI. I ...
- 137
-2
votes
1
answer
646
views
How microservices db are updated and sync when scale? [closed]
Scenario:
In Case I have MS "MS-1"
Orchestration detect high volume
Orchestration create additional node with cloned MS "MS-2"
"MS-2" get request and update its DB
Question :
How MS "MS-1" will ...
- 107
-1
votes
1
answer
161
views
Containers Across Operating systems
Curious how containers are portable across development/testing/cloud environments with no worry needed about the underlying infrastructure. Does the Docker Engine essentially standardize operating ...
1
vote
0
answers
179
views
Can/should multiple application contexts share a common microservice in a single namespace?
My current employer has a single namespace into which all microservices for all projects are deployed.
Projects A, B and C all use microservice x in this common namespace:
Rather than each design ...
- 261
3
votes
1
answer
131
views
Run a job every hour with Lambda or something else?
I am working on a SaaS project that will have a trial when the trial is ending I get a webhook notification when 3 days are remaining. I do some stuff with this and one of the things is I update user....
- 161
0
votes
0
answers
134
views
How can I economically scale to 100+ instances of my .Net Core app without using 1 container per instance?
Currently I have a .NET core application, which fires up a new thread to hold each customer account. Each thread instance:
Is long running for many months or more
Holds open SignalR Websockets and ...
- 101
-1
votes
1
answer
55
views
What happens to network connections to the web app running in a pod, when a pod is down in a Kubernetes node?
Each pod represents single instance of the web application in a node of Kubernetes.
Lets say 100 users are signed into a web app like Stackoverflow and connected to Pod1 of NodeA. Pod1 is down now. ...
- 101
-4
votes
1
answer
128
views
How was industry dealing with containerizations and container orchestration before Docker and Kubernetes? [closed]
Before Kafka, we had RabbitMQ, ActiveMQ etc.
Mostly there use to be a something before version, in technology.
But What was industry using something similar to Docker and Kubernetes, before they ...
- 101
2
votes
1
answer
256
views
About databases in docker containers
I'm trying to understand containerized apps and databases and I'm trying to understand the microservice architecture using kubernetes. One thing that I couldn't get my mind convinced is the database ...
- 249
5
votes
0
answers
210
views
What are best practices for deploying different configurations per environment in Kubernetes/OpenShift?
Kubernetes provides a very elegant mechanism for managing configuration for pods using ConfigMaps. What's not clear from the documentation is what the recommended practice is for using ConfigMaps to ...
- 151