22
votes
Accepted
How to handle backpressure in message queue
A good analogy here is to think of a dam on a river. The river corresponds to the incoming data, and the dam to your consumer. There are three possibilities at any given point:
The incoming river's ...
- 28.5k
4
votes
Do Lambdas(AWS) stop making sense after a certain number of functions?
Working with Lambdas really requires some deployment automation tooling to manage all of these things for you. At my last job, we used Serverless Framework, but after a year I was starting to feel ...
- 141
4
votes
How to handle backpressure in message queue
How throttling helps to solve backpressure problem? If the TPS is consistent, Wouldn't it create the same problem even when producer retry after delay? At the end some producers will exhaust retries ...
- 12.7k
4
votes
JAMstack vs Serverless architecture: what's the difference?
I think you misunderstand the concept of 'Serverless' technology. IMO it's a very misleading and confusing name so you are not alone in this.
using JavaScript and APIs (serverless).
Using ...
- 28.5k
3
votes
Accepted
Scheduled AWS Lambda to Update Database via API Call
You should probably look over this: AWS lambda best practices. The first bullet is one thing you should definitely consider:
Initialize SDK clients and database connections outside of the ...
- 28.5k
3
votes
Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?
I believe there is a 6Mb limit on the request/response, which would make it unsuitable.
https://docs.aws.amazon.com/lambda/latest/dg/limits.html
Ideally you want a resumable stream of data for large ...
- 78.5k
2
votes
Accepted
The right way of doing images manipulation in a serverless app
One thing I've learned early on doing these sorts of complicated procedures is to clearly name and record the steps taken thus far. If something goes wrong (and something will), you want to ...
- 22.8k
2
votes
What is "serverless mesh"?
I'm wondering if this was someone's mash up of "service mesh," and "serverless." As mentioned in the comments, both of these terms are used more than understood.
To clarify though, you run a service ...
- 131
2
votes
Do Lambdas(AWS) stop making sense after a certain number of functions?
AWS Lambdas never made any sense.
Or perhaps I should say "serverless applications" never made any sense. Because it seems to me that's what you are doing, moving application code to lambdas ...
- 78.5k
1
vote
Do Lambdas(AWS) stop making sense after a certain number of functions?
It's true that lambdas can save hosting costs for low- and medium-traffic apps.
You don't have to have a zillion separate lambdas and a deployment nightmare for your little app, though. There is no ...
- 4,907
1
vote
Git structure for Azure Function Apps that accounts for shuffling functions
How much gets put in a repository depends on the scope of changes. As you have discovered, when the scope of necessary changes requires code beyond the repository, then things get complicated. That ...
- 40.8k
1
vote
How to build an event sourced system with AWS (Specifically, how to deal with side effects)
I believe that the usual practice is to write messages to SNS topics at the time you put interesting changes into DyanmoDB.
If I'm understanding correctly this is a hybrid of your ideas B and C. ...
- 33.4k
1
vote
RESTful URLs for multiple resource in the same Microservice
We are developing a serverless application (AWS API Gateway, Lambda, and Dynamo) keeping users and groups in the same microservice as they are being stored in the same DynamoDB table.
Is it okay to ...
- 33.4k
1
vote
RESTful URLs for multiple resource in the same Microservice
No, its a pain in the arse to parse the ids out of the string afterwards. Which you often want to do for logging or routing.
Try and keep the depth and the syntax of your Urls constant
groups/get/{id}
...
- 78.5k
1
vote
AWS Serverless Microservice design
As mentioned, SQS might be a good option for better ensuring the processing of messages from your project updates. This would make the architecture more fault tolerant since the consuming Lambda needs ...
1
vote
AWS Serverless Microservice design
You could add onto this design by subscribing an SQS Queue to an SNS Topic that would then trigger a Lambda function. The SQS would handle the Queuing of notifications into the Lambda. You would also ...
1
vote
Serverless game server architecture
In AWS when you want to orchestrate this sort of thing, you want to look at using Step Functions. You can create the game event state machine with Step Functions.
- 3,293
1
vote
pub/sub events to/from microservices in different languages
I think your question covers too many topics and it isn't quite clear what you want to know really. I'll try anyways.
For context, the Pub/Sub solution I'm more used to is the one provided by Google ...
- 121
1
vote
Accepted
Confused about AWS dev: How to use React with Python in my lambda functions?
It sounds like you want to submit a form from your front end. I don’t know how React works, but they probably POST the form data to an endpoint you specify, and they probably let you choose between ...
- 146
1
vote
Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?
If you know the limits on the response then you can use aws lambda but also make sure you know how to handle the situtation when aws lambda timed out because of reasons out of your control. How would ...
- 111
1
vote
Accepted
Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?
Sounds like a possible use case but it really depends on the type of database, how much data you're returning and if the hard limits on AWS services prohibit the use of API Gateway/Lambda.
SQL ...
- 126
1
vote
How should AWS Lambda functions subscribe to domain events?
We do some event processing at very low scale using AWS and a "push" model. Roughly, the design looks like this:
SNS is used by a publisher to `fan-out`
SQS is used by a subscriber to `fan-in`
...
- 33.4k
Only top scored, non community-wiki answers of a minimum length are eligible