Skip to main content
Share Your Experience: Take the 2024 Developer Survey
22 votes
Accepted

How to handle backpressure in message queue

A good analogy here is to think of a dam on a river. The river corresponds to the incoming data, and the dam to your consumer. There are three possibilities at any given point: The incoming river's ...
JimmyJames's user avatar
  • 27.5k
4 votes

Do Lambdas(AWS) stop making sense after a certain number of functions?

Working with Lambdas really requires some deployment automation tooling to manage all of these things for you. At my last job, we used Serverless Framework, but after a year I was starting to feel ...
Scott Simontis's user avatar
4 votes

How to handle backpressure in message queue

How throttling helps to solve backpressure problem? If the TPS is consistent, Wouldn't it create the same problem even when producer retry after delay? At the end some producers will exhaust retries ...
Useless's user avatar
  • 12.6k
4 votes

JAMstack vs Serverless architecture: what's the difference?

I think you misunderstand the concept of 'Serverless' technology. IMO it's a very misleading and confusing name so you are not alone in this. using JavaScript and APIs (serverless). Using ...
JimmyJames's user avatar
  • 27.5k
3 votes
Accepted

Scheduled AWS Lambda to Update Database via API Call

You should probably look over this: AWS lambda best practices. The first bullet is one thing you should definitely consider: Initialize SDK clients and database connections outside of the ...
JimmyJames's user avatar
  • 27.5k
3 votes

Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?

I believe there is a 6Mb limit on the request/response, which would make it unsuitable. https://docs.aws.amazon.com/lambda/latest/dg/limits.html Ideally you want a resumable stream of data for large ...
Ewan's user avatar
  • 76.4k
2 votes
Accepted

The right way of doing images manipulation in a serverless app

One thing I've learned early on doing these sorts of complicated procedures is to clearly name and record the steps taken thus far. If something goes wrong (and something will), you want to ...
Neil's user avatar
  • 22.7k
2 votes

What is "serverless mesh"?

I'm wondering if this was someone's mash up of "service mesh," and "serverless." As mentioned in the comments, both of these terms are used more than understood. To clarify though, you run a service ...
Robert Houghton's user avatar
2 votes

Do Lambdas(AWS) stop making sense after a certain number of functions?

AWS Lambdas never made any sense. Or perhaps I should say "serverless applications" never made any sense. Because it seems to me that's what you are doing, moving application code to lambdas ...
Ewan's user avatar
  • 76.4k
1 vote

Do Lambdas(AWS) stop making sense after a certain number of functions?

It's true that lambdas can save hosting costs for low- and medium-traffic apps. You don't have to have a zillion separate lambdas and a deployment nightmare for your little app, though. There is no ...
Quitting Due To Antisemitism's user avatar
1 vote

Git structure for Azure Function Apps that accounts for shuffling functions

How much gets put in a repository depends on the scope of changes. As you have discovered, when the scope of necessary changes requires code beyond the repository, then things get complicated. That ...
Greg Burghardt's user avatar
1 vote

How to build an event sourced system with AWS (Specifically, how to deal with side effects)

I believe that the usual practice is to write messages to SNS topics at the time you put interesting changes into DyanmoDB. If I'm understanding correctly this is a hybrid of your ideas B and C. ...
VoiceOfUnreason's user avatar
1 vote

RESTful URLs for multiple resource in the same Microservice

We are developing a serverless application (AWS API Gateway, Lambda, and Dynamo) keeping users and groups in the same microservice as they are being stored in the same DynamoDB table. Is it okay to ...
VoiceOfUnreason's user avatar
1 vote

RESTful URLs for multiple resource in the same Microservice

No, its a pain in the arse to parse the ids out of the string afterwards. Which you often want to do for logging or routing. Try and keep the depth and the syntax of your Urls constant groups/get/{id} ...
Ewan's user avatar
  • 76.4k
1 vote

AWS Serverless Microservice design

As mentioned, SQS might be a good option for better ensuring the processing of messages from your project updates. This would make the architecture more fault tolerant since the consuming Lambda needs ...
LikeLikeAteMyShield's user avatar
1 vote

AWS Serverless Microservice design

You could add onto this design by subscribing an SQS Queue to an SNS Topic that would then trigger a Lambda function. The SQS would handle the Queuing of notifications into the Lambda. You would also ...
ilminternational's user avatar
1 vote

Serverless game server architecture

In AWS when you want to orchestrate this sort of thing, you want to look at using Step Functions. You can create the game event state machine with Step Functions.
RibaldEddie's user avatar
  • 3,283
1 vote

pub/sub events to/from microservices in different languages

I think your question covers too many topics and it isn't quite clear what you want to know really. I'll try anyways. For context, the Pub/Sub solution I'm more used to is the one provided by Google ...
Gabriel Pires's user avatar
1 vote
Accepted

Confused about AWS dev: How to use React with Python in my lambda functions?

It sounds like you want to submit a form from your front end. I don’t know how React works, but they probably POST the form data to an endpoint you specify, and they probably let you choose between ...
Rohit Chatterjee's user avatar
1 vote

Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?

If you know the limits on the response then you can use aws lambda but also make sure you know how to handle the situtation when aws lambda timed out because of reasons out of your control. How would ...
Ankur Kothari's user avatar
1 vote
Accepted

Are AWS Lambda functions a good fit for the use case of fetching huge amount of records from database on User request?

Sounds like a possible use case but it really depends on the type of database, how much data you're returning and if the hard limits on AWS services prohibit the use of API Gateway/Lambda. SQL ...
Fernando's user avatar
  • 126
1 vote

How should AWS Lambda functions subscribe to domain events?

We do some event processing at very low scale using AWS and a "push" model. Roughly, the design looks like this: SNS is used by a publisher to `fan-out` SQS is used by a subscriber to `fan-in` ...
VoiceOfUnreason's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible