Questions tagged [high-performance]

The tag has no usage guidance, but it has a tag wiki.

1
vote
1answer
87 views

Is Web API suitable as services for IoT?

The issue I care about here is high throughput, there are a lot of sensors (monitoring devices) which send data to the server at high frequency. It looks really like that we have to use UDP protocol ...
3
votes
1answer
87 views

Architecture for Large-Scale Matrix Multiplication: Distributed Architecture or One Strong Server

I've asked a question about Scaling Matrix Multiplication by CPU Cores on StackOverflow and it seems that merely adding more CPU cores to this problem won't reduce the time to do Matrix ...
3
votes
1answer
445 views

What can be the design of a distributed high available trade exchange?

I am working on design of a financial xchange system and especially the order-matching part. I couldn't find a clear/complete design article especially for scalable/high available order-maching ...
2
votes
2answers
147 views

In app development is it common to first write your app in a high level language, then rewrite it in a low level language?

Maybe I have misunderstood this concept. But is it common, when developing the backend to an app, mobile or web. To first write it in a high level programming language such as php, python, javascript ...
2
votes
1answer
154 views

Large Scale Machine Learning vs Traditional HPC Hardware

I've spent the last few days working with tensorflow for the first time as part of a natural language processing assignment for my degree. It's been interesting (fun isn't the right word) trying to ...
0
votes
4answers
593 views

Is there a way to see how many operations a function, block of code or a statement costs?

Let's say I have a phone that can process 1 million operations per second and a micro controller that can perform 1000. Is there a way to tell how many operations a performed by a function or block ...
3
votes
2answers
196 views

Receiving lots of records and storing them in a database in a short time frame

A colleague has challenged me with an interesting question. To be honest I have no idea how to deal with it. Suppose the following: Every 5 minutes you get a new file with one hundred thousand ...
-2
votes
1answer
108 views

CAP Theorem x Load Balance / Failover x Availability

My understanding is that the system below can accomplish consistency, availability and partition tolerance. So I must be misinterpreting some aspect of the CAP theorem. How come? Let's say I have a ...
1
vote
1answer
640 views

How to test software with near-real-time requirements?

So, I've been refactoring my videoconferencing application for a while, covering it with unit and general tests. Finally, I got to the point where I need to write a loopback test with 1 client sending ...
2
votes
2answers
1k views

Code size overhead by including unnecessarily extra header files

I have a program which includes lots of header files but it do not uses all the header files. I have removed some of them although it is working fine. I did not notice any changes in the performance. ...
4
votes
1answer
184 views

Refactoring numerical code for TDD and encapsulation

I am coming to terms with TDD, and the fact that I need to re-factor some code that I'm (re)writing. I am having a problem that I think is a classic conflict---TDD vs. encapsulation of private methods/...
5
votes
2answers
5k views

What is a latency-bound and a memory-bound application in HPC?

I understand that in HPC hybrid systems, for instance a MIC architecture, main memory access is much slower than access to data in own cache or in the cache of another core. I read that HPC MIC ...
0
votes
1answer
208 views

Huge long addition overhead compared to Native call?

A run a simple test JDK 1.7.0_45 (Windows 7, 64bit): Test 1: long start = System.nanoTime(); for (int i=0; i < 1000000; i++) { System.currentTimeMillis(); } elapsed = System.nanoTime() - ...
6
votes
4answers
2k views

Design of high performance file processing web application

I'm trying to design a web app with ability to scale but can't wrap my heads around few concepts. I want to design it right but im not a experienced programmer, i have more of a system engineering ...
3
votes
2answers
226 views

What is a scalable and practical way to search existence of a group of strings in a huge file

Context: I built an app which generates around 1000 domain names based on user input. I need to check if they are available or not by matching against a huge zone file of parsed domain names which is ...
1
vote
2answers
620 views

Socket Connection Data Insert

I have been working through a high-performance application where I have identified a bottleneck. The bottleneck is actually when the application must insert messages from a socket, it will record them ...
6
votes
4answers
860 views

Trying to get a better understanding of object-oriented design's performance pitfalls

I'm currently in a high-performance computing class taught in C++. Usually, I do work in C#, meaning everything is taken care of for me, and optimization comes behind maintainability and higher-level ...
0
votes
0answers
68 views

Help in finding the total time taken by the entire production?

I have a line object and each line object has an array of tasks associated with it.Each task has a start time and an end time.Each task also has a list of tasks which are its predecessors. So if all ...
5
votes
2answers
6k views

DbFirst vs Code First? what should I use if I rely on Stored procedures

This question is asked many times, and I always prefer code-first as I like to keep the logic in code. But now I have a challenge to load screen under 5 seconds and very little time to do things. I ...
2
votes
1answer
935 views

High performance and/or real time java open source applications [closed]

Which open source java projects do you know to be high performance or real time performance? I tried hard to find them on github or google, but couldn't find suitable. I want to learn from this ...
3
votes
2answers
2k views

clojure/erlang/go for high volume server

I have a project that will need to handle 1000s of requests a second with a decent amount of processing for each. For the most part, the processing will be done on a list of items, basically ...
-2
votes
1answer
1k views

How do I create a web service with high amounts of traffic that works effectively with lots of different users? [closed]

I have created web services before that are used by a small number of users but have a new project that would have lots of users. For each user that uses the services, this is what they would do: 1) ...
6
votes
5answers
3k views

Cpu-heavy web server

When reading about web servers, frameworks, etc most of the time I notice that the goal is to have a technology that has the next features: Able to handle as many connections as possible. Fit an I/O ...
10
votes
1answer
660 views

Random Cache Expiry

I've been experimenting with random cache expiry times to avoid situations where an individual request forces multiple things to update at once. For example, a web page might include five different ...
106
votes
10answers
77k views

Why is Python used for high-performance/scientific computing (but Ruby isn't)?

There's a quote from a PyCon 2011 talk that goes: At least in our shop (Argonne National Laboratory) we have three accepted languages for scientific computing. In this order they are C/C++, ...