Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [benchmarking]

The tag has no usage guidance.

2
votes
3answers
200 views

Comparison of build times on various hardware; why non-linear results?

Why do the compile times not vary significantly between different era CPUs, even though disk (NVMe vs. HDD) and CPU benchmarks vary significantly in performance? Why does disabling hyperthreading ...
2
votes
0answers
55 views

How to write disk benchmarking software?

I am coding a disk (HDD/SSD) benchmarking software. I have a few questions on how a disk should be benchmarked (regardless of programming language used). This is my pseudo code for testing sequential ...
1
vote
2answers
216 views

How to benchmark software performance under same conditions (RAM, CPU caching etc)?

I am writing a software that splits big files into smaller files and I have coded several solutions. I am measuring the execution time of each of my solutions. (with threads, go routines, MPI etc) ...
-3
votes
1answer
74 views

Handling different versions of a program and benchmarking with OO

Note: I'm not sure if the way I phrase the question initially will fit 100% on this board, so please help me to focus on the main point. Scenario: You develop an algorithm or a neural network that ...
2
votes
1answer
196 views

How do I triage a website effectively?

I've inherited responsibilities for maintaining a section of enterprise intranet, and my manager has tasked me with, "Clean up the code, please. We're probably going to get lots of change requests ...
3
votes
1answer
181 views

How to compare C and CUDA performance fairly?

I have developed a CUDA code that is a reimplementation of a (CPU only) C code. I would like to benchmark the performance of these two programs. I am wondering how to do benchmarking well in this ...
1
vote
2answers
546 views

Can I use statistical methods to compare benchmark performance figures?

Imagine I am working on a C compiler. I have made some changes to the compiler's code, and am interested to know what effect these changes have on the performance of generated binaries. I have a ...
1
vote
1answer
165 views

How to manage code experiments meant to stay permanently with git?

I have an asm/C code which implements some image filters. The objective of this project is experimentation with different implementations, benchmarking, plotting and reporting data to write a paper ...
6
votes
2answers
109 views

Estimate if benchmark sampling difference is significative

In order to estimate the fastest function in various cases in a non fully deterministic context, I'm running an experiment calling one or the other at random and recording the duration of the ...
3
votes
1answer
1k views

Load testing HTTP server with large number of concurrent connections

I'm trying to load test/benchmark a http server with a very large number of simultaneous connections (10-100k). What is a good procedure for doing this? On linux I've seen that both the client and ...
1
vote
1answer
365 views

When do micro-benchmarks make sense? [closed]

I've been researching micro-benchmarks (e.g. using JMH or Caliper, though not necessarily limited to Java). Now, there are many articles which describe how to write a benchmark but I haven't found ...
0
votes
5answers
9k views

Why Java is a factor 2-3 slower than equivalent C++ program? [closed]

I know there is an opinion that programs written in Java and running under JVM as as fast as C++ programs, after introducing just-in-time (JIT). I see many cases when Java is terribly slow for simple ...
7
votes
2answers
2k views

Where is the evidence for the performance of Node.js?

A lot of developers, especially ones who haven't used Node.js in production, seem to believe that Node.js is faster than other interpreted languages such as PHP, Python, and Ruby. These claims ...
3
votes
3answers
566 views

How does a software developer know if the target hardware is fast enough to run the software? [duplicate]

How do software developers manage to know if their software will run on the target hardware they are developing to? Many developers today work on machines much faster than the intended platform. What ...
1
vote
2answers
149 views

Should benchmarks (to compare processors performance) be compiled with optimization CFLAGS?

I need to compare performance of 2 processors and I concluded I should benchmark then with several various tests. I'm currently using linpack (HPL) (because it's still well known and used for ...
1
vote
2answers
1k views

Dual pivot quicksort in face of expensive swaps

I was told this is better place to ask this TLDR Has anyone tested dual pivot quicksort performance with expensive-to-swap elements? It seems that in this case, it should massively underperform ...
0
votes
1answer
207 views

Huge long addition overhead compared to Native call?

A run a simple test JDK 1.7.0_45 (Windows 7, 64bit): Test 1: long start = System.nanoTime(); for (int i=0; i < 1000000; i++) { System.currentTimeMillis(); } elapsed = System.nanoTime() - ...
1
vote
4answers
269 views

Track performance numbers

I have a (large) software project in a git repository. There is a benchmark suite that spits out lots of numbers (time per benchmark, allocations done per benchmark) I’d like to track. What is the ...
1
vote
1answer
8k views

Why execution time is different each time in java?

I am trying to make a program in Java which measure the complexity of a specific program with respect to its run time. Let's take a problem and code that problem in all possible ways with respect to ...
-1
votes
1answer
103 views

What do I benchmark before updating a web site? [closed]

I am volunteering my time to update a website for a local business. The current website they have is not up to date and it fails quite a few "web tests". For example, the pages are too large, the ...
2
votes
0answers
406 views

Repeatability of CPU-intensive benchmarks on NUMA hardware

Consider a benchmark of a C++ application. It does little or no I/O in proportion to its overall runtime -- it is compute-intensive. It is a single-threaded program. It pages/reads in all of its data ...
18
votes
3answers
13k views

Fastest Functional Language

I've recently been delving into functional programming especially Haskell and F#, the prior more so. After some googling around I could not find a benchmark comparison of the more prominent functional ...
5
votes
8answers
2k views

If python compiles to assembly and an OS is written in it, will it compete favorably with C in benchmarks?

Ok, I have used the word python in the question, but it well could be language agnostic in that: If a language X has a well optimised compiler targeting assembly and an OS is written in that language, ...
4
votes
2answers
2k views

How to test the render speed of my solution in a web browser?

Ok, I need to test the speed of my solution in a web browser, but I have some problems, there are 2 versions of the web solution, the original one that is on server A and the "fixed" version that is ...
5
votes
3answers
421 views

Is running “milli”-benchmarks a good idea?

I just came across the Caliper project and it looks very nice. Reading the introduction to microbenchmarks, one gets the feeling that the developers would not suggest to use the framework if the ...
4
votes
2answers
350 views

Benchmarking CPU processing power

Provided that many tools for computers benchmarking are available already, I'd like to write my own, starting with processing power measurement. I'd like to write it in C under Linux, but other ...
5
votes
1answer
193 views

Use of a profiler tool to aid in the analysis of a brute force algorithm in Java

I was asked to profile (using some tool, such as YourKit or JVisualVM) a couple of implementations of the Traveling Salesman Problem (find the minimum path that visits all the given set of cities), in ...
4
votes
3answers
675 views

Question about a “Benchmark” regarding Java and .NET

To get that out of the way - i am not asking about which platform is faster or try to start a flame war. Question: Why is the .NET version slower 5x in the first test ? The results i got were: .NET ...
13
votes
4answers
5k views

Benchmarking databases

I see lots of discussions flying around about performance of db 'x' or that moving from 'x' to 'y' improved our site performance. I'm yet to see proper benchmarking that works across different types ...
2
votes
4answers
2k views

Measures of Javascript engine performances over time? [closed]

Since the beginning of the Javascript race -- which I would situate around Google Chrome launch in 2008 -- the improvement in the Javascript engine performances have been impressive. The web is ...
7
votes
5answers
1k views

Does profiling without benchmarking lead to micro-optimization?

Read first: For a definition of the two terms ("profiling" and "benchmarking") and the need for distinguishing them, please read this answer to a previous question. I have to admit that until I saw ...
1
vote
1answer
202 views

benchmarks for quasi real-time software

I'm wondering if there is any benchmarks which can help to understand real-time characteristics (response time) of non-real-time software. For instance C# application on Windows or MSSQL Server. I ...
21
votes
3answers
10k views

Does anyone do hardware benchmarks on compiling code? [closed]

I've seen a bunch of sites that benchmark new hardware on gaming performance, zipping some files, encoding a movie, or whatever. Are there any that test the impact of new hardware (like SSDs, new CPUs,...
3
votes
2answers
857 views

What will be a good python script (or your favorite language goes here) to test a system's performance and capabilities?

Let's say you're in a computer store looking at 10 laptops, you want to really compare the system's capabilities. What will be an efficient "your fav language goes here" script that will allow you to ...
2
votes
2answers
261 views

Which benchmarking software would you use to evaluate the performance of your development rig?

I have been tasked with evaluating a new PC for our dev team that is spec'd only slightly better than our current models. Could anyone recommend appropriate benchmarking software that would be ...
3
votes
2answers
164 views

Do system background services affect languages benchmarking?

Today I was looking at some blogs on Ruby and Python. A Python loyalist wrote a few lines of code with a loop to show how Python is faster than Ruby, with a similar code. I also found a blog of a Ruby ...