Questions tagged [statistics]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
32 views

Weighted correlation coefficient

My problem is to classify input time series signal (128 points, equidistant in time, range 0.0..1.0) in limited amount (say 16) different classes. We have hand-classified 20000 samples and we are ...
1
vote
0answers
41 views

What algorithm to count user click/read/turnover for a period of time?

We tried to develop a kinda-real-time statistics module to measure how hot/trend a content is. We know it is hard to achieve high end stuff like youtube/FB/twitter, our goal is simpler : Count click/...
2
votes
2answers
131 views

How to get a useful measure for latency

I'm writing some web socket (wamp) connectivity tests. basically one end pings, and the other end records it. let's say I have the latency for each ping. So I'm tracking the min and the max latency ...
1
vote
1answer
51 views

Compare two arrays by the number of occurances

I have the following dictionary: { "Drama": 8, "Adventure": 8, "Action": 4, "Comedy": 3, "Thriller": 1 } This dictionary is like a representation of a user's preferences in movies. (in the past he ...
7
votes
2answers
486 views

FIFO Min-Max-Heap for Rolling Median

I'm working on a system with hard real-time constraints in c++ and I need a very fast way to calculate the rolling/moving/streaming median of a set of numbers of size N=100 to 300. Normally this size ...
0
votes
2answers
165 views

(AI) algorithm to optimize input parameters

Background information I am building a program that plays checkers as good as possible. It already plays pretty well but the goal is to improve it even more. This can be done by adding new methods ...
3
votes
1answer
2k views

How to perform data mining efficiently (in PHP)?

The moment of working on a system that gives you statistics based on some data gathered from the database has arrived in my company. How do you efficiently gather statistics from a database in such a ...
1
vote
2answers
663 views

Can I use statistical methods to compare benchmark performance figures?

Imagine I am working on a C compiler. I have made some changes to the compiler's code, and am interested to know what effect these changes have on the performance of generated binaries. I have a ...
2
votes
1answer
54 views

How to find most representative event for category?

Description I've got a series of events (points, objects, letters, what have you) that occur during a labeled time period (category.) Events can happen during multiple categories. I want to find the ...
5
votes
2answers
110 views

Estimate if benchmark sampling difference is significative

In order to estimate the fastest function in various cases in a non fully deterministic context, I'm running an experiment calling one or the other at random and recording the duration of the ...
0
votes
0answers
50 views

Alternative to Wilson Score when I only have the number of ratings and the average rating?

I'm getting a list of items from an external API and each item has a number of ratings and an average rating out of 5. What is the best way to rank them? Is it statistically sound to just convert an ...
5
votes
1answer
218 views

Algorithm for predicting outcome based on parameters

I've never done anything with statistics, so I'm unsure of how to start with this problem that I need to solve for some software that I'm working on. Basically, there are three parameters An integer ...
4
votes
2answers
150 views

Estimating in groups - How to extract useful statistics / estimates?

As many other projects we have to estimate our jira tasks up front. This is obviously not fun and I've started hacking on a simple webapp to "gameify" this tedious process. My idea is that an issue ...
4
votes
1answer
3k views

Oscillations detector: how to effectively detect oscillations of a variable?

I monitor a variable in real-time where new value is generated every 1/25 second. Depending on the conditions, this variable may either be stable, i.e. fluctuate a little (+/-1%) around some value (...
4
votes
2answers
314 views

Simplifying Some Probabilistic If-Then Spaghetti Code

I've got a fairly substantial code base that I'm trying to simplify. One section in particular deals with probabilistically creating objects. It currently uses hundreds of random number generator ...
0
votes
2answers
244 views

Advantage of non-deterministic staistical analysis?

I am working with a Java Library used for identifying the language of a given text. It relies on an n-gram analysis of the text to return a set of languages it might be and the "confidence" that it ...
5
votes
2answers
133 views

When designing a replacement application, how can I compare its performance to the original, if there are no existing statistics?

I don't believe there are any performance statistics kept for the application I'm being asked to replace, and don't want to ask the individuals doing the work to manually record things like how long ...
2
votes
0answers
612 views

PHP MySql - Statistical Reporting - Best Approach to query appointment system time utilization

I have built an appointments system for various medical practices. Practice schedule appointments - I am looking to provide analysis on the amount of time that has been utilised by the practice. I ...
0
votes
1answer
166 views

Does it make sense to express reliability as a ratio of number of tests and system failures? [closed]

I have seen a reliability of the system expressed like this: Rel=No of tests executed / Sum of crashes or other critical events Does it make sense and what actually is the output?
0
votes
2answers
244 views

Permutation tests for large sequences

I would like to perform a permutation test on a particularly large data set, i.e. around 4 million entries. Basically, I need to get some number of random permutations of this data set. Usual way to ...
2
votes
3answers
865 views

Count unique visitors by group of visited places

I'm facing the problem of counting the unique visitors of groups of places. Here is the situation: I have visitors that can visit places. For example, that can be internet users visiting web pages, ...
0
votes
2answers
2k views

Word recognition in a string without spaces or punctuation marks

I have a small C# project that reads a file and gives me an output: a string that does not contain spaces nor any types of punctuation marks. It may also contain a few misspellings. Ex. Output: ...
1
vote
1answer
533 views

Is it possible to get probabilities from a support vector machine?

From what I understand, SVM's take a discrete number of x and y values from which to learn from, then when given new x values map it to one y value (category). Is it possible to use SVM's or something ...
0
votes
1answer
575 views

scipy.stats.percentileofscore() wrong?

i'm a data scientist and python noob, but I seem to have found a bug with scipy.stats.percentileofscore. it may be "by design" but please bear with me. if you have an array, you will get an upper ...
0
votes
1answer
800 views

How do I mutate a value in a genetic algorithm using Gaussian distribution?

I've been reading 'Introduction to Evolutionary Algorithms'. This method is stated, but not described, and I can't find anything more specific online. p44/45 of 2nd Ed for reference. adding to the ...
3
votes
6answers
462 views

Unit Testing with an Optimization Problem

Suppose I'm making an algorithm that identifies the subject of a picture. It could be anything that a computer doesn't do that well, but I'm not expecting to get the right answer every time - 80% is ...
1
vote
1answer
163 views

Even distribution through a chain of resources

I'm working on an algorithm which routes tasks through a chain of distributed resources based on a hash (or random number). For example, say you have 10 gateways into a service which distribute tasks ...
3
votes
1answer
676 views

How to do inference in a card game?

In the game there are 5 players, each with 8 cards in hand. No other card is present. Using Monte Carlo (MCTS) I run many simulations of the game from the current state to the end of the match. In ...
0
votes
0answers
340 views

Algorithm for generating hyperexponential distribution

I need to generate a hyperexponential distribution for my project. I have already implemented a poisson generating algorithm given by Donald Knuth, but I couldn't find an algorithm for generating a ...
4
votes
1answer
592 views

Algorithm, AI, or intelligent agent suggestions for ingesting poorly-formatted & variable data from different document types

Thanks for looking! Background I have been tasked with writing a program to normalize and ingest data from various sources to a common database. For the sake of simplicity, let's say that the ...
1
vote
2answers
1k views

Statistics collection engine for C++ systems

We have a research project with idea->prototype->statistics development cycle. Anyway, our final product is a prototype, so the statistics collection suite is not used persistently. Supposing I have ...
3
votes
2answers
159 views

Randomness of wrapped RNG

There are plenty of questions around regarding random number generation, but I couldn't find anything that exactly matched my question. Apologies if I missed one. Most random number generators in ...
4
votes
4answers
357 views

Is code that terminates on a random condition guaranteed to terminate?

If I had a code which terminated based on if a random number generator returned a result (as follows), would it be 100% certain that the code would terminate if it was allowed to run forever. while (...
4
votes
1answer
118 views

Statistical Software Quality Control References

I'm looking for references about hypothesis testing in software management. For example, we might wonder whether "crunch time" leads to an increase in defect rate - this is a surprisingly difficult ...
4
votes
2answers
1k views

statistics for checking imported data?

I'm working on a data migration of several hundred nodes from a Drupal 6 to a Drupal 7 site. I've got the data exported to the new site and I want to check it. Harkening back to my statistics classes, ...
0
votes
3answers
2k views

Get system info from C program?

I'm writing a little program in C that I want to use to output some system stats to my HD44780 16x2 character display. The system I'll be working with is a Debian ARM system and, although irrelevant, ...
10
votes
1answer
15k views

Programming language trends

Are there some statistics out there that show the approx. number of users that popular programming languages have and the rate this number increases over time?
0
votes
2answers
371 views

why is a naturally ordered set generated at 9 but not 10 digits

code found at: https://softwareengineering.stackexchange.com/q/158606/44933 Presuming that the problem indicated above is due to the test app and not due specifically to method generateRandomDigits()....
7
votes
2answers
87 views

Testing applications with statistical features [duplicate]

Possible Duplicate: How should I test randomness? Are their some techniques described for testing applications that have as a requirement some statistical or probabilistic features? They may for ...
0
votes
1answer
654 views

Impact of Website Redesign on Google Analytics

I just finished a redesign for a website that is currently using Google Analytics. I want to continue to use Google Analytics, but I'm not sure if I should create a new profile for the new site or ...
11
votes
4answers
10k views

Google Analytics with multiple environments

We are planning to use Google Analytics in our organization and I am in charge for setting it up. I was wondering how to deal with multiple environments. We sure do not want to collect data during ...
2
votes
1answer
414 views

Calculate statistics for web application

I'm planning to add a couple of usage statistics to my web application. Some common things like: registered users, amount of comments/posts, etc. over time (last 24 hours / last week / last month / ...
14
votes
4answers
19k views

Where can I get a diverse set of sample text? [closed]

I am trying to gather statistics on character or word sequences used in the English language for use in a software project. Where can I can get a large amount (several GB would be nice) of English ...
3
votes
2answers
220 views

Google Analytics and customers privacy

I work in a company that sells SaaS web applications for HR and financial issues. Our customers are key accounts to which we guarantee the privacy of their data, for obvious reasons. We need to make ...
5
votes
2answers
944 views

What kind of metrics should I collect for a website/web app

I have a website that allows users to register for accounts, login, and renew an annual membership fee. They can also update their personal profile, their personal profile, look at a list of their ...
7
votes
6answers
2k views

Are 70% of programs/business applications/something based in COBOL? [closed]

I heard this number and a quick google search reveals a whole lot of touting this number and absolutely zero data (honestly most articles promoting COBOL read like 95% propoganda). Perhaps it's true ...
2
votes
1answer
318 views

Incanter for real world statistical projects [closed]

I'm interested in statistical computing. R is a leader platform obviously but what about Incanter? Incanter is at the top of my list since I'm a Clojure and JVM guy. Do you have any real world ...
4
votes
3answers
3k views

distribution of programming languages in embedded systems

I am looking for statistics concerning the distribution of programming languages in the embedded sector. Do you know any good websites, articles or books? I found this as a first reference but am ...
11
votes
9answers
1k views

Learning the rules of chess

A similar question asks whether a computer can learn to play optimally in chess by analyzing thousands of games. If a machine can look at the state of the board for a few games of chess (or a few ...
1
vote
3answers
3k views

Debugging Facts and Statistics [closed]

I'm trying to find a research answering a question: "How much time developers spend on development vs debugging?". I found several interesting links on the Net but they are little too old. This 2002 ...