Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data-mining]

Data mining is the process of locating patterns and trends within a given data-set, that may not be immediately obvious or intuitive.

0
votes
1answer
62 views

Lightweight data mining + organization & visualization

I'm looking to do some simple data mining that consists of going once per day to a single page and collect the following information: List of movie theaters Movies today on each theater Session times ...
0
votes
1answer
194 views

CRISP-DM, which phase and tasks relate to User Acceptance Testing?

EDIT: The project is about creating an algorithm for Procedural Content Generation for a videogame. The actual game is secondary to the algorithm. It must be something basic to test the Procedural ...
1
vote
1answer
501 views

Distinction between AI, ML, Neural Networks, Deep learning and Data mining

I have recently started exploring the field of machine learning (ML). I think I understand the difference between ML and AI at high level, but I wanted to understand more accurately the differences ...
3
votes
1answer
2k views

How to perform data mining efficiently (in PHP)?

The moment of working on a system that gives you statistics based on some data gathered from the database has arrived in my company. How do you efficiently gather statistics from a database in such a ...
2
votes
0answers
76 views

mining (& searching in) github projects

Is there any way to find every github project which: is GPL licensed has over one million lines of C++ code I am imagining that the Github API was designed to automate such requests, but I am not ...
16
votes
2answers
608 views

How to find hard to misspell given names?

Here is a question that I believe could be solved with some data mining and a sophisticated algorithm, but I don't quite know how. Any pointers as to what data sources to use and what algorithm to ...
1
vote
1answer
59 views

Efficiently determining many-to-many subset relation

I'm doing market basket analysis. I have a set of transactions. Every transaction is a set of items that were bought. I then have a set of itemsets (i.e. a set of items) that I want to determine the ...
1
vote
1answer
457 views

Recommending new products using k-means clusters?

I'm trying to figure out the best way to recommend images based on past classifications using k-means clusters. What I have done is mapped the RGB values of a set of images, performed a k-means ...
2
votes
0answers
252 views

How do I visualise the feature space partitioning in random forest?

I am learning about random forest and found this video https://www.youtube.com/watch?v=gdnIqGbqiYs&list=UUb9svouAi1XHRqlOs8LXbBg very useful. The first 8 minutes explain how to visualise how the ...
1
vote
2answers
255 views

How do I find the JavaScript that is invoked when I click on a button or a link in a web-page (part of a data mining project)?

I tried to use the 'inspect element' of the firebug addon for Firefox but it doesn't give me any link to the javascript. For example I got this from the firebug add-on: <a href="javascript:"> ...
0
votes
2answers
796 views

Algorithm for optimal combination of two variables

I'm looking for an algorithm that would be able to determine the optimal combination of two variables, but I'm not sure where to start looking. For example, if I have 10,000 rows in a database and ...
-1
votes
2answers
689 views

Determine Cluster Label in K-means

I have dataset that is contain 150 data that is actually divided into 3 group. Each group has it’s own label. I do clustering process with K-means algorithm to group the data. I need to assign the ...
0
votes
2answers
2k views

Word recognition in a string without spaces or punctuation marks

I have a small C# project that reads a file and gives me an output: a string that does not contain spaces nor any types of punctuation marks. It may also contain a few misspellings. Ex. Output: ...
1
vote
1answer
2k views

Beginning Data Mining

For simplicity, my database has entities and transactions. Each transaction has a DateCreated and a foreign key to the entity. I'd like to have the ability to find entities that have had a recurring ...
0
votes
2answers
87 views

Cleaning a dataset of song data - what sort of problem is this?

I have a set of data about songs. Each entry is a line of text which includes the artist name, song title, and some extra text. Some entries are only "extra text". My goal is to resolve as many ...
6
votes
2answers
2k views

Clustering Strings on the basis of Common Substrings

I have around 10000+ strings and have to identify and group all the strings which looks similar(I base the similarity on the number of common words between any two give strings). The more number of ...
0
votes
1answer
228 views

What is the basic process and tools needed for crawling a source code repository for the purpose of data mining?

This all is with respect to Microsoft project CodeBook: CodeBook There is huge amount of code in the repository, many classes , a call hierarchy of functions, testcases etc. I am interested in ...
1
vote
1answer
63 views

Create association between informations

I deployed a project some days ago that allow to extract some medical articles using the results of a questionnaire completed by a user. For instance, if I reply on questionnaire I'm affected by ...
2
votes
2answers
161 views

Suggesting albums based on friends' top ten lists

Just wondering if someone could suggest a good algorithm in the collaborative filtering vein that I could use to suggest music choices based on top ten lists. This is a personal project, I am a ...
4
votes
5answers
2k views

Data Mining Books [closed]

I'm passionate about data mining, I have read some books like Programming Collective Intelligence, and I would like to know more good books, specially practical ones, about data mining in conjunction ...
5
votes
3answers
3k views

How do I cluster strings based on a relation between two strings?

If you don't know WEKA, you can try a theoretical answer. I don't need literal code/examples... I have a huge data set of strings in which I want to cluster the strings to find the most related ones, ...
0
votes
2answers
948 views

How can I make my career in supply chain optimisation and data mining? [closed]

There is a company in my city which does supply chain optimization, data mining and predictive modelling. I tried hard but was not able to enter there. Now I want to do similar sort of work. They ...
1
vote
1answer
711 views

Pattern for SQL data mining app

We have an app that is used for data mining on our client database. Typical uses include getting a list of clients and their email addresses, running reports about user transactions between certain ...
3
votes
1answer
165 views

Modern approaches to retrieve useful content from a web page?

What are the modern ways to (effectively) determine which part of page contains useful text, data tables, etc. and which are not (e.g. ads, navigation, etc.)? What were the last valuable researches/...
1
vote
1answer
115 views

Social Analytics in your current data

By now everyone is aware of the massive boom in social-networking (Twitter, Facebook, LinkedIn) and obviously a big part of its business model revolves around being able to mine this data to create ...