Questions tagged [machine-learning]

relates to algorithms that are "trained" by some data set.

Filter by
Sorted by
Tagged with
144
votes
14answers
11k views

Simple method for reliably detecting code in text?

GMail has this feature where it will warn you if you try to send an email that it thinks might have an attachment. Because GMail detected the string see the attached in the email, but no actual ...
60
votes
5answers
110k views

R vs Python for data analysis [closed]

I have been programming for about a year and I am really interested in data analysis and machine learning. I am taking part in a couple of online courses and am reading a couple of books. Everything ...
22
votes
1answer
42k views

Decision trees vs. Neural Networks

I'm implementing a machine learning structure to try and predict fraud on financial systems like banks, etc... This means that there is a lot of different data that can be used to train the model eg. ...
20
votes
7answers
4k views

Machine learning applied to code development

My background is in mechanical engineering, so please forgive my ignorance to this area. I really enjoy programming and software development. Also, I recently took a free online Machine Learning (ML) ...
16
votes
1answer
4k views

How is machine learning incorporated into search engine design?

I am currently building a small in-house search engine based on Apache Lucene. Its purpose is simple - based on some keywords, it will suggest some articles written internally within our company. I am ...
13
votes
2answers
23k views

What does it mean for an algorithm to converge?

I keep coming across this term when reading about reinforcement learning, for example in this sentence: If the problem is modelled with care, some Reinforcement Learning algorithms can converge to ...
13
votes
3answers
4k views

Switching to a career in Machine Learning [closed]

My day job is plain old software development. I am also doing my Masters in CS (part time, course based). I took a course on AI and found machine learning quite fascinating but like most courses it ...
12
votes
5answers
6k views

Is it imaginable to teach a machine how to program itself to a defined specification? [closed]

A friend of mine without programming knowledge asked me this question and I found it interesting. I think it is not possible because it would require a really advanced artificial intelligence ...
11
votes
3answers
2k views

Can a neural network provide more than “yes” or “no” answers?

Every example neural network for image recognition I've read about produces a simple "yes" or "no" answer. One exit node corresponds to "Yes, this is a human face," and one corresponds to "No, this ...
11
votes
9answers
1k views

Learning the rules of chess

A similar question asks whether a computer can learn to play optimally in chess by analyzing thousands of games. If a machine can look at the state of the board for a few games of chess (or a few ...
11
votes
2answers
6k views

What math skills are required to learn machine learning? [closed]

I am interested in taking this online course on machine learning. As it stands my math is very elementary, and I am basically learning math from scratch on khan academy. Programming-wise I have a ...
10
votes
3answers
7k views

What algorithm(s) can be used to achieve reasonably good next word prediction?

What is a good way of implementing "next-word prediction"? For example, the user types "I am" and the system suggests "a" and "not" (or possibly others) as the next word. I am aware of a method that ...
9
votes
4answers
743 views

Using machine learning to aim mirrors in a solar array?

I've been thinking about solar collectors where several independent mirrors to focus the light on a solar collector, similar to the following design from Energy Innovations. Because there will be ...
9
votes
5answers
19k views

What's the best way to learn image processing? [closed]

I'm a senior in college that hasn't done much image processing before (except for some basic image compression on smartphones). I'm starting a research project on machine learning next semester that ...
9
votes
2answers
7k views

Machine Learning With Categorical and Continuous Data

This question could go here or on S.O. perhaps... Suppose that your training dataset contains both categorical and continuous data such as this setup: Animal, breed, sex, age, weight, ...
9
votes
4answers
6k views

How to trim emails for just the body, when using email as input to an external system?

When an application allows emails to be sent to it to either reply to comments or add todos, trimming those emails for just the relevant text becomes a problem, since there are many different ...
8
votes
1answer
1k views

quantitatively comparing AST shapes

How could one compare the shape of abstract syntax trees of similar source code programs (C, C++, Go, or anything compiled with GCC...)? I guess that plagiarism detection on source code would use ...
7
votes
2answers
2k views

Advanced Job Shop Scheduling Algorithm Question

I've looked into numerous solutions for the simple version of this problem, but I've found no solutions for advanced cases, short of sorting through all possible permutations. I don't know where to ...
7
votes
1answer
939 views

Using grammars to extract bibliographic citations

My task lays in the area of text mining / labelling, more particular extraction of bibliographic citations (references) from the plain text, as shown here: Basically, for the input text the algorithm ...
6
votes
5answers
11k views

What skills are needed for machine learning jobs? [closed]

I posted this question on Quora, but didn't get enough responses. reposting it here. I am a learner sitting at home and learning linear algebra, very interested on working in Machine Learning ...
6
votes
1answer
429 views

How to access large amounts of data for machine learning in a microservices architecture

Imagine you are building a product recommendation algorithm for an eccommerce application which is built as a microservices architecture, this architecture having separate services for users and ...
5
votes
1answer
234 views

Algorithm for predicting outcome based on parameters

I've never done anything with statistics, so I'm unsure of how to start with this problem that I need to solve for some software that I'm working on. Basically, there are three parameters An integer ...
5
votes
2answers
370 views

How to solve this problem- Neural Net? Fuzzy? Other?

Hi I have a programming problem that I would like to solve using some artificial intelligence technique. I really dont know where to start. I would like some guidance as to what methodology to pursue. ...
4
votes
4answers
2k views

Implementing a machine learning algorithm to detect the region of an address

I have 10,000 addresses from a city, which all have a region field in the database. When a new address is entered, then I want my software to automatically detect the region of the address . I think ...
4
votes
2answers
2k views

What is the required background to apply Machine Learning to Finance?

I'm interested in machine learning in relations to the stock market (predicting future values of stocks etc). What topics would I need to learn - e.g. what branch of AI to look into etc? and what ...
4
votes
1answer
380 views

What's the normal way machine-learning algorithms are integrated into normal programs?

I'm currently taking a machine learning course for fun, and the course heavily focuses on Matlab/Octave to write the code. One thing mentioned in the course is that, while Matlab/Octave are great for ...
4
votes
3answers
816 views

Can symbolic AI 'learn' a data model?

Perceptrons, a simple form of supervised machine learning, must be trained with a set of known good inputs before they can "learn" by adjusting internal weights assigned to inputs, based on the ...
4
votes
2answers
3k views

Why do convolutional neural networks use so much memory?

I heard that one of the main problems applying neural style to high resolution images is the huge amount of memory that would use. Also I just configured a network using tiny-cnn This is my ...
4
votes
3answers
500 views

Clustering algorithm based on distance

So, I have a packaging center A. And I have n points scattered around A. Let's call them i1, i2 ... in. I have a maximum distance threshold, called D. My task is to break those n points into groups ...
4
votes
2answers
291 views

What specific category / type of machine learning can be used to make better AI decisions in this board game?

I'm collaborating with a friend to, as a challenge, create a bot that can beat the best human players at a browser-based card / board game called Duelyst. It looks like this: It was my original plan ...
4
votes
2answers
160 views

Learning system instead of using sed/replace for reviewing test results

For every build of my software I run it through a series of tests that execute a number of commands on a command line and captures the results. Most of the time the output is a combination of: - ...
3
votes
1answer
505 views

Is Machine Learning a part of Data Science?

I am having trouble differentiating between Big Data vs Data Science. From what I've understood so far, both are buzzwords for the old statistics job. Where does machine learning fit into this?
3
votes
1answer
466 views

Watson Information Encoding [closed]

IBM's Watson has a lot of book information encoded into a 'database' that Watson searches in real time. Does anyone know how that information is coded? It seems hard to imagine how humans could type ...
3
votes
1answer
821 views

Machine Learning with sample data set

I have a question regarding Machine Learning in general. Consider the following scenario: Given a piece of text, we want a program to know whether the text is 'abusive' or not. To do this we can ...
3
votes
2answers
5k views

Separating words in a string

How do I separate words in a string? In the following I have a random sample of words in a string extracted from text file with over a million words. Here's the string: "intervene Pockets ...
3
votes
1answer
2k views

Distinction between AI, ML, Neural Networks, Deep learning and Data mining

I have recently started exploring the field of machine learning (ML). I think I understand the difference between ML and AI at high level, but I wanted to understand more accurately the differences ...
3
votes
2answers
530 views

Is manually tagging content an ideal start for eventual machine learning?

I'm putting together a mobile app that would allow users to search, rate, and upload photos of dishes at restaurants. I have no machine learning experience (just FE/BE/Mobile) so for the time being I ...
3
votes
2answers
9k views

Why does this evaluation function work in a connect four game in java

I am exploring how a Minimax algorithm can be used in a connect four game. I was looking through a program and found this evaluation function. private static int[][] evaluationTable = {{3, 4, 5, 7, ...
3
votes
2answers
195 views

Clustering algorithm that doesn't require predefining the number of clusters required

I have a set of user queries from a search engine that I want to cluster. The only clustering algorithm I have come across so far is the K-means clustering algorithm, which requires defining the ...
3
votes
1answer
83 views

Machine Learning in Real Time

I've been going over some tutorials on machine learning using Python and libraries including SciKit Learn and Tensor Flow. (Basic tutorials like creating an algorithm to predict a price given input ...
3
votes
2answers
152 views

Can I use machine learning for screening experimental data?

I am a experimental physicist. In our research, we have our experimental data in a 400*400*400 matrix(x, y, z axis of a 3d space), each entry is associated with a value("brightness"). We expect the ...
3
votes
1answer
165 views

Modern approaches to retrieve useful content from a web page?

What are the modern ways to (effectively) determine which part of page contains useful text, data tables, etc. and which are not (e.g. ads, navigation, etc.)? What were the last valuable researches/...
3
votes
1answer
239 views

Tasks incorrectly categorized with online text classifiers

Context: Finding company to do the job The use case of an application I want to write is that a user will describe a task to be performed by some company, e.g., I want to move 10 boxes (30x40x50cm)...
3
votes
2answers
471 views

What is the best way for transferring large datasets between an old java app and a python app on the network?

I am working on a machine learning project at the moment which requires me to transfer the data from an old Java app(which is also the custodian of the data in current paradigm) to a python service ...
3
votes
1answer
157 views

How can you write an activation function in a neural network to handle a layer architecture of arbitrary dimensions?

I am making a neural network in Clojure that can take an array of integers,and return a data structure representing the layers of a neural network: so (make-layers [1 4 5]) would evaluate to: [[0] ...
3
votes
1answer
235 views

Reward discounting in reinforcement learning

I've been reading the Sutton and Barto book and following David Silver's lectures on youtube. The basic principles make a lot of sense to me and I've been building a maze (an arbitrary grid where the ...
3
votes
0answers
88 views

Software design strategy for a machine learning tool that outputs a subset of the text input (Information Extraction)?

Let's say I have thousands of pdfs that are each about 30k words written in conversational English. In each of the pdfs there is a name / names of a person/people who snowboard. There are also many ...
3
votes
0answers
755 views

Rotation logic for MNIST Handwritten Digit Dataset

I am currently applying some pre-processing to this dataset. Some of the digits are extremely rotated and I would like to know how others managed to get them 'upright'. I have implemented something ...
3
votes
1answer
4k views

Vector input for Artificial Neural Network?

My problem is fairly complex, so here is a similar, simplified example. Let's say you wanted to predict the Miles Per Gallon (fuel consumption) of a car, based on the following information: you have ...
3
votes
2answers
702 views

Dynamic gesture recognition with fingertip points

I have built a fairly robust program in c++ which tracks several points on a hand. It accurately quantifies the size of the palm, the center of the palm, and the fingertip locations among other hand ...