Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
Make your voice heard. Take the 2019 Developer Survey now

Questions tagged [neural-networks]

The tag has no usage guidance.

-1
votes
1answer
71 views

Is there a way to get rid of loop for layers in a neural network

I have being learning about deep neural networks and how the increase in hidden layers give better results. but the problem that i found was we usually get rid of loops in calculations by using ...
-2
votes
0answers
25 views

What is batch / batch size in neural networks? [migrated]

I have some problems with understanding of batch concept and batch size. I messed something up. First i start it consider based on convolutional neural network I heard two versions: 1. When batch ...
0
votes
1answer
105 views

How to end a sentence in neural networks

I have a simple neural-network which can create new text out of words which are likely to come after a specific word. The code lacks of comma placement and punctuation. It also can't transform a ...
1
vote
1answer
360 views

Distinction between AI, ML, Neural Networks, Deep learning and Data mining

I have recently started exploring the field of machine learning (ML). I think I understand the difference between ML and AI at high level, but I wanted to understand more accurately the differences ...
0
votes
0answers
33 views

Software design implementation - Is it possible to pass a word2vec model as input to a neural net?

I am trying to use a neural net for information extraction. I want to extract a specific human name (name of the person / persons with cancer) from a document that may have many names. I have ...
2
votes
0answers
80 views

Software design strategy for a machine learning tool that outputs a subset of the text input (Information Extraction)?

Let's say I have thousands of pdfs that are each about 30k words written in conversational English. In each of the pdfs there is a name / names of a person/people who snowboard. There are also many ...
0
votes
1answer
271 views

How do you evolve a neural network?

I've read about NEAT/Evolutionary Artificial Neural Networks/Genetic Algorithms. I understand the concept of choosing the fittest neural networks and breeding them to produce another one, but how ...
3
votes
2answers
307 views

Test Driven Development for Stochastic algorithms?

this is similar, but no the same as this post, which was the closest question I could find on this. I don't even see that answer as satisfactory for the question asked in that thread let alone TDD. ...
0
votes
3answers
160 views

Can I train further a trained neural network only with some new character?

I would like to make a semi-automatic OCR software for offline handwritten documents, where the OCR tries to recognize the words and the user has the ability to correct the fails of the recognizer by ...
1
vote
1answer
565 views

How to have a neural network deal with a variable size input

I'm trying to write a program in Python that will take an input of a .wav (sound) file, and determine whether the user is saying "yes" or "no". The issue is that the sound files are not always the ...
4
votes
1answer
350 views

Double neural network architecture for starcraft AI programming endeavour

Please take a look at this AI system architecture proposal: As you can see this is a multi-agent AI system for starcraft brood war that utilizes BWAPI AI framework, and I proposed this idea for the ...
2
votes
1answer
123 views

Creating a neural network to solve inequality

I am just testing out a simple neural network with a single neuron. To classify if a number X between 1..10 is greater than a number N. N is a constant for example N=3. Given my input X and a ...
0
votes
1answer
373 views

How to run 2-layer perceptron to solve XOR

XOR is not solvable by using a single perceptron with standard scalar product and unit step function. This article suggests using 3 perceptron to make a network: http://toritris.weebly.com/perceptron-...
3
votes
2answers
2k views

What is identity mapping in neural networks

I came across the term identity mapping in some papers about neural networks but am not sure what it is supposed to mean in that context. I'm guessing it means to map a sort of input to an output? I ...
3
votes
2answers
2k views

Why do convolutional neural networks use so much memory?

I heard that one of the main problems applying neural style to high resolution images is the huge amount of memory that would use. Also I just configured a network using tiny-cnn This is my ...
6
votes
2answers
1k views

Why my Neural Network Accuracy is 100%?

I wanna ask about Neural Network. I have a research and programming about Neural Network using Backpropagation algorithm for prediction. My input data using binary form. But, i'm still confuse, ...
1
vote
0answers
39 views

How do you feed sets of connected data elements to an artificial neural network?

I'm currently working on a neural network to try to predict movements of electricity prices in a big city with multiple power companies to choose from. I know from a friend in the industry that power ...
4
votes
2answers
207 views

Neural networks: No solutions for test data possible?

So there are two ways of teaching a neural network as far as I am aware of. You supply the AI with test data and the correct solution to the problem. After some time the network will be able to get ...
6
votes
2answers
7k views

What are the practical uses of a neural network?

Even as an outsider to neural network development, they still seem to be a hot topic... I get lots of projects I see being starred on my GitHub homepage relating to neural networks. These projects ...
3
votes
1answer
2k views

Vector input for Artificial Neural Network?

My problem is fairly complex, so here is a similar, simplified example. Let's say you wanted to predict the Miles Per Gallon (fuel consumption) of a car, based on the following information: you have ...
0
votes
0answers
51 views

Is sparsity parameter really useful?

To make a sparse autoencoder,one way is add something to the function we want to minimize,which the further do average activity of hidden units to a sparsity parameter,the bigger your added thing will ...
23
votes
3answers
6k views

Calendar/Planning algorithm

I'm facing a problem I'm not sure how to approach. I have to generate a calendar for employees, each of them having specific work constraints (some personal, some common) What I'm working with : I ...
2
votes
1answer
92 views

To what values should you initialize the neurons and connection strengths in a neural network?

The values of all of the neurons in my neural network are initialized to 0 and the connection strengths between the neurons are set to randomly generated floats, between 0 and 1. I have seen other ...
3
votes
1answer
147 views

How can you write an activation function in a neural network to handle a layer architecture of arbitrary dimensions?

I am making a neural network in Clojure that can take an array of integers,and return a data structure representing the layers of a neural network: so (make-layers [1 4 5]) would evaluate to: [[0] ...
1
vote
1answer
489 views

An Introductory Tutorial for Neural Net Backpropagation with Simplified Math

I built a neural net, and planned on optimizing the weights using a genetic algorithm. I was informed though, that this isn't a good idea, and to look into backpropagation. I searched around, and ...
2
votes
1answer
809 views

Is the output of a neural net supposed to have had the activation function applied to it?

TL; DR: Is the output from a feed-forward neural a direct result of the activation function? I.e: If the activation function is the sigmoid function, will the output always be between 0 and 1? I'm ...
1
vote
0answers
69 views

How to evaluate a recurrent connection in an artificial neural network?

I just can't understand how should I compute the output of a neural network, which contains a recurrent connection. So here is an example: (i_1,2 are the input values, w_1,2,3,r are the ...
2
votes
0answers
75 views

What parallelization methods can make neural nets train faster?

A fairly straightforward way (on a theoretical level, at least) of parallelizing artifical neural networks (ANNs) would be to divy up the batches of training examples during every epoch so that ...
2
votes
1answer
473 views

What type of neural network is suitable for simulating brain of virtual organism? [closed]

A while ago I was experimenting with evolving virtual creatures using neural network + genetic algorithm, but that didnt go well (simulation speed was too slow, mainly because bad programming habbits ...
1
vote
0answers
801 views

Neural network converges to 0.5 for XoR

I'm coding a neural network in C for an OCR project. Before testing with character recognition, I'm making it learn the XoR operation. Although, the results I'n getting always converges to 0.5 instead ...
0
votes
2answers
108 views

Could one sample be enough for a perceptron training?

I need to compare a picture and decide whether or not it is similar to another one. In this case, I would like to use a simple perceptron that compares pixelmaps of both pictures. But I have only very ...
2
votes
1answer
211 views

Support Vector Machines as Neural Nets?

This is more of a conceptual question. I have learned about Neural Nets, and I have some clue as to how Support Vector Machines work. I read somewhere however that given the appropriate kernel (is ...
1
vote
2answers
621 views

Neural network input preprocessing

It's clear that the effectiveness of a neural network depends strongly on the format you give it to work with. You want to pre-process it into the most convenient form you can algorithmically get to, ...
5
votes
2answers
362 views

How to solve this problem- Neural Net? Fuzzy? Other?

Hi I have a programming problem that I would like to solve using some artificial intelligence technique. I really dont know where to start. I would like some guidance as to what methodology to pursue. ...
1
vote
1answer
2k views

How to design a calculator from scratch [closed]

A basic calculator can perform a wide variety of operations. How does the claculator 'get' the concept of adding two numbers in the same way a human does? I dont think people that make claculators ...
6
votes
5answers
552 views

Type of AI to tackle this problem?

I posted this on stackoverflow but want to get your recommendations as well as a user on overflow recommended I post it here. I'm going to say from the beginning that I am not a programmer, I have a ...
1
vote
1answer
63 views

Create association between informations

I deployed a project some days ago that allow to extract some medical articles using the results of a questionnaire completed by a user. For instance, if I reply on questionnaire I'm affected by ...
0
votes
2answers
3k views

Can neural network discover rng patterns

Can neural network find connections beetween numbers generated by random number generator without knowing about it's seed and predict this rng's next numbers with more sucess then randomly guessing? I ...
6
votes
1answer
155 views

How to determine the source of a request in a distributed service system?

Map/Reduce is a great concept for sorting large quantities of data at once. What to do if you have small parts of data and you need to reduce it all the time? Simple example - choosing a service for ...
2
votes
4answers
1k views

Sign Language Recognition [closed]

I am a final year undergraduate student of Information Technology. My team and I have taken up "Sign Language Recognition" as our Final Year Project. We have just started with it and we are in the ...
11
votes
4answers
11k views

What is a Neural Network in simple words [closed]

Can you please explain neural networks in simple words with an example?
4
votes
3answers
665 views

Can symbolic AI 'learn' a data model?

Perceptrons, a simple form of supervised machine learning, must be trained with a set of known good inputs before they can "learn" by adjusting internal weights assigned to inputs, based on the ...