Last call to make your voice heard! Our 2022 Developer Survey closes in less than a week. Take survey.

Questions tagged [machine-learning]

relates to algorithms that are "trained" by some data set.

Filter by
Sorted by
Tagged with
1 vote
1 answer
109 views

Database design for a reccomendation system

I am working on a project which will have a recommendation system and I am in the database design phase, I have a good foundation in programming but databases is a new topic for me, I have designed a ...
user avatar
  • 11
0 votes
0 answers
55 views

Is the output of all kinds of machine learning models binary or can the end values be interpreted in other ways?

I'm just wrapping my head around the topic and building a simple neural network from scratch as I go. I'm trying out different data types to hold weights, values and biases as well as different ...
user avatar
  • 189
1 vote
1 answer
203 views

Should I check floating point values in a unit test?

We have unit tests that are running some underlying model. We provide it with some test input, and receive some outputs + floating point scores. What's a good practice from a unit-testing standpoint? ...
user avatar
  • 155
0 votes
1 answer
32 views

Best practices for tuning an eval of an ML model

Let's say that I have a service like that takes in some text, classifies it, and then outputs the classification. The critical path between entry and classifier is as follows: Query -> ...
user avatar
  • 155
2 votes
0 answers
60 views

How to package and distribute a Tensorflow GPU desktop application

I am developing a desktop application that utilises Tensorflow. The aim of the application is to let users easily train a given model and use it for inference within the app. I want to support ...
user avatar
  • 1,627
4 votes
3 answers
483 views

GET vs POST when exposing machine learning model predictions using a REST API

So the recommendations for using GET vs POST in a REST API that I've read on stack overflow are geared almost exclusively toward CRUD operations involving a database. However if you are simply writing ...
user avatar
  • 247
-1 votes
1 answer
88 views

How would I detect a physical attack in video form? [closed]

I hope this question isn't too vague because it's more a discussion than a question. I want to write a code which can detect physical violence in a scene (with the end result being the prediction of ...
user avatar
1 vote
0 answers
56 views

How to build a chatbot that is Open Domain but can intervene on specific intents?

As per my knowledge, there are 2 type of Chatbots- Open Domain and Closed Doman Intent Based. I was wondering how are conversational agents created such that can converse as if they are Open Domain, ...
user avatar
1 vote
1 answer
221 views

How to maintain well structured code and latency optimized code together?

I'm working on a c++ data analysis project. My workflow goes like this Analyze the data and build models Optimize the code for latency, to deploy for production goto 1 Step 1 has lots of machine ...
user avatar
0 votes
1 answer
505 views

Machine Learning pipeline design patterns

In machine learning we have modules that perform operations on data in a sequencial manner. Modules are generally the following: Data Collection Module: Takes raw data from a resource (filesystem,...
user avatar
  • 133
0 votes
0 answers
183 views

What would be a good approach to applying computer vision to automatically edit out the downtime in tennis video?

I have an iOS/macOS tennis app that now lets the user import video, and I would like to add the ability to automatically edit out the significant amount of downtime where players are not in a rally or ...
user avatar
-1 votes
1 answer
207 views

Is it bad design to pass around a dictionary of arguments to all your functions?

In my machine learning pipeline, I have all the arguments collected into a dictionary. args = {'save_model': True, 'learning_rate': 0.01, 'batch_size': 4, 'model': 'my_model', 'momentum': 0.9, '...
user avatar
  • 243
0 votes
1 answer
113 views

Best file formats for ML training

Hi I'm bulding an ML pipeline with PyTorch to support various tasks and am looking for some advice on efficient ways to store processed data. The main frame work was 3 layers [data prep] -> [data ...
user avatar
0 votes
3 answers
240 views

Is it really good practice in Python code for machine learning to use so many parameters?

Currently I am a student learning Machine Learning, and so my observation is from an academic context. It may be different in a business environment. One thing I find very odd when I see Python code ...
user avatar
  • 125
-1 votes
1 answer
147 views

K-nearest neighbors for friend recommendation system

I want to write algorithm that will find recommended friends for given user. I was wondering if K-nearest neighbors algorithm will work fine for that task? Firstly, I'm not sure if I understood this ...
user avatar
  • 101
0 votes
0 answers
54 views

What algorithm should I use to optimize a bike sharing redistribution system?

I want to optimize a bike-sharing redistribution system( find the best way for an agent to take bikes from a station that has more bikes than needed and relocate them to a station that needs more ...
user avatar
-4 votes
1 answer
42 views

How to make comprehension questions from text?

Lets say I wanted to autogenerate questions for a wikipedia page as a sort of comprehension exercise, how would i best go about that. Using machine learning would be necessary but any other things i ...
user avatar
-4 votes
1 answer
80 views

backpropagation DQN double q learning

After many research, I still can't find a neat answer about this question: Let's assume 'lo' is our loss for a state-action pair calculated with the Bellman eq. I don't understand wich one here is ...
user avatar
-1 votes
1 answer
3k views

Best way to store data for machine learning (Database or Files)

I am currently in the process of developing a machine learning application, where my users can upload their own data to train models. Furthermore, the users must be able to extend their uploaded data ...
user avatar
0 votes
2 answers
232 views

Do we draw the dataset as a secondary actor in a use case diagram?

I am working on a project to detect cancer and I am using deep learning (Convolutional neural network). In the user interface, the user has only to input an image number then click test when the user ...
user avatar
-4 votes
1 answer
51 views

Development paradigms of ML libraries

I know that Tensorflow use symbolic model-building APIs where the developers can use them to build static computational graphs. Whereas Pytorch offer imperative programming paradigm where it performs ...
user avatar
  • 1
-4 votes
1 answer
47 views

How to create a quiz app without multiple choice?

So I'm trying to make a quiz app where the answers should be typed rather than multiple choice. However, even though there is always one right answer, in english, we have many ways of writing the same ...
user avatar
-2 votes
1 answer
23 views

What do these terms refer to in the context of RL/TD learning?

I've been working on an implementation of TD-backgammon. The paper/project I'm basing my implementation on is here: https://www.cs.cornell.edu/boom/2001sp/Tsinteris/gammon.htm Everything makes sense ...
user avatar
-4 votes
1 answer
61 views

Capture the face when we blink eye

I need some guidance that how to capture the face when we blink the eyes. I have seen the core Image framework, but it detects only after capturing the image. But I need it to be live capture.
user avatar
-1 votes
1 answer
286 views

Is Python's Django WebFramework good to design Expert System as a Web App?

I hope everyone is good. Well, I am at the end of my degree BS (Software Engineering), and in the third Phase of my Final Year Project named as 'Test Phase'. My Project is to build an Expert System ...
user avatar
4 votes
1 answer
99 views

Machine Learning in Real Time

I've been going over some tutorials on machine learning using Python and libraries including SciKit Learn and Tensor Flow. (Basic tutorials like creating an algorithm to predict a price given input ...
user avatar
  • 145
0 votes
1 answer
89 views

How can I alter a system design to improve computational efficiency with AWS?

I have a use case which will take in data from the front end and transform it with various parameters. Then a random effects model is run on each transformation and multiple models are built For ...
user avatar
  • 19
-1 votes
2 answers
65 views

Sensitive data and cloud storage

I've been reading about machine learning models deployment and pipelines and so far most of the sources suggest that the data should be ingested from some sort of cloud based storage or source, be it ...
user avatar
  • 151
2 votes
0 answers
47 views

How to test generated text

I am creating a text generation algorithm for my master's research. I have a dialogue between two people and I would like to simulate one part of the conversation with naturally generated text (not ...
user avatar
-1 votes
1 answer
93 views

Algorithm that maps consecutive whole numbers to sets of numbers

Where would I begin if I wanted to develop an algorithm that maps consecutive whole numbers to a long list of unique sets of whole numbers. For example: 0 = {0, 0, 0} 1 = {0, 0, 1} 2 = {0, 0, 2} ...
user avatar
-2 votes
1 answer
794 views

How to do regression testing on a machine learning based application? [duplicate]

This question is different from What are best practices for testing programs with stochastic behavior? be cause it's particular to Regression testing. We are building a chat bot, and for regression ...
user avatar
3 votes
2 answers
594 views

What is the best way for transferring large datasets between an old java app and a python app on the network?

I am working on a machine learning project at the moment which requires me to transfer the data from an old Java app(which is also the custodian of the data in current paradigm) to a python service ...
user avatar
2 votes
1 answer
70 views

Ideal architecture for ML training -> API service workflow, with multiple models/services? [closed]

I'm planning to construct a workflow/environment for training and serving NLP classifiers, that follows something like: The model training system takes in annotated documents from a subset of a ...
user avatar
2 votes
1 answer
42 views

Setup pipeline to analyze data stored in web app DB

Background: So there is a (Ruby) web app with a production Postgres DB (hosted in the cloud) I would like to run some machine learning algorithms in a Python setting on the production data and (...
user avatar
  • 151
-2 votes
1 answer
126 views

Sphere parameter optimization: how would I approach it? [closed]

I am looking to construct a program that takes, as input, 576 [x, y, z] points as well as 576 corresponding distance values. I want to find the [x, y, z, radius] parameters of a sphere such that the ...
user avatar
1 vote
1 answer
169 views

How does machine learning learn? [closed]

I'm new to Machine learning or Ai but I have been a developer for almost 10 years. I have a news aggregator application that grabs and save articles from news websites, And I have developed an ...
user avatar
1 vote
2 answers
111 views

Balancing function call overhead and testability in a code that is a part of the deep learning model training loop

I am currently implementing the transformer architecture for sequence to sequence problems. Key part of the model is the attention mechanism, which is basically a matrix multiplication, followed by a ...
user avatar
  • 19
1 vote
0 answers
121 views

Solution architecture for storing machine learning data

I'm building a mobile application using Expo & React Native. As the user interacts with the mobile app I need to store their interactions in Google BigQuery, so they can later be used to train ...
user avatar
  • 119
1 vote
1 answer
54 views

Compare two arrays by the number of occurances

I have the following dictionary: { "Drama": 8, "Adventure": 8, "Action": 4, "Comedy": 3, "Thriller": 1 } This dictionary is like a representation of a user's preferences in movies. (in the past he ...
user avatar
1 vote
1 answer
78 views

Predicting Diagnosis Codes

I am very new to Machine Learning. I've read about it and I successfully did a tutorial where we looked at the dimensions of Iris petals and predicted what other Iris petal sizes may be. This all made ...
user avatar
2 votes
2 answers
367 views

Distributed training of many small ML models

I have a data science application that involves training tens of thousands of small individual Gaussian models. By "small", I mean that any individual model can easily be trained on one of our worker ...
user avatar
  • 137
2 votes
3 answers
75 views

Redesigning Procedural Decision Engine To Leverage Machine Learning (and Which)

I'm not sure if this is the right forum, but I'm really looking for an advice on this. We've a procedural decision engine, which is fairly rudimentary, to decide application routing. It's basically ...
user avatar
  • 145
0 votes
1 answer
735 views

Battery level prediction model

I have the idea of develop a model that predicts the battery charge level of my system for now until the following 5 days. The battery is charged using a solar panel. I am writing my code in Python 2....
user avatar
0 votes
1 answer
862 views

Clustering Algorithm with max number of clusters

I'm looking for a clustering algorithm (ideally density based) that allows me to specify the maximum number of clusters (but not the exact number). All points must be assigned to a cluster, so I can't ...
user avatar
-2 votes
1 answer
83 views

How to physically test a machine learning model?

I am new to machine learning. I have implemented a machine learning model which detects sound (for example: horn, siren, hammer etc) and predicts the type of sound. I have to physically test the model ...
user avatar
1 vote
0 answers
28 views

Bernoulli naive bayes document model for multi-label classification

I want to ask about Bernoulli Naive Bayes document model. Can we use Bernoulli Naive Bayes document model for multi-label classification of documents?
user avatar
  • 11
3 votes
2 answers
539 views

Is manually tagging content an ideal start for eventual machine learning?

I'm putting together a mobile app that would allow users to search, rate, and upload photos of dishes at restaurants. I have no machine learning experience (just FE/BE/Mobile) so for the time being I ...
user avatar
-1 votes
1 answer
5k views

Training data in unsupervised learning?

Unsupervised learning (USL) is about learning/constructing the algorithm to find the hidden data pattern based on training data without hard coded business rules like arithmetic sum, etc. Example of ...
user avatar
  • 1,856
0 votes
1 answer
321 views

How do I check programmatically if two photos show the same drawing? [closed]

Imagine a simple drawing of let's say a duck. And you have an photo of it in your database. Now a user takes a second photo of the same drawing of the duck. What approaches exist to check if both ...
user avatar
3 votes
1 answer
3k views

Distinction between AI, ML, Neural Networks, Deep learning and Data mining

I have recently started exploring the field of machine learning (ML). I think I understand the difference between ML and AI at high level, but I wanted to understand more accurately the differences ...
user avatar