Questions tagged [models]

For questions related to modelling external environment, functional models tuned through convergent methods such as artificial networks or fuzzy logic containers, loss models, semantic models, model-based reasoning, or other kinds of models used in AI research, development, or practice.

Filter by
Sorted by
Tagged with
1 vote
2 answers
421 views

Why do transformers have a fixed input length?

From what I understand, Transformer Encoders and Decoders use a fixed number of tokens as input, e.g., 512 tokens. In NLP for instance, different text sentences have a different number of tokens, and ...
  • 111
0 votes
1 answer
28 views

Model Suggestions for Real Life local Hospital Data [closed]

I'm doing a machine learning project and was looking for suggestions. It's meant to get the date, household, age, sex, doctor, date of the medical appointment, and type of medical appointment of a ...
1 vote
0 answers
34 views

Why "Good Model" that performs great on holdout validation data fails on production data

I have this binary regression model that has ~500 futures with an unbalanced dataset with the following results. ...
  • 23
1 vote
1 answer
79 views

How to handle out-of-bound values in Production data?

So I have this model but the data may vary. And it is virtually impossible to always have the values in bounds. If I do I`d have to use larger period leading to concept shift which is worse. The ...
  • 23
1 vote
0 answers
16 views

What is the next step in top-down brain simulation after spiking neural networks?

This paper from Yamazaki et al. describes a 68 billion spiking neural network model of the cerebellum. The simulation was about 600 times slower than real time, and the cerebellum is perhaps one of ...
  • 91
3 votes
0 answers
28 views

How should I compare multiple machine learning models to be (generally) fair to all models?

I am testing multiple models on IBM HR Analytics Attrition Dataset (1470 lines) and HR Analytics dataset (15000 lines) for a research project. The models include traditional models (Naive Bayes, SVM), ...
0 votes
0 answers
217 views

Which algorithm can find the best combination of players to maximize the chance of getting a high score?

I am looking for the right terminology for this problem, so I know what to learn about. Imagine a population of 100 people in a town. The town has a sport team with 10 positions that play in ...
  • 1
1 vote
3 answers
52 views

Why my classification results are correlated with the proportionality of my data?

I'm facing a problem. I'm working on mixed data model with NN (MLP & Word Embedding). My results are not pretty good. And I observed that the proportionality of my data are corelated with my ...
2 votes
0 answers
45 views

Can the environment change even without the intervention of the agent in Reinforcement Learning?

I'm modeling a problem using Reinforcement Learning (RL). Formally, I have two agents: one of them is the one that I have to program and model, the other one is unpredictable (random). With ...
  • 133
2 votes
1 answer
61 views

What is the definition of a "model"? [duplicate]

What is the definition of a "model" in the discussion of a neural network? I need a canonical definition. Can you please supply me with a definition along with a reference from any book or ...
0 votes
1 answer
29 views

Deep Learning Architecture where outputs from two different inputs are used for error calculation

Is there a deep learning architecture where outputs of the same model with two different inputs are used for error calculation (backpropagation)? Workflow: Input1 -----> Model ------> Output1 ...
-2 votes
1 answer
54 views

model and trained model parameters on CIFAR-10 [closed]

I'm looking for different models (specifically ResNet18/20, ResNet32/34, VGG16, MobileNet and SqueezeNet) and their parameters after training (i.e., .pth file) that ...
1 vote
1 answer
115 views

Are there any animation tools available to visualise and simulate deep neural networks? [closed]

Deep learning researchers have to work with a lot of models. The models may include different types of Layers: They include convolutional neural network layers, recurrent neural network layers, batch ...
  • 3,451
0 votes
1 answer
111 views

Why is the validation accuracy lower in case of CNN?

I fed the same set of 1.4 million data to two different models: MLP CNN model In both cases, I used the same parameters and hyperparameters. The CNN is showing comparatively lower accuracy (80%) ...
0 votes
0 answers
30 views

Non-locally Electrically Programmable Logic Gates - Technological Advances Progress

Preface: I’d like to clarify that I understand what a relay is and that a PLC uses a fairly conventional microprocessor that only digitally establishes logical logic gate configuration as a digitally ...
1 vote
0 answers
74 views

How to generate text descriptions from keywords?

I wonder how can I build a neural network which will generate text description from given tag/tags. Let's assume I have created such data structure: ...
0 votes
0 answers
180 views

What is a model lineage?

We know about the lineage of datasets. Is there anything called "(ML) model lineage". What are all the works that had been remarkable regarding "model lineage"? There are few links ...
  • 1
1 vote
0 answers
35 views

Which approach best suits vector encodings?

I want to build a model that when given two vectors, outputs the probability of one vector being the encoded form of the other. I have 2 strategies for this: (Dataset available) I can directly feed ...
4 votes
1 answer
1k views

Is there a machine learning model that can be trained with labels that only say how "right" or "wrong" it was?

I'm trying to find the name for a model that is used to output a decision (maybe something like right, left, or ...
9 votes
3 answers
2k views

What are the differences between an agent and a model?

In the context of Artificial Intelligence, sometimes people use the word "agent" and sometimes use the word "model" to refer to the output of the whole "AI-process". For ...
  • 2,589
3 votes
4 answers
1k views

How to embed/deploy an arbitrary machine learning model on microcontrollers?

Say I have a machine learning model trained on a laptop and I then want to embed/deploy the model on a microcontroller. How can I do this? I know that TensorflowLite Micro generates a C header to be ...
  • 191
2 votes
0 answers
59 views

How and why do state-of-the-art models in medical segmentation differ from general segmentation models?

I am just getting into medical image segmentation and have been able to understand the state-of-the-art architectures, like Double UNet, UNet++, and Multiresunet. What I haven't understood yet: Why ...
4 votes
4 answers
1k views

What is the fundamental difference between an ML model and a function?

A model can be roughly defined as any design that is able to solve an ML task. Examples of models are the neural network, decision tree, Markov network, etc. A function can be defined as a set of ...
  • 3,451
1 vote
1 answer
84 views

Aside from specific training sets, what distinguishes the capabilities of different AI implementations?

(Disclaimer: I don't know much about ML/AI, besides some basic ideas behind it all.) It seems like ML/AI models can often be boiled down to statistics, where certain levers (weights) get fine-tuned ...
  • 111
3 votes
1 answer
74 views

Is there a complement to GPT/2/3 that can be trained using supervised learning methods?

This is a bit of a soft question, not sure if it's on topic, please let me know how I can improve it if it doesn't meet the criteria for the site. GPT models are unsupervised in nature and are (from ...
3 votes
1 answer
169 views

What is the difference between parametric and non-parametric models?

A model can be classified as parametric or non-parametric. How are models classified as parametric and non-parametric models? What is the difference between the two approaches?
  • 93
1 vote
0 answers
27 views

Literature on computational modelling involving neuronal ensemblies

Straying from the current trends in deep learning, there is an, arguably, interesting idea of neuronal ensembles possibly providing an alternative to the current "layered feature detectors" ...
1 vote
1 answer
160 views

What are some examples of functions that machine learning models compute?

My simple understanding of AI is that it is based on a mathematical model of a problem. If I understood correctly, the model is a polynomial equation and its weights are calculated by training the ...
  • 113
0 votes
1 answer
97 views

How to combine specific CNN models that work better at slightly different tasks?

I'm not sure how to describe this in the most accurate way but I'll give it a shot. I've developed a Inception-Resnet V2 model for detecting audio signals via spectrogram. It does a pretty good job ...
0 votes
2 answers
443 views

How can I be sure that the final model, trained on all data, is correct?

The 'by the book' method of delivering final machine learning models is to include all data in the final training (including validation and test sets). To check robustness of my model I use randomly ...
  • 1,220
1 vote
0 answers
87 views

Is it good practice to save NLP Transformer based pre-trained models into file system in production environment

I have developed a multi label classifier using BERT. I'm leveraging Hugging Face Pytorch implementation for transformers. I have saved the pretrained model into the file directory in dev environment. ...
  • 141
0 votes
1 answer
37 views

Detect data in tables of roughly the same structure

I would like to train a model that serializes a table of nutrition facts into it's values. The tables can vary in form and colour, but always contain the same set of keys (e.g. carbs, fats). Examples ...
1 vote
1 answer
409 views

What are the main differences between a language model and a machine translation model?

What are the main differences between a language model and a machine translation model?
  • 1,403
2 votes
1 answer
180 views

Why is the hypothesis function $h_{\theta}(x)$ equivalent to $E[y | x; \theta]$ in generalised linear models?

Reading through the CS229 lecture notes on generalised linear models, I came across the idea that a linear regression problem can be modelled as a Gaussian distribution, which is a form of the ...
  • 1,241
1 vote
0 answers
35 views

Training a model for text document transformation?

I have a bunch of text documents, split into source documents and transformed documents. These text documents have multiple lines and are edited at specific locations, in a specific way. I make use ...
1 vote
1 answer
34 views

How to work on different models for a given problem?

I am working on the MNIST data on my own. The idea is to use different values for the number of hidden layers, number of nodes in a given layer, etc. How do you organize these things while you are ...
3 votes
1 answer
598 views

What is the difference between FC and MLP in as used in PointNet?

I am trying to understand the PointNet network for dealing with point clouds and struggling with understanding the difference between FC and MLP: "FC is fully connected layer operating on each ...
  • 31
2 votes
1 answer
66 views

Neural networks with internal dynamics in the state-space form

Neural networks with feedback (Hopfield, Hamming, etc.) differ from ordinary neural networks (multilayer perceptrons, etc.), which turns them into a dynamic element with its own internal dynamics (if ...
  • 227
5 votes
3 answers
291 views

Isn't a simulation a great model for model-based reinforcement learning?

Most reinforcement learning agents are trained in simulated environments. The goal is to maximize performance in (often) the same environment, preferably with a minimum amount of interactions. Having ...
3 votes
1 answer
369 views

What is the difference between model and data distributions?

Is there any difference between the model distribution and data distribution, or are they the same?
2 votes
0 answers
175 views

What are the advantages and disadvantages of extrinsic and perplexity model evaluation in NLP?

In the video Evaluation and Perplexity by Dan Jurafsky, the author talks about extrinsic and perplexity evaluation in the context of natural language processing (NLP). What are the advantages and ...
  • 1,403
2 votes
1 answer
71 views

What is the current state-of-the-art in unsupervised cross-lingual representation learning?

What is the current state-of-the-art in unsupervised cross-lingual representation learning?
  • 1,403
2 votes
0 answers
80 views

Using ML for Enemy Generation in Video Games

I am attempting to make a 2-D platformer game where the player traverses through an evil factory that is producing killer robots. The robots spawn at multiple specific locations in each level and ...
0 votes
1 answer
839 views

YOLOv3 Model Structure: Why is filters = (classes + coords + 1) * num?

Here's a tutorial about doing custom training of YOLO (Darknet): https://medium.com/@manivannan_data/how-to-train-yolov3-to-detect-custom-objects-ccbcafeb13d2 The tutorial guides how to set values in ...
  • 1,263
1 vote
0 answers
32 views

What models will you suggest to use in Industrial Anomaly Detection and Predictive analysis on live streamed data?

I have been working on industrial data, that is fed live, I want to explore a few models which might suit for this the best. The data are KPI data from the manufacturing Industry.
  • 31
-1 votes
2 answers
255 views

Will AI always depend on models and thus approximations?

In section 3 of the paper The Limits of Correctness (1985) Brian Cantwell Smith writes When you design and build a computer system, you first formulate a model of the problem you want it to solve, ...
  • 59
3 votes
0 answers
843 views

Why isn't there a model playing FPS like CoD or Battlefield already existing?

Assuming we had an unlimited time to train a model and a very powerful machine to use our model in real-time (hello quantum computer), I'd like to know why no one could achieve to build an AI able to ...
  • 131
0 votes
0 answers
24 views

What are the properties of a model that is well suited for for high performance real-time inference

What are general best practices or considerations in designing a model that is optimized for real-time inference?
2 votes
0 answers
58 views

Correlating two models to predict the output of one that corresponds to an output of the other

I am currently working on a problem and now got stuck to implement one of it's steps. This is a simple attempt to explain what I am currently facing, which is something that I am aiming to implement ...
3 votes
0 answers
19 views

What is a good model for regression problem with binary features and small data?

I am trying to predict the solution time for riddles in which matchsticks are combined into digits and operators. An example of a matchstick riddle is 4-2=8. The solution for this riddle would be ...