Skip to main content

Questions tagged [evaluation-functions]

For questions about evaluation functions in the context of search algorithms (and other AI subfields).

Filter by
Sorted by
Tagged with
0 votes
0 answers
16 views

Spike/Peak detection algorithm performance evaluation [closed]

I've typically implemented my own performance evaluation function for spike/peak detection algorithms by analyzing the position of detected spikes/peaks and using a search window around the reference ...
GGChe's user avatar
  • 1
0 votes
1 answer
65 views

How to evaluate the relevance of a search made with an AI Agent?

I’m building an AI agent designed to find the best results for with a search tool. The agent is essentially a Large Language Model (LLM) connected to a Search API via function calling. The goal is for ...
Léonard Henriquez's user avatar
0 votes
0 answers
56 views

Can mAP(mean average precision) use at classification problem?

I have some questions about mAP(mean Average Precision). In object detection problem, mAP use to measure performance broadly. But, Is it possible to use mAP in multi-class classification problem? I ...
Yang's user avatar
  • 57
1 vote
0 answers
23 views

How can evaluate the success of my algoritm?

A little bit of context. I have a classification algorithm based on mathematical discriminator and I am not applying any machine learning or AI technique, just moving window and several relative ...
GGChe's user avatar
  • 123
1 vote
1 answer
1k views

why cross entropy loss has to be multiplied by a batch size during an evaluation in transformer model?

I am trying to look through a code of the transformer model from Pytorch. However, I do not understand why batch size needs to multiply with cross-entropy loss given that loss is calculated based on ...
BOB's user avatar
  • 11
3 votes
1 answer
375 views

Can we achieve optimality with minimax using an evaluation function?

The following quote (from AIMA) refers to the situation in which the minimax algorithm computes its values directly from the terminal states. (The) definition of optimal play for MAX assumes that MIN ...
Kestina's user avatar
  • 31
2 votes
0 answers
473 views

Minimax evaluation function for games with score instead of loss/draw/win result

I am trying to create minimax evaluation function for the Ms Pacman game. The goal of the player is to maximize score. I have some idea about the features that I would like to use in my evaluation ...
Druudik's user avatar
  • 171
1 vote
1 answer
43 views

What inherent quality of a function makes it treated as either loss or evaluation metric?

A neural network model needs a loss function for training. The neural network needs to minimize the loss function. A neural network is evaluated after training using a metric. The neural network needs ...
hanugm's user avatar
  • 3,930
2 votes
0 answers
189 views

Which heuristic function should I use for the ColorShapeLinks game?

For learning purposes, I am trying to implement the minimax algorithm for the ColorShapeLinks game, which is similar to connect 4, except the fact that it combines both shape and color as the winning ...
Errata's user avatar
  • 21
1 vote
0 answers
177 views

What would happen if we set the evaluation function in the best-first search algorithm as the cost of paths taken to new nodes?

I am reading Artificial Intelligence: A Modern Approach. In Chapter 3, Section 3.3.1, The best-first search algorithm is introduced. We learn that in each iteration, this algorithm chooses which node ...
Hamed's user avatar
  • 21
0 votes
2 answers
90 views

What is the meaning of the terms in this evaluation function for chess?

I'm trying to improve my evaluation and I saw this here ...
James Urian's user avatar
1 vote
1 answer
2k views

What is the difference between the heuristic function and the evaluation function in A*?

I am reading college notes on state search space. The notes (which are not publicly available) say: To do state-search space, the strategy involves two parts: defining a heuristic function, and ...
Slowat_Kela's user avatar
2 votes
0 answers
199 views

Is this a good approach to evaluate the game state with a neural network?

I've written a Monte Carlo Tree Search player for the game of Castle (AKA Shithead, Shed, Palace...). I have set this MCTS player to play against a basic rule-based AI for ~30000 games and collected ~...
Cyrus Dobbs's user avatar
3 votes
2 answers
520 views

Is a good evaluation function as good as any of the extensions of alpha-beta pruning?

I would like to know if having a really good evaluation function is as good as using any of the extensions of alpha-beta pruning, such as killer moves or quiescence search?
JoeyB's user avatar
  • 477
6 votes
1 answer
5k views

Why most imperfect information games usually use non machine learning AI?

To provide a bit of context, I'm a software engineer & game enthusiast (card games, especially). The thing is I've always been interested in AI oriented to games. In college, I programmed my own ...
Alexander Aeons Torn's user avatar
1 vote
1 answer
966 views

Game AI evaluation function and making progress towards winning

In two-player games, the exact value of the evaluation function doesn't matter, as long as it's bigger for better positions. However, for learning, it's customary when it does change when the best ...
maaartinus's user avatar
3 votes
1 answer
2k views

How do I write a good evaluation function for a board game?

I'm currently writing the Alpha-Beta pruning algorithm for a board game. Now I need to come up with a good evaluation function. The game is a bit like snakes and ladders (you have to finish the race ...
po0l's user avatar
  • 119
1 vote
1 answer
1k views

How to design a good evaluation function for a go-like game?

I am trying to find a good evaluation function for a game with: A 7x7 tile board 2 players, given an equal number(>=3 currently undetermined) of stones placed randomly on the tiles A turn is ...
Nae's user avatar
  • 129
1 vote
1 answer
792 views

Is it standard to say that an evaluation function estimates the “goodness” of a position?

Wikipedia states that: An evaluation function, also known as a heuristic evaluation function or static evaluation function, is a function used by game-playing computer programs to estimate the value ...
DukeZhou's user avatar
  • 6,237
5 votes
1 answer
619 views

Can games be solved without an evaluation function?

Fundamentally, a game-playing AI must solve the problem of choosing the best action from a set of possible actions. Most existing game AI's, such as AlphaGo, do this by using an evaluation function, ...
dshin's user avatar
  • 161