17
$\begingroup$

Decades ago there were and are books in machine vision, which by implementing various information processing rules from gestalt psychology, got impressive results with little code or special hardware in image identification and visual processing.

Are such methods being used or worked on today? Was any progress made on this? Or was this research program dropped? By today, I mean 2016, not 1995 or 2005.

$\endgroup$
1
  • 7
    $\begingroup$ Could you cite some papers / authors / textbooks that you would say represented this trend? $\endgroup$
    – bukwyrm
    Jul 31, 2018 at 17:02

1 Answer 1

1
$\begingroup$

Rules based on Gestalt psychology could be seen as a 'local minima' in terms of optimal image processing. Some of them could be surprisingly effective, but difficult to extend and improve upon, since they assume certain high level attributes that might not generalize well.

"If it's circular, then it's a fruit 90% of the time"

Modern methods like neural networks come at the problem from another direction, and try to build towards those high level attributes incrementally. You could say that a goal of these modern methods is to recreate a version of those 'assumptions' or 'Gestalt rules' empirically. That way, we can feel more confident that we're not using a locally optimal approach.

"This is the smallest algorithm that will accurately identify fruit 90% of the time"

Are such methods being used or worked on today?

Yes, and not just in image processing. If you look at any industry where fast processing of ambiguous domain-specific data is needed, there are usually systems that were designed by experts in that field using 'hand-crafted' heuristics. A benefit of these approaches is that the 'Gestalt rules' are understandable apart from the system that uses it, and is therefore easier to trust.

Was any progress made on this? Or was this research program dropped?

Aside from trivial cases, employing the gestalt approach in a particular domain requires expertise. "Image Expert" is an expensive and hard to fill role. Even then, you're bounded by that expert's ability to effectively generalize an extremely complex problem. Over the past decades, machine learning has become a lot easier and less expensive to employ, and has been slowly replacing all those 'hand-crafted' approaches.

However, one of the interesting things we're finding when we let the machine learning approaches loose is that they sometimes don't agree with our previous rules. Why they don't agree, and what this means about automation and our psychological biases, is one of the big open questions in AI.

You might also be interested in Saliency Maps, and similar techniques intended to visualize the general rules used by neural networks: https://en.wikipedia.org/wiki/Saliency_map

References:

http://wayback.archive-it.org/219/20121229060421/http://www.cs.indiana.edu/~jwmills/ANALOG.NOTEBOOK/klm/klm.html

https://journals.sagepub.com/doi/pdf/10.1177/002029400403701001

https://maritime.org/doc/op1140/index.htm

https://airandspace.si.edu/stories/editorial/inventing-apollo-spaceflight-biomedical-sensors

$\endgroup$
2
  • $\begingroup$ Maybe you could provide some references that support your claims to your first question. $\endgroup$
    – nbro
    Jun 30, 2020 at 21:14
  • $\begingroup$ I'd recommend reading about the transition from analog to digital computing that took place in the mid 20th century. Some examples of this shift are 70 years old, but others are still taking place. I'll add a few links for examples. $\endgroup$
    – bey
    Jul 1, 2020 at 13:49

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .