Machine learning and NN trainings as a part of ML is based on data that was gotten from real world and inserted into virtual space by humans.

Meanwhile NN are also used for data generation. Each year the more and more texts, images, sounds etc become more realistic and cannot be determinated from real world data even by a human.

So it is really possible that machines will start to learn with data that was generated by other machines, because it will look as real even for a human, but naturally will be not related to real world.

Q: Will it lead to some machine learning collapse?

Q: Might it lead to some changes in human's perception of the world, because people get a very big part of their knowledge using computers, connected to the Internet?

Q: Is anyone thinking about this potential problem?

  • $\begingroup$ Can you please revise your question. $\endgroup$ – quintumnia Jan 1 '18 at 18:51
  • $\begingroup$ what do you mean? $\endgroup$ – Sergey Kravchenko Jan 1 '18 at 18:55
  • $\begingroup$ I don't see real research in your question,hope your fellow humans will analyze it carefully. $\endgroup$ – quintumnia Jan 1 '18 at 19:00

We can already observe information bubbles on social media, where the circle is that machine learns what content people like and give more similar content based on clicks and so on. From single wrong click you could enter a bubble and never come out if you don't take care or be aware.

This happens with humans, so same may apply to computers. Checking backgrounds, like clicksaver for click titles as a ultimate example, would save the machines from circles, too.

Information as such is not different whether it is made in consecutive rounds by humans or same applied to computer generated one.

If you for example make a thesis, not necessarily all things you write is your own investigation and research. You use quotes, refer to papers and so on. For information sources you have to be careful if the source is respected and considered to be meaningful and correct.

Same carefulness needs to be applied to machine generated content. To the responsible - the last responsibility is with the reader to believe or not what you're reading.

  • $\begingroup$ Great point about social media. There was a lot of coverage about Google search as such a bubble some years back, but the issue seems to have dropped off the radar of most people I talk to today. $\endgroup$ – DukeZhou Jan 2 '18 at 22:23

Will it lead to some machine learning collapse?

I wouldn't think so. Data is data. From the standpoint of automata, everything is ultimately reduced to a sting of bits. It may even be useful to be able to train AI's using CGI, for instance, in relation to automated vehicles. Not any different from humans using flight simulators.

Creating models and training AIs on them is useful, and a part of the contemporary AI landscape.

Might it lead to some changes in human's perception of the world, because people get a very big part of their knowledge using computers, connected to the Internet?

As nbro astutely points out, it already is. It's not only the false CGI content, but the scope of the search filter that dictates what information a websurfer gets. These results are controlled by algorithms, which evolve. Self evolving algorithms will make the process more opaque. It's definitely seems to be creating social problems already.

Is anyone thinking about this potential problem?

I'm sure there are papers out there on this subject. (Don't have time to search now, but I may do that and come back and amend with some articles and research papers.)

Two authors who are definitely thinking about this are Neal Stephenson and Hannu Rajaneimi. Stephenson addressed the "information unreliability" problem of the internet in Anathem. (It's not a major theme, but his ideas are quite insightful--Stephenson has a hard-science background, with a particular interest in computing.) Rajaniemi extends the ideas in the post-singularity Quantum Thief trilogy, where information and matter are interchangeable, and contains some very interesting ideas. (Rajaneimi holds two advanced mathematics degrees, which is useful in tackling a subject of such great complexity.)


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.