4
$\begingroup$

Due to recursive self-improvement, AI could lead to an intelligence explosion improving on itself year over year exponentially.

Assuming the proper environment was created to allow an AI to self-improve, how fast would this occur?

With human intervention we might say AI could improve similar to GDP or science growth say 3% per year. But this intervention would be additive to the self-recurring improvements made by the AI.

What is a reasonable annual rate of self-growth and what would the processing power of the AI be after 10 years given an initial value of say 1PFLOP?

Example:

human rate = 3% annually

AI rate = 1% of current processing power annually

Year 1. 1 PFLOP

Year 2. 1 PFLOP + (1 PFLOP * 3%) + (1 PFLOP * 1%) = 1.04 PFLOP

Year 3. 1.04 PFLOP + (1.04 PFLOP * 3%) + (1.04 PFLOP * 1.04%) = 1.082 PFLOP

Year 4. 1.082 PFLOP + (1.082 PFLOP * 3%) + (1.082 PFLOP * 1.082%) = 1.126 PFLOP

Year 5. 1.126 PFLOP + (1.126 PFLOP * 3%) + (1.126 PFLOP * 1.126%) = 1.172 PFLOP

$\endgroup$
  • $\begingroup$ Possible duplicate. $\endgroup$ – quintumnia Jan 16 '18 at 19:51
  • 1
    $\begingroup$ @quintumnia please post links. This is specifically about the rate of improvement, (and includes pedaflops;) $\endgroup$ – DukeZhou Jan 17 '18 at 1:21
  • $\begingroup$ Improvement in terms of better speed, accurate results, wider scale of implementation or something else? Please define "improve". $\endgroup$ – gurvinder372 Jan 17 '18 at 10:58
  • $\begingroup$ @gurvinder372 the question is attempting to limit the scope to FLOPS/speed. This may be a oversimplified/naive view of AI and I'll consider editing the question if there's a better suggestion for definition of improvement that's answerable. For my purposes I ideally want to know how the AI will improve in all aspects that contribute to its ability to improve itself. $\endgroup$ – Alex Cooper Jan 17 '18 at 19:31
  • $\begingroup$ Have you seen The impossibility of intelligence explosion? "Recursively self-improving systems, because of contingent bottlenecks, diminishing returns, and counter-reactions arising from the broader context in which they exist, cannot achieve exponential progress in practice. Empirically, they tend to display linear or sigmoidal improvement." $\endgroup$ – endolith Jan 30 '18 at 14:56
2
$\begingroup$

The processing power might still follow the Moore's law, but it is basically an economical law, although it has worked surprisingly well considering the physical limitations of technology. An Artificially Intelligent agent could focus on manipulating the market, research possible hardware improvements, allocate human resources more effectively to the problem, etc.

I would expect some improvement in the AI algorithm design itself, which will not influence the number of operations available, but the number of operations required to complete a task. By using a better heuristics, the AI algorithm will consume less brute force to complete the task, thus being able to complete more tasks given the same number of operations. Sorry if I misunderstood the question. Thanks for the improvement.

$\endgroup$
  • $\begingroup$ Welcome to AI! Nice point about algorithmic optimization, although I don't think you can separate processing speed from algorithmic efficiency in terms of the results--both are key factors. $\endgroup$ – DukeZhou Jan 17 '18 at 1:23
  • $\begingroup$ You raise a good point and I have read before it's possible that speed improvements may be limited to human intervention (hardware upgrades) while algorithmic efficiency may be drastically improved upon internally. I wonder if there's a limit to efficiency, a least common denominator. 1+1+1+1=4 is inefficient and AI may simplify to 2*2=4 or 2^2=4 but can you simplify an operation indefinitely or is there a lower limit? If an AI can simplify its own 1 million lines of code into 1 line it could be at most 1,000,000x more efficient, but in that case is it still limited to hardware? $\endgroup$ – Alex Cooper Jan 17 '18 at 19:41
  • $\begingroup$ @jankubat Your answer contains great insights. Most of the constraints of AI are purely economic. Its rate of growth is directly proportional to the rate that it can effectively direct resources to itself. $\endgroup$ – Seth Simba Jan 18 '18 at 6:19
0
$\begingroup$

The short answer is that no one knows - here is just my take on it. Note here that this all sounds SciFi as hell. This didn't occur yet to any degree but is in the domain of the physical possible.

I will divide this into Hardware, Software and Economics. Economics is just a replacement for the name of a concept which I am unaware of - that is the interaction between A(G)I's, companies and companies of AGI's.

Note that the growth of GPU's outpaces moores law. Note also that the growth of the computational power throws at ML outpaces moores law, too AI and Compute

Software

Software improvements are certainly possible.

A lot of software improvements can be found in Levels of the self-improvement of the AI.

The software improvements of the core A(G)I mechanisms, algorithms and datastructures depend on

a) The intelligence and optimization power of the used A(G)I(s).

Incapable A(G)I's may either fail completely to improve the algorithms and datastructures and intelligence or they cap out at a certain (sub)human level. See Analysis of Types of Self - Improving Software Timeline and analysis of existing attempts of recursive self improving (RSI) software systems for a detailed analysis and a analysis of most publically known attempts.

b) The already done optimizations of the used software (of the A(G)I(s)) and the format in which the programs are encoded.

All current ML frameworks make certain assumptions and tradeoffs between (software) optimizations and ease of use for human programmers. The efficiency of lets say Tensorflow can be greatly improved for most special cases.

Incapable A(G)I's may require the description of the algorithms with DSL's because they fail to reason about contemporary programming languages (C, C++, Java, etc) and frameworks (Tensorflow, etc.). Further they may require speciallized training and/or software to develop software.

c) The mental architecture of the A(G)I's

Some architectures might be easier to improve by the A(G)I's than others. One extreme is where the AGI was built by an specialized AI - here everything is "in the mind" of the AGI. One other extreme is a architecture which is based on a biological brain. This might be extremely hard or impossible to improve uppon because natural evolution had done all optimizations it could do in 100's of millions of years.

Hardware

Specialized Hardware is faster than Software. Examples for this are uses of FPGA's, GPU's and custom ASICs.

Speedup of FPGA code depends on the used FPGA and the algorithm and datastructures as well as the implementation itself. Typically in the range on ~100x - 10000x (?) vs CPU's.

Speedups of GPU code depends on a lot of factors - but are usually between 5x to serveral 100 x. This all depends on the optimizations done on the CPU software which are used for comparision.

A example for custom ASIC's are "Tensor Processing Units". The speedup of TPU's today is ~2.8x against GPU's - depending on the workload Benchmarking Google’s new TPUv2. Nothe here that custom ASIC's may be more energy efficient than CPU's, GPU's or FPGAs.

Economics

Lets assume that a sufficiently developed AGI is used by entities which ressemble companies of today (2019). We can put entities on a graph where the X axis is the amount of work done (by some computable or not computable metric) and the Y axis is the ration between human labor and work done by AGI's.

Purely human driven entities are essentially like companies of today - they may use weak AI for some tasks (like everyone is doing today - weak AI is everywhere).

There is a interesting regime where a lot of work is done by humans and AGI's. AGI's might get tasked with all sorts of tasks. Interesting tasks worth to mention here include company leadership and decision making for the company. This comes with it's own social problems inside a mixed company - who would like to work for an AGI where the AGI is the boss and decides on the fate of the company. A mixed version of the "AGI leadership" idea are humans which use AGI's as an oracle to make decisions. There are lots of possibilities of only this interaction.

The other extreme regime is where almost all or all work is done by AGI's. Human operators may or may not exist and excert power over the AGI's. Note here that many AGI's may act like a single AGI. One other interesting effect is that AGI's may decide to split off and form their own "company" - or they might decide to fuse. This occurs today with contemporary companies but at a slow pace. AGI's may do this in a very short time (minutes, seconds, etc).

Then there will be basically three different company like entities - purely human driven ones, ones where there is a mix of AGI's and humans and the third category is made up of almost only AGI's.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.