Thoughts on AI

Thoughts on the future of humanity, usually posted while I am drunk.

Thursday, August 24, 2006

An entropic view of AI

So what is it to view AI through the expanded view of entropy provided by MEP? Basically, we have a problem, and an agent who starts out with a large amount of "potential energy" which is not related to the solution to the problem. The agent goes through a series of iterations where it the "entropy" of the system is incrementally increased through finding paths of maximum entropy and avoiding restrains. When the entropy in the agent has increased its maximum state, it has grown a solution of some kind to the problem. It settles into the state of least resistence, which is an optimal solution for the agent in the time given.

If the agent is trained, the entropy used for solutions will be the entropy at the end of the training sets. The entropy should be observable, and fallow a curve similar to those you can get by graphing Shannon Entropy with different probability distributions.

Starting Thoughts

So basically what I want to do this quarter is to pull theory together, and come up with some kind of cohesive set of tools for organic programming and software applications. I am using this term "organic programming" to refer to life driven designs, which will include AI things but also evolutionary algorithms and the like. I want a solid cohesive theory, I want to strip down things to the most fundamental level.

http://www.entropylaw.com/

Gives a persuasive view of life and cognition as arising from entropy, or more specifically the "Expanded view" of entropy that comes from the Law of Maximum Entropy Production, which states that order is expected to arise from entropy, rather than pure homogenous disorder, (Kind of a contradiction, that term) This gets rid of previous akward attempts to explain life as an "obstruction" to entropy, and lets us see the universe as a continuum.

The heart of the idea is that order is produced by entropy when an ordered path happens to produce more entropy (minimalize the potential) faster than other paths. These other paths are therefore viewed as "restraints". Viewing early life through this lense, we see natural selection to be the series of restraints placed upon the replicating lifeforms, so that the selected genetic variations are the paths of maximum entropy. I see congition as a product of evolution, evolution as a product of entropy, or rather the second law of thermodynics.