TY - JOUR
T1 - Tackling learning intractability through topological organization and regulation of cortical networks
AU - Thangavelautham, Jekanthan
AU - D'Eleuterio, Gabriele M.T.
N1 - Funding Information:
Manuscript received January 10, 2011; revised November 3, 2011; accepted November 15, 2011. Date of publication January 27, 2012; date of current version March 6, 2012. This work was funded by the Natural Science and Engineering Research Council of Canada, which the authors gratefully acknowledge.
PY - 2012
Y1 - 2012
N2 - A key challenge in evolving control systems for robots using neural networks is training tractability. Evolving monolithic fixed topology neural networks is shown to be intractable with limited supervision in high dimensional search spaces. Common strategies to overcome this limitation are to provide more supervision by encouraging particular solution strategies, manually decomposing the task and segmenting the search space and network. These strategies require a supervisor with domain knowledge and may not be feasible for difficult tasks where novel concepts are required. The alternate strategy is to use self-organized task decomposition to solve difficult tasks with limited supervision. The artificial neural tissue (ANT) approach presented here uses self-organized task decomposition to solve tasks. ANT inspired by neurobiology combines standard neural networks with a novel wireless signaling scheme modeling chemical diffusion of neurotransmitters. These chemicals are used to dynamically activate and inhibit wired network of neurons using a coarse-coding framework. Using only a global fitness function that does not encourage a predefined solution, modular networks of neurons are shown to self-organize and perform task decomposition. This approach solves the sign-following task found to be intractable with conventional fixed and variable topology networks. In this paper, key attributes of the ANT architecture that perform self-organized task decomposition are shown. The architecture is robust and scalable to number of neurons, synaptic connections, and initialization parameters.
AB - A key challenge in evolving control systems for robots using neural networks is training tractability. Evolving monolithic fixed topology neural networks is shown to be intractable with limited supervision in high dimensional search spaces. Common strategies to overcome this limitation are to provide more supervision by encouraging particular solution strategies, manually decomposing the task and segmenting the search space and network. These strategies require a supervisor with domain knowledge and may not be feasible for difficult tasks where novel concepts are required. The alternate strategy is to use self-organized task decomposition to solve difficult tasks with limited supervision. The artificial neural tissue (ANT) approach presented here uses self-organized task decomposition to solve tasks. ANT inspired by neurobiology combines standard neural networks with a novel wireless signaling scheme modeling chemical diffusion of neurotransmitters. These chemicals are used to dynamically activate and inhibit wired network of neurons using a coarse-coding framework. Using only a global fitness function that does not encourage a predefined solution, modular networks of neurons are shown to self-organize and perform task decomposition. This approach solves the sign-following task found to be intractable with conventional fixed and variable topology networks. In this paper, key attributes of the ANT architecture that perform self-organized task decomposition are shown. The architecture is robust and scalable to number of neurons, synaptic connections, and initialization parameters.
KW - Coarse coding
KW - evolutionary algorithms
KW - robotics
KW - task decomposition
UR - http://www.scopus.com/inward/record.url?scp=84876947700&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84876947700&partnerID=8YFLogxK
U2 - 10.1109/TNNLS.2011.2178311
DO - 10.1109/TNNLS.2011.2178311
M3 - Article
C2 - 24805039
AN - SCOPUS:84876947700
SN - 2162-237X
VL - 23
SP - 552
EP - 564
JO - IEEE Transactions on Neural Networks
JF - IEEE Transactions on Neural Networks
IS - 4
M1 - 6140581
ER -