The problem of fitness Beings of the synthetic world

understanding by studying species that have much simpler nervous systems than humans, because in them the connection between structure and func- tion are much more apparent. This makes the task of modeling them easier. We can call this ap- proach ‘the worm’s-eye view of intelligence’. This trend is followed by neuroethology and its newer version, called computational neuroethology Beer, 1990; Cliff, 1994. The latter is distin- guished from other trends of computational mod- eling of the nervous system in that it examines the neural mechanisms that take part in creating be- havior. The nervous system and its functioning is not modeled by itself, but as a part of the whole living organism, creating a consistent system — similar to real biological organisms. To achieve this we have to model the whole sensory-motor apparatus that contributes to the creation of be- havior and put it into the suitably formed model of a body. This type of autonomous agents is called ‘animats’ Wilson, 1991; Guillot and Meyer, 1994. They are put into a simulated envi- ronment, so the functioning of the model nervous system will be revealed by the behavior of the animat in that particular environment. This en- ables us to model the neural control of behavior and to study the interaction between the nervous system, behavior and the environment. Behavior — a sequence of actions — is the result of the interaction between the animal or animat and its environment. Behavior is regarded adaptive if the animat responds to environmental stimuli in ways that promote the survival of the organism Meyer and Guillot, 1994. Adaptive behavior is a broad ability to cope with the com- plex, dynamic, unpredictable world in which the given organism lives. A trait is adaptive if it contributes to an organism’s overall survival. Strictly speaking, ‘adaptive behavior’ means be- havior which is adjusted to environmental condi- tions Beer, 1990.

3. The problem of fitness

We would like to stress that the concept of fitness has another meaning in these models than in population biology. In the latter case fitness is a mathematically well-defined term, a statistical parameter that is calculated on the basis of the gene frequencies in the descendant population. In our models we use the term ‘fitness’ to describe the assessment of the indi6idual performances, which is the basis for selection. In this case fitness indicates individual suitability, so it has an etho- logical rather than a population biological mean- ing. It is a less exact concept and has more intuitive elements. The simplest but most frequently used and life- like method that serves for the assessment of the performance of the modeled phenotype is a ‘bi- nary fitness function’, which tells whether the given individual survives or dies at the end of a simulation step Michel and Biondi, 1994. It is applicable when the task of the model organism is to try to find food. If their behavior control is not good enough, the individual ‘starves to death’. Otherwise it ‘survives’ the trial Nolfi and Parisi 1991; Nolfi et al., 1994a.

4. Beings of the synthetic world

The computer-simulated animals can be classified by the features of their nervous systems that enable them to behave in an adaptive way. One group of animats had a carefully planned and precisely wired neural net. In this group effective functioning is the result of profound knowledge of the neuroanatomy and physiology of the modeled species. Such a model mimics a concrete species and is able to generate the char- acteristic behavior of that species Beer, 1990; Cliff, 1994. Another type of model tries to minimize the preprogrammed design of the nervous system, so the behavior of the animat becomes more efficient by its own ‘experiences’. If the environment changes, the animat is able to adapt to the new circumstances by modifying its behavior Cecconi et al., 1995; Kodjabachian and Meyer, 1996. To achieve this we have to apply mechanisms that are both able to ensure the plasticity of the nervous system and have a biological basis. One of these methods is Hebbian learning, when the synaptic weights are modified according to the Hebbian rule, hereby the probability of adaptive reactions increases in a given situation. The plasticity of the neural net is more manifest in models where the number, the position and the connections of the neurons are the result of an ontogenetic process, i.e. one that is influenced by both the information encoded in the genome and the effects of the environment. Changes in the genome of the successive generations because of mutation and crossing-over also increase the pos- sible variations of the neural net and the probabil- ity of development of the most adaptive behavior too Nolfi and Parisi, 1995. Neural networks that are created to study the regulatory mechanisms underlying adaptive be- havior are called ecological neural networks or econets Parisi et al., 1990. The object of these models are not to reproduce the structure of the nervous system and behavior of a certain species, but to study ways in which simple rules and interaction with the environment can produce adaptive behavior.

5. The animat and its environment