sábado, 25 de octubre de 2008

Martin Nowak and Cooperation



Martin A. Nowak, the master of the spatial games published two years ago a book, entitled "Evolutionary Dynamics: Exploring the Equations of Life" (Belknap Press, 2006). We remark some references by Nowak about cooperation in this book.
According to Nowak, experimental game theory shows that humans do not behave rationally. They are guided by instincts that might have evolved via different situations. In the Prisoner´s Dilemma, humans often try to cooperate. Cooperation means not to cooperate with the state attorney but to cooperate with your partner and remain silent. If both of you defect, both will get a long prison sentence. No matter what your partner does, it is better for you to defect. The rational analysis suggests that both prisoners will confess and spend a long time in jail. Defector always have a higher fitness than cooperators. Natural selection increases the frequency of defectors until cooperators have become extinct. But cooperation becomes a promising option when the game is repeated several times between the same two players. Consider a strategy in which an agent cooperates on the first move and then cooperates as long as the opponent does not defect. If the opponent defects once it will switch permanently to defection and it will never forgive. This strategy is a strict Nash equilibrium versus a strategy consisting in always defect. In terms of evolutionary dynamics, if the whole population uses the first strategy, then the second one cannot invade. Obviously, human strategic instincts are not formed by playing games with a well-defined number of rounds. In the lifetime there might always be another round. There is always a tomorrow in our plans.

sábado, 18 de octubre de 2008

Towards a computational model of craving in addictions


Several computational models try to explain the brain mechanisms in the origin of addictive behaviors. Perhaps, David A. Redish, Professor at the Department of Neuroscience (Minnesota University) has been the pioneer. He published in Science (2004) the article "Addiction as a computational process gone awry", a milestone for many other computational models.
Following to Redish and Johnson (2007), there are two systems in the mammalian brain with differing levels of search: (1) a flexible system, which is capable of being learned quickly, but is computationally expensive to use, and (2) an inflexible system, which can act quickly, but must be learned slowly. The flexible system allows the planning of multiple paths to achieve a goal; the inflexible system only retrieves the remembered action for a given situation. The authors hypothesize a unified system incorporating three subsystems, a situation recognition system and two contrasting decision systems-a flexible, planning-capable system that accommodates multiple paths to goals and takes into account the value of potential outcomes, and an inflexible, habit-like system.
The flexible decision-making system requires recognition of a situation, recognition of a means of achieving outcome from situation as well as the evaluation of the value of achieving outcome.
The inflexible decision-making system entails a simple association between situation and action. Evaluation entails a memory recall of the learned associated value of taking an action in the situation. To evaluate the value of an outcome, the system needs a signal that recognizes hedonic value. Two brain structures that have been suggested to be involved in the evaluation of an outcome are the orbitofrontal cortex and the ventral striatum. Neurons in the ventral striatum show reward correlates, and anticipate predicted reward. The hippocampus projects to ventral striatum and ventral striatal firing patterns reflect hippocampal activity.
It seems that hedonic signals are carried by opioid signaling. If endogenous opioids signal the actual hedonic evaluation of an achieved outcome, then when faced with potential outcome signals arriving from the hippocampus, one might expect similar processes to evaluate the value of expected outcomes. According to Redish and Johnson (art. cit., p. 330), this predicts that the effect of hippocampal planning signals on accumbens structures will be to trigger evaluative processes similar to those that occur in response to actual achieved outcomes. This has an effect for craving. Craving can be defined as the intense desire for something. Because the flexible system only entails the recognition that an action can lead to a potential path to a goal and does not entail a commitment to action, craving is not necessarily going to produce action selection. When the hippocampal component reaches a goal that is evaluated to have a high value, this will produce a strong desire to achieve that goal: the psychological effect of that recognition is to produce craving.
Competitive opioid antagonists have been used clinically to reduce craving. The hypothesis that reward signals are released on recognition of a pathway to a high-value outcome implies that blocking those reward signals would not only reduce the subjective hedonic value of receiving reward, but would also reduce craving for those rewards. If that reward signal is based on opioid signaling, then this may explain why an opioid antagonist such as naltrexone can reduce craving.

viernes, 10 de octubre de 2008

José Mira: in memoriam



On August 13th, 2008, Spanish engineer José Mira died in Madrid. Specialists in Artificial Intelligence and others will remember Mira as a sharp thinker and a nice person, whose interests and expertise ranged from theoretical and applied Artificial Intelligence to Cognitive Science. Professor Mira did much to establish in 1989 the Department of Artificial Intelligence at UNED. Mira' s research contributions were focused on methodological aspects in Knowledge Engineering and the connections between Neuroscience and Computation. From an applied perspective he worked about Knowledge Systems in Medicine and Industry. Definitely, Mira has been one of the principal influences on AI in Spain and Latin America: his death feels like losing a decisive influence.