↓ Skip to main content

From Animals to Animats 12

Overview of attention for book
Cover of 'From Animals to Animats 12'

Table of Contents

  1. Altmetric Badge
    Book Overview
  2. Altmetric Badge
    Chapter 1 Natural and Artificial Systems: Compare, Model or Engineer?
  3. Altmetric Badge
    Chapter 2 LocoKit: A Robot Construction Kit for Studying and Developing Functional Morphologies
  4. Altmetric Badge
    Chapter 3 An Introduction to the Analysis of Braitenberg Vehicles 2 and 3 Using Phase Plane Portrait
  5. Altmetric Badge
    Chapter 4 Synthesis and Adaptation of Effective Motor Synergies for the Solution of Reaching Tasks
  6. Altmetric Badge
    Chapter 5 Gaze Allocation Analysis for a Visually Guided Manipulation Task
  7. Altmetric Badge
    Chapter 6 Using Sensorimotor Contingencies for Terrain Discrimination and Adaptive Walking Behavior in the Quadruped Robot Puppy
  8. Altmetric Badge
    Chapter 7 How Walking Influences the Development of Absolute Distance Perception
  9. Altmetric Badge
    Chapter 8 Modelling Interaction in Multi-modal Affordance Processing with Neural Dynamics
  10. Altmetric Badge
    Chapter 9 A Bio-inspired Model Reliably Predicts the Collision of Approaching Objects under Different Light Conditions
  11. Altmetric Badge
    Chapter 10 Synthesising a Motor-Primitive Inspired Control Architecture for Redundant Compliant Robots
  12. Altmetric Badge
    Chapter 11 Using Sensorimotor Contingencies for Prediction and Action Planning
  13. Altmetric Badge
    Chapter 12 A Bio-inspired Control System for a Wearable Human-Machine Interface
  14. Altmetric Badge
    Chapter 13 A Finite Element Method of Electric Image in Weakly Electric Fish
  15. Altmetric Badge
    Chapter 14 Multimodal Integration of Visual Place Cells and Grid Cells for Navigation Tasks of a Real Robot
  16. Altmetric Badge
    Chapter 15 Towards a Neural Hierarchy of Time Scales for Motor Control
  17. Altmetric Badge
    Chapter 16 Modelling Walking Behaviors Based on CPGs: A Simplified Bio-inspired Architecture
  18. Altmetric Badge
    Chapter 17 Plastic Representation of the Reachable Space for a Humanoid Robot
  19. Altmetric Badge
    Chapter 18 Towards Behavioral Consistency in Neuroevolution
  20. Altmetric Badge
    Chapter 19 Evolving Variants of Neuro-Control Using Constraint Masks
  21. Altmetric Badge
    Chapter 20 The Search for Beauty: Evolution of Minimal Cognition in an Animat Controlled by a Gene Regulatory Network and Powered by a Metabolic System
  22. Altmetric Badge
    Chapter 21 Evolving Reactive Controller for a Modular Robot: Benefits of the Property of State-Switching in Fractal Gene Regulatory Networks
  23. Altmetric Badge
    Chapter 22 Adaptation and Genomic Evolution in EcoSim
  24. Altmetric Badge
    Chapter 23 Degeneration of a von Neumann Self-reproducer into a Self-copier within the Avida World
  25. Altmetric Badge
    Chapter 24 The Emergence of Pathological Constructors When Implementing the von Neumann Architecture for Self-reproduction in Tierra
  26. Altmetric Badge
    Chapter 25 Automatic Synthesis of Controllers for Real Robots Based on Preprogrammed Behaviors
  27. Altmetric Badge
    Chapter 26 Self-organization of Visual Sensor Topologies Based on Spatiotemporal Cross-Correlation
  28. Altmetric Badge
    Chapter 27 From Animals to Animats 12
  29. Altmetric Badge
    Chapter 28 A Computational Model of the Role of Serotonin in Reversal Learning
  30. Altmetric Badge
    Chapter 29 Which Temporal Difference Learning Algorithm Best Reproduces Dopamine Activity in a Multi-choice Task?
  31. Altmetric Badge
    Chapter 30 Multi-timescale Nexting in a Reinforcement Learning Robot
  32. Altmetric Badge
    Chapter 31 Self-organizing Developmental Reinforcement Learning
  33. Altmetric Badge
    Chapter 32 Adaptive Learning in Continuous Environment Using Actor-Critic Design and Echo-State Networks
  34. Altmetric Badge
    Chapter 33 Learning Adjectives and Nouns from Affordances on the iCub Humanoid Robot
  35. Altmetric Badge
    Chapter 34 Learning and Adaptation of Sensorimotor Contingencies: Prism-Adaptation, a Case Study
  36. Altmetric Badge
    Chapter 35 Unsupervised Learning of a Reduced Dimensional Controller for a Tendon Driven Robot Platform
  37. Altmetric Badge
    Chapter 36 Adaptive Quadruped Locomotion: Learning to Detect and Avoid an Obstacle
  38. Altmetric Badge
    Chapter 37 Attentional Action Selection Using Reinforcement Learning
  39. Altmetric Badge
    Chapter 38 Analysing an Evolved Robotic Behaviour Using a Biological Model of Collegial Decision Making
  40. Altmetric Badge
    Chapter 39 On the Evolution of Homogeneous Multi-robot Teams: Clonal versus Aclonal Approach
  41. Altmetric Badge
    Chapter 40 Biologically-Inspired Deceptive Behavior for a Robot
  42. Altmetric Badge
    Chapter 41 Automated Synthesis of Locomotion Controllers for Self-reconfigurable Modular Robots
  43. Altmetric Badge
    Chapter 42 Towards Detecting Group Identities in Complex Artificial Societies
  44. Altmetric Badge
    Chapter 43 Cost, Precision, and Task Structure in Aggression-Based Arbitration for Minimalist Robot Cooperation
  45. Altmetric Badge
    Chapter 44 Examining the Information Requirements for Flocking Motion
Attention for Chapter 30: Multi-timescale Nexting in a Reinforcement Learning Robot
Altmetric Badge

Mentioned by

1 blog


3 Dimensions

Readers on

33 Mendeley
1 CiteULike
You are seeing a free-to-access but limited selection of the activity Altmetric has collected about this research output. Click here to find out more.
Chapter title
Multi-timescale Nexting in a Reinforcement Learning Robot
Chapter number 30
Book title
From Animals to Animats 12
Published by
Springer, Berlin, Heidelberg, August 2012
DOI 10.1007/978-3-642-33093-3_30
Book ISBNs
978-3-64-233092-6, 978-3-64-233093-3

Joseph Modayil, Adam White, Richard S. Sutton, Modayil, Joseph, White, Adam, Sutton, Richard S.

Mendeley readers

The data shown below were compiled from readership statistics for 33 Mendeley readers of this research output. Click here to see the associated Mendeley record.

Geographical breakdown

Country Count As %
United Kingdom 1 3%
Spain 1 3%
Unknown 31 94%

Demographic breakdown

Readers by professional status Count As %
Student > Ph. D. Student 12 36%
Student > Master 10 30%
Professor 3 9%
Student > Doctoral Student 2 6%
Student > Postgraduate 2 6%
Other 4 12%
Readers by discipline Count As %
Computer Science 16 48%
Engineering 9 27%
Agricultural and Biological Sciences 4 12%
Psychology 1 3%
Mathematics 1 3%
Other 2 6%