This model implements a classic scenario used in Reinforcement Learning problem, the “Cliff Walking Problem”. Consider the gridworld shown below (SUTTON; BARTO, 2018). This is a standard undiscounted, episodic task, with start and goal states, and the usual actions causing movement up, down, right, and left. Reward is -1 on all transitions except those into the region marked “The Cliff.” Stepping into this region incurs a reward of -100 and sends the agent instantly back to the start (SUTTON; BARTO, 2018).

The problem is solved in this model using the Q-Learning algorithm. The algorithm is implemented with the support of the NetLogo Q-Learning Extension

This is a re-implementation of a the NetLogo model Maze (ROOP, 2006).

This re-implementation makes use of the Q-Learning NetLogo Extension to implement the Q-Learning, which is done only with NetLogo native code in the original implementation.

Exploring how learning and social-ecological networks influence management choice set and their ability to increase the likelihood of species coexistence (i.e. biodiversity) on a fragmented landscape controlled by different managers.

I added a discounting rate to the equation for expected values of defective / collaborative strategies.
The discounting rate was set to 0.956, the annual average from 1980 to 2015, using the Consumer Price Index (CPI) of Statistics Korea.

This simulation is of the 2003 Station Nightclub Fire and is part of the Interdependencies in Community Resilience (ICoR) project (http://www-personal.umich.edu/~eltawil/icor.html). The git contains the simulation as well as csvs of data about the fire, smoke, building, and people involved.

This NetLogo model illustrates the cultural evolution of pro-environmental behaviour patterns. It illustrates how collective behaviour patterns evolve from interactions between agents and agents (in a social network) as well as agents and the affordances (action opportunities provided by the environment) within a niche. More specifically, the cultural evolution of behaviour patterns is understood in this model as a product of:

1. The landscape of affordances provided by the material environment,
2. Individual learning and habituation,
3. Social learning and network structure,
4. Personal states (such as habits and attitudes), and
   …

Aqua.MORE (Agent-based MOdelling of REsources in Socio-Hydrological Systems) is an agent based modelling (ABM) approach to simulate the resource flow and social interaction in a coupled natural and social system of water supply and demand. The model is able to simulate the two-way feedback as socio-economic agents influence the natural resource flow and the availability of this resource influences the agents in their behaviour.

B3GET simulates populations of virtual organisms evolving over generations, whose evolutionary outcomes reflect the selection pressures of their environment. The model simulates several factors considered important in biology, including life history trade-offs, investment in fighting ability and aggression, sperm competition, infanticide, and competition over access to food and mates. Downloaded materials include starting genotype and population files. Edit the these files and see what changes occur in the behavior of virtual populations!

View the B3GET user manual here.

The model is designed to analyse the effects of mitigation measures on the European brown hare (Lepus europaeus), which is directly affected by ongoing land use change and has experienced widespread decline throughout Europe since the 1960s. As an input, we use two 4×4 km large model landscapes, which were generated by a landscape generator based on real field sizes and crop proportions and differed in average field size and crop composition. The crops grown annually are evaluated in terms of forage suitability, breeding suitability and crop richness for the hare. Six mitigation scenarios are implemented, defined by a 10 % increase in: (1) mixed silphie, (2) miscanthus, (3) grass-clover ley, (4) alfalfa, (5) set-aside, and (6) general crop richness. The model shows that that both landscape configuration and composition have a significant effect on hare population development, which responds particularly strongly to compositional changes.

BEGET Classic includes previous versions used in the classroom and for publication. Please check out the latest version of B3GET here, which has several user-friendly features such as directly importing and exporting genotype and population files.

The classic versions of B3GET include: version one and version three were used in undergraduate labs at the University of Minnesota to demonstrate principles in primate behavioral ecology; version two first demonstrated proof of concept for creating virtual biological organisms using decision-vector algorithms; version four was presented at the 2017 annual meeting at the American Association of Physical Anthropologists; version five was presented in a 2019 publication from the Journal of Human Evolution (Crouse, Miller, and Wilson, 2019).