The Fade-in Protocol

by | Jun 3, 2018

The origins of the protocol were first documented over 50 years ago, but it is not a well-known or frequently selected protocol. Susan Friedman explains the original experiment succinctly in her article Clearing the Path to Reinforcement with an Errorless Learning Mindset:

Terrace (1963) researched errorless learning with a successive discrimination task. In the traditional successive discrimination procedure (different than Terrace’s procedure), a pigeon, for example, is reinforced with food for pecking a disk on the wall of an operant chamber (called a key light or key) when it’s illuminated red. After many repetitions, when the pecking behavior in the presence of the red key is well established the color of the key changes to green and pecking is no longer reinforced. With the standard protocol then, the red light is the discriminative stimulus (SD) that cues pecking for food reinforcement, and the green light is the stimulus delta (S ∆) that signals the extinction condition, i.e., pecking will not produce food reinforcement. The red and green keys are then alternately presented with the corresponding reinforcement and extinction conditions in effect. After initially making many errors (due to response generalization), the correct differential response to key color gradually occurs (Pierce & Cheney, 2013).
Alternatively, Terrace used two procedures in his errorless discrimination training not typical of standard discrimination training. First, the S ∆ condition, the green key, was introduced very early in the program before pecking in the redlight condition was well established. Second, Terrace used a fading (i.e., fading in) procedure to present the green key at different values, gradually increasing brightness, wavelength and duration over the repetitions. These two procedures resulted in faster learning of the discrimination and very few errors. The pigeons trained with the errorless discrimination procedures made about 25 errors (i.e., pecking the green key light) compared to 2000 to 5000 errors made by the pigeons taught with standard procedures. Only those birds trained with T&E exhibited emotional responses in the presence of the S ∆. The pigeons trained with the errorless approach remained calm until the red disk, the SD, appeared.
These findings have been widely replicated across species. Powers, Cheney, & Agostino (1970) found that preschool children taught a color discrimination with errorless learning procedures learned faster and with fewer errors, and they enjoyed learning more than the children taught with standard procedures. Roth reported similar results with dolphins (as cited in Pierce & Cheney, 2013).

 

Even though today we are surrounded by many available protocols for teaching with positive reinforcement, there is still a persistence that a dog should be set-up to make an error. The reasons for this are extensive:

“the dog needs to know when they are wrong so that they can focus on what is required”

“we are building resilience”

“this teaches a dog impulse control”

With this mindset underpinning the training, adding reinforcement to correct choices does not make it positive learning. Any time being wrong is deliberately included in the curriculum we are failing our learners. Sure, learning may be effective, unforgotten and lifelong but at a cost.

The cost can be a mistrust in the teacher. When the learner is faced with a new lesson they may first ask “what is the trap?” This is a negative view and likely to cause hesitation and a resistance to discovery and exploration. If you think your teacher is only setting you up for success you approach with an enthusiasm and eagerness for the learning.

All of us have been damaged by the error-trap. Whether it was deliberate on part of the teacher or not, it makes us cautious learners.

In addition to this approach to learning we then experience frustration, that can escalate to rage, when we cannot solve the error. If you have ever used a computer connected to a printer you have experienced this. And it wasn’t good.

Application of the Fading-In Protocol

This is an elegant process that builds on success and teaches exquisite discrimination skills.

When a stimulus is presented it is rarely in isolation. Reality surrounds our stimulus with relevant and non-relevant information. We cue a behaviour verbally the way we are standing can either support that information our contradict it. A step towards the dog as we cue a “sit” can force the dog to take a step back: the step towards contradicts the verbal cue.

When teaching a behaviour we want to surround the stimulus (which may be the temporary cue, not the final one) with an environment that encourages success, not error. Under these conditions an error is simply information that tells you the environment needs changing. The dog is responding to a selected cue that does not contribute to our goal. The step towards causing the dog to step back.

It is always the dog that get to choose what is relevant and what information they are receiving.

If I have food in my hand and I have used food to hand-lure behaviour, then a step towards food in the hand is a correct response for that dog. If you have taught a nose-touch to hand, then a hand cue that asks the dog to wait, hold position, is a mixed message.

To be able to teach without confusion, frustration or error we need to be clear in our communication and understanding of what information the dog is taking from the environment.

 

An error is simply the difference between
my expectation and the dog’s response.

 

I consider errors valuable information:

it shows me what the dog understands is likely to earn reinforcement

it may tell me what the “hot” behaviour is at that moment (the most recently reinforced behaviour),

it may tell me the dog is becoming mentally tired, particularly if the error rate has increased

it may tell me a change in the environment is a stress overload. It could be too much information, a threat or opportunity the dog is struggling to resolve.

it may tell me the dog cannot recognise the cue (I was too loud, too quick, or ambigious)

Errors should be noted, and if possible logged with a clear description. The type of error, or response from the dog, can often give us important information, it should not be simply recorded as “error”.

Before we begin the practical work we should prepare a range of events to fade-in. These are our green:blinks – the increasing brightness, wavelength and duration of the light in the Terrace experiment. They should be of short duration: a blink, of low intensity: quite far away, and have very little impact or relevance to the dog. Green:blinks should never be an event or something the dog wishes to avoid. We train with attractions, not aversions.

If you have a training assistant they need to be fully aware of how to fade-in and when to fade-out. If you are training alone, use a fixed green:blink and as you progress through the repeats of the cycle you can control the exposure of the dog to the green:blink. You could use a pot of food on a chair outside the doorway. At first it is not on view, then on view for a moment, then increasingly in full view, then closer in proximity until the dog is rolling through their cycles alongside the chair.

To begin the fade-in application we begin with the base behaviour. If it has been taught previously then it would benefit from refreshing. This is the behaviour the dog will default to when unable to make a choice. It is the red light in the Terrace experiment.

We choose this behaviour in the cycle of Antecedent, Behaviour [Mark], Consequence. [Mark] is optional. We look to see if the dog is ready and seeking a cue, we give the cue (A), the dog responds with (B), we mark this to promise good things and begin the reinforcement delivery process (C). As the dog consumes their treat they will be seeking another cue. More ..?

After the dog has completed the behaviour, been marked and is seeking their reward, we begin to introduce the minimal green:blink. If it can be arranged it is a short “blink” between the mark and the collection of the food. Either as I reach, walk or open the pot, or the dog runs after a thrown treat or steps towards an offered treat.

Introduction of the green:blink at this stage can provide me with valuable information:

~ The dog has been marked and in their experience this leads directly to much anticipated reinforcement. I suspect this is the strongest part of the ABC cycle. If at the moment of travelling to reinforcement the green:blink is of greater interest, then the only part of the cycle that has been interrupted is the collection of a treat. The dog has chosen green:blink as a preferred reinforcer. That is important information that may impact on my choice of reinforcer.

~ If the dog shows awareness of the green:blink and continues to consumption of their treat then there is a pairing beginning of green:blink and treats.

~ If the dog chooses to explore, investigate the green:blink, we should not regard this as an error and make an teeth sucking, sighs or noises. No error, just information. The dog still gets their treat and we change the green:blink – further away, for shorter duration AND increase the value of the reinforcer. We are not seeking to punish, just seeking information.

If you look at the data you collect you may see that when a novel event arises the dog will look to it for a second or two, perhaps hesitate, process the information and make a choice to pursue the reinforcer you have offered.

It is this process of assessment and choice that is the skill we want to teach, we want to let the dog learn how to make fast judgements about their options. I am tempted to call this a “WTF” moment, where the dog will look, and then continue the cycle. If the WTF breaks the focus on the cycle, then the fade-in has been too invasive. Adjust and proceed.

This is the skill of living in an environment that is overflowing with many choices.

Once the fade-in has proven to not break the “C” part of the cycle in 6-10 alterations of intensity, we want to migrate the fade-in and WTF opportunity to earlier in the cycle.

It is important that we keep the behaviour stable. Reinforcement is still occurring and if our green:blink has caused a wobble in the behaviour this will get reinforced. Dangerous ground. We should only progress to green:blinks during the behaviour  (5) when green:blink has travelled many other places around the cycle and changed in intensity without causing hesitation.

The delight in this process is many fold. Dogs generalise this very well. We can choose a cosmetic behaviour to teach it, not a life-important behaviour, and the dog will transfer the skills of maintaining the ABC cycle.

Be careful not to label this process as “proofing”. We are not trying to test out the behaviour or the dog’s resilience. It is a teaching process that develops a dog’s capacity to focus on our training of cycles. If a green:blink produces a reduction in the quality of that focus, we are setting up a permanent poor association that often gets reinforced (“because he sort of did it anyway”).

You will have to find a way to laugh off the exceedingly long WTFs that may occur, plan for it and make sure you find a way of letting the dog know you screwed up and you would like to start again (after having sent green:blink packing).

I use fading-in many, many times during every training session. We use it all day long if we look for it and your dog practices many WTFs – deciding that when you scratch your ear it is just a green:blink, that when the adverts roll on the TV, it is just a green:blink. These are non-relevant events that do not impact of their comfortable snooze, chewing of a bone, or deep hand-massage. It is a quite natural survival skills of assessing what information the dog should pay attention to under specific circumstances. Often we need to dress-rehearse those circumstances to enable the dog to be confidence and fluent.

 

Explore

COURSES

Build the Learning

Lifelong skills built in activities and play. A dog that is curious, confident, resilient with a natural enthusiasm for learning.

rewards skills

Learn about the fascinating landscape of rewards and how to make them the centre of your training and relationship.

Management or Training

Find a pathway to suit your lifestyle of living with dogs. When management temporarilly supports the learning, or choose training.

learn well
learn it once

Setter Members

Access to The Sett community and groups

Discount for all courses and videos 50%

Archives of previous courses and books

Share your learning, upgrade your thinking

£140

Key Reading

Location is Their Cue

We begin teaching the dog to go to a target, such as a mat or platform and in this process our focus is on the outcome – the dog can place feet on the object or settle down. But at the same time this learning is happening the dog is also noting the location: where this is happening in this room, in the house, relative to the food-machine (you).

Cue Seeking is Connection

Connection is very individual and to be authentic we have to observe, slow down, understand our dogs and meet them where they are.

The Right Bed in the Right Spot

Resting and sleeping are not necessarily the same state. Good sleep where we feel safe and comfortable is important for us all.

Play Health Check

When we look at play or food delivery as an ACTIVITY we share the same mindset as the dog: is there pleasure to be experienced?

Since the Dawn of Dog Training

The old joke reminds us that the only thing dog trainers can agree on is that their training method in the best one. It becomes increasingly difficult to know which method is “right” and whether it will suit the dog, the situation and trainer’s skills.

Back to Basics?

The word “basic” is often derided as synonymous with “shallow,” but in its origins it is the very opposite: foundational, profound, supportive.

The Whole of The Dog

We cannot divide training into compartments of fast recalls, or sit for greeting, or loose leads as everything we ask of the dogs is interrelated.

Not Today and Not for My Sheepdogs

Standard protocols of extinction, impulse control, counterconditioning are quickly grabbed off the shelf as satisfactory solutions. These solutions are unlikely to help your collie, your sheepdog as the focus is heavily on suppression of who they are and why they live.

Do you see what I see

Doing better is the reward from doing the work. This work needs to be the right work at the right time with the right intent done in the right way.

The Cost of Cherrypicking

When we admit that the ideas we’re sharing are derived from the work of others, we demonstrate our own commitment to learning

Top Training

Evidence of learning

When we use the words “teach” or “train” child, person or dog, the operative term implies that the process is under the ownership of the teacher or trainer. What your teacher thinks you have learned may not be what you actually learned.

One dog watching

The other dog working
or ….how to train the spectators to quietly rest and watch whilst you work, play, teach a single member of the group

The Power of Passive Learning

Active learning: the learner takes active choice of what to do, how to respond, is attentive and making conscious effort
Passive learning: little conscious effort, reward is delivered for minimum effort.

A Day of Learning

A no-training day does not mean he gets a lazy day lying idly in the sun. Learning is still happening and this is significant and important for his development.

Surprising Puppy

Surprising Puppy. With obnoxious moments. After introducing the obnoxious puppy as a youngster I am knocked over by the Delightful Young Man he is turning into……

Obnoxious Puppy

The delight of your new puppy is probably going to last a few weeks, maybe four if you are lucky. When 12 weeks old hits, and you will feel a slam, the Delight is going to demonstrate ungrateful, obnoxious traits.

Preparation

Preparing before you train and the final check list

More than words

We expect our dogs to understand the meaning of words and signals, but if you have ever worked with computers you will know that what you say doesn’t always turn into an actionable response.

Not all lures contain food

“the direct use of the reinforcer to elicit the behaviour”
This should always be foremost in our mind, in that many alternatives lures are available.

Remote lures

Lures at a distance, separated from hands, pockets . Using reward stations, patterns, containers

6 Comments

  1. Michaela Hempen

    What a great Klog! After listening to talks on errorless learning two weeks ago and studying Terrace’s paper, I thought about how your puzzle or WTF moments fit into this versus training that sets the learner up to errors. I figured that the WTF moments don’t set the dog up for failure (and don’t intend to) and are so minimal that the dog can still be successful (“faded-in” as I learnt reading the article)

    Many thanks for this and very well timed. My pondering remained a WTF and did not escalate into a Leave It!

    Reply
  2. Michaela

    What a great Klog! After listening to talks on errorless learning two weeks ago and studying Terrace’s paper, I thought about how your puzzle or WTF moments fit into this versus training that sets the learner up to errors. I figured that the WTF moments don’t set the dog up for failure (and don’t intend to) and are so minimal that the dog can still be successful (“faded-in” as I learnt reading the article)

    Many thanks for this and very well timed. My pondering remained a WTF and did not escalate into a Leave It!

    Reply
  3. Kay Laurence

    Thanks Michaela, sometimes we don’t see the lines connecting the points until we wander around to a different view!

    Reply
  4. Sue McGuire

    This klog (I am learning to go with the new title) does go to the heart of how incredibly perceptive our learners are during the process. It’s our attentiveness to this that provides real learning and real leaps of understanding.
    What I had missed is being attentive to “moving” the irrelevant stimulus into different sections of the learning cycle. For some reason I had attached myself to the “A” part. When in reality it’s all “part” of the fading in.
    It’s quite astounding when you consider “fading in” IS part of the learning process.

    Reply
    • Kay Laurence

      It is strawberry season. Much anticipated (our version of the warm peaches direct from the tree). So if that strawberry, with some double cream is on the spoon and travelling to my mouth …… and the phone beeps …..

      There is NO question, the strawberry goes in the mouth, then I decide whether to attend to the phone.

      But if I was just slicing the strawberries, I would most likely interrupt that moment to pick up the phone.

      Reply
  5. Julie Van Schie

    What I love about this training is that the dog still has choice. We are not waving extra extra high value food or toys in front of his nose and using those to lure away from the “blink”. Rather the dog is allowed to look, to process and to decide “not relevant”. That way we can truly move at the dog’s pace.

    You are always thought provoking Kay!

    Reply

Trackbacks/Pingbacks

  1. Impulse control – mindset matters pt. 2 of 2 - Tromplo - […] reinforcement to begin with. Once the alternate behaviors are strong enough, next I carefully “fade in” (credit Kay Laurence)…

Submit a Comment

Your email address will not be published. Required fields are marked *

News on courses, articles and stuff you don't want to miss.

 

Woof!