Tuesday, September 4, 2018

Training Methodologies

By Erica Pytlovany

Positive reinforcement training, at its core, takes the following strategy:

  1. Look for, or create, behaviors that we like, and then
  2. Reinforce those behaviors, while we
  3. Passively ignore or actively prevent the behaviors that we don't like

Clicker training is positive reinforcement plus use of some kind of consistent, neutral mark that highlights the exact behavior that we want to repeat.  The mark could be a click, a tongue cluck, a whistle, the word "yes!", a flash of light, or any other neutral signal that the learner can perceive.  Clicker training is really about the mark, not the the actual clicker device; we could just as easily call it "marker training".

Within this framework, there are many ways to catch or to create behaviors.  I will refer to dogs for all descriptions, although we would use the same approach to teach catshyenas, llamasgibbonsdolphins, parrots, or even goldfish (yes, this is real).

Capturing

Description:  Mark and reward a behavior that the dog offers spontaneously during a training session, or even just while wandering around the house.  See something that you think is really cute?  Click it!  Examples could include:  cocking head to the side, sneezing, shaking off, holding ears a certain way.  Also an easy way to teach sit.
Upside:  Perfect when there's some behavior your dog offers and you'd like to put it on cue.
Downside:  Your dog has to offer the behavior all on its own.  You can't capture something that he never offers on his own.

Luring

Description:  Get your dog to follow a toy or food (primary reinforcer) to put him into a particular position (i.e. sit, down, heel position) or get him to follow a certain path (i.e. walk with me, go over a jump).
Upside:  A quick way to jump start a new behavior, especially if you lure the behavior one to three times and then switch to one of the other strategies.
Downside:  It can be hard to "fade out" or get rid of the lure.  If the dog is only following the food or the toy, he is not thinking about what he is doing and so probably won't connect the treat with the final behavior.  It might look like the dog "knows" how to do the behavior, but he can actually just do it when he's given assistance or when the treat is present.

Shaping

Description:  Shaping is a lot like the "Hotter, Colder" game we play as children except that you only get to use the word "hot", aka the click.  We start by capturing one small piece of the behavior and then gradually clicking for more and more pronounced movements toward our goal.  An example:  to shape a wave goodbye, we could click when the dog shifts his weight off his front paw, then click when the paw comes off the ground a tiny bit, then click when the paw is a few inches from the ground, and continue to only click the highest lifts until the paw is raised high.  Another: to teach a dog to touch a target, we might first click when the dog looks at the target, then click any movement toward the target, and finally click for contact with the target.
Upside:  We can lead the dog through complicated behaviors and behaviors that he would not naturally do on his own.  Shaping also teaches the dog a lot about problem solving, which is not so important for simple behaviors like sit, but which is very important if you want to do more advanced training later on.  Shaping is also great mental exercise.
Downside:  While shaping is easy to learn, it is hard to master.  At it's highest level, shaping can seem a little like the proverbial story about what Michelangelo said at the unveiling of his immortal David.  He was asked "How could you have achieved a masterpiece like this from a crude slab of marble?"  "It was easy," he replied.  "All I did was chip away everything that didn't look like David."  Anyone can shape, just as anyone can sculpt, but it does take some experience and finesse to shape more complex behaviors.

Targeting

Description:
Upside:
Downside:

Environmental Manipulation

Description:
Upside:
Downside:

Molding

Description:
Upside:
Downside:

Social Facilitation

Description:
Upside:
Downside:

Imitation

Description:
Upside:
Downside:



It might have happened, just like the story of Michelangelo being congratulated at the unveiling of his immortal David.
“How in God’s name could you have achieved a masterpiece like this from a crude slab of marble?” a fan is supposed to have asked him.
“It was easy,” Mike is said to have said. “All I did was chip away everything that didn’t look like David.”

We can teach dogs to do all sorts of things from dog sports to polite house manners to low-stress veterinary exams.  We can stop problem behavior by installing new and better behaviors, for example sit and stay can replace jumping on guests.  We can even teach catshyenasgibbonsdolphins, and even goldfish (yes, this is real).