Sequence Learning - Learning To Sequence

In cognitive psychology, sequence learning is inherent to human ability because it is an integrated part of conscious and nonconscious learning as well as activities. Sequences of information or sequences of actions are used in various everyday tasks: "from sequencing sounds in speech, to sequencing movements in typing or playing instruments, to sequencing actions in driving an automobile." Sequence learning can be used to study skill acquisition and in studies of various groups ranging from neuropsychological patients to infants. According to Ritter and Nerb, “The order in which material is presented can strongly influence what is learned, how fast performance increases, and sometimes even whether the material is learned at all.” Sequence learning, more known and understood as a form of explicit learning, is now also being studied as a form of implicit learning as well as other forms of learning. Sequence learning can also be referred to as sequential behavior, behavior sequencing, and serial order in behavior.

History

Sequence to Sequence Deep Learning (Quoc Le, Google) - The talks at the Deep Learning School on September 24/25, 2016 were amazing. I clipped out individual talks from the full live streams and provided links to each below in case that's useful...

In the first half of the 20th century, Margaret Floy Washburn, John B. Watson, and other behaviorists believed behavioral sequencing to be governed by the reflex chain, which states that stimulation caused by an initial movement triggers an additional movement, which triggers another additional movement, and so on. In 1951, Karl Lashley, a neurophysiologist at Harvard University, published “The Problem of Serial Order in Behavior,” addressing the current beliefs about sequence learning and introducing his hypothesis. He criticized the previous view on the basis of six lines of evidence:

The first line is that movements can occur even when sensory feedback is interrupted. The second is that some movement sequences occur too quickly for elements of the sequences to be triggered by feedback from the preceding elements. Next is that the errors in behavior suggest internal plans for what will be done later. Also, the time to initiate a movement sequence can increase with the length or complexity of the sequence. The next line is the properties of movements occurring early in a sequence can anticipate later features. Then lastly the neural activity can indicate preparation of upcoming behavior events, including upcoming behavior events in the relatively long-term future.

Lashley argued that sequence learning, or behavioral sequencing or serial order in behavior, is not attributable to sensory feedback. Rather, he proposed that there are plans for behavior since the nervous system prepares for some behaviors but not others. He said that there was a hierarchical organization of plans. He came up with several lines of evidence. The first of these is that the context changes functional interpretations of the same behaviors, such as the way “wright, right, right, rite, and write” are interpreted based on the context of the sentence. “Right” can be interpreted as a direction or as something good depending on the context. A second line of evidence says that errors are involved in human behavior as hierarchical organization. In addition, “hierarchical organization of plans comes from the timing of behavioral sequences.” The larger the phrase, the longer the response time, which factors into “decoding” or “unpacking” hierarchical plans. Additional evidence is how easy or hard it is to learn a sequence. The mind can create a “memory for what is about to happen” as well as a “memory for what has happened.” The final evidence for the hierarchical organization of plans is characterized by "chunking". This skill combines multiple units into larger units.

Types of sequence learning

Learning to Sequence 3-Scene Board Game Grade PK-1 | Carson .... Source : www.carsondellosa.com

There are two broad categories of sequence learningâ€"explicit and implicitâ€"with subcategories. Explicit sequence learning has been known and studied since the discovery of sequence learning. However, recently, implicit sequence learning has gained more attention and research. A form of implicit learning, implicit sequence learning refers to the underlying methods of learning that people are unaware ofâ€"in other words, learning without knowing. The exact properties and number of mechanisms of implicit learning are debated. Other forms of implicit sequence learning include motor sequence learning, temporal sequence learning, and associative sequence learning.

Sequence learning problems

Learning to Sequence 6-Scene Board Game Grade PK-1 | Carson .... Source : www.carsondellosa.com

Sequence learning problems are used to better understand the different types of sequence learning. There are four basic sequence learning problems: sequence prediction, sequence generation, sequence recognition, and sequential decision making. These “problems” show how sequences are formulated. They show the patterns sequences follow and how these different sequence learning problems are related to each other.

Sequence prediction attempts to predict the next immediate element of a sequence based on all the preceding elements. Sequence generation is basically the same as sequence prediction: an attempt to piece together a sequence one by one the way it naturally occurs. Sequence recognition takes certain criteria and determines whether the sequence is legitimate. Sequential decision making or sequence generation through actions breaks down into three variations: goal-oriented, trajectory-oriented, and reinforcement-maximizing. These three variations all want to pick the action(s) or step(s) that will lead to the goal in the future.

These sequence learning problems reflect hierarchical organization of plans because each element in the sequences builds on the previous elements.

In a classic experiment published in 1967, Alfred L. Yarbus demonstrated that though subjects viewing portraits reported apprehending the portrait as a whole, their eye movements successively fixated on the most informative parts of the image. These observations suggest that underlying an apparently parallel process of face perception, a serial oculomotor process is concealed. It is a common observation that when a skill is being acquired, we are more attentive in the initial phase, but after repeated practice, the skill becomes nearly automatic; this is also known as unconscious competence. We can then concentrate on learning a new action while performing previously learned actions skillfully. Thus, it appears that a neural code or representation for the learned skill is created in our brain, which is usually called procedural memory. The procedural memory encodes procedures or algorithms rather than facts.

Ongoing research

Learning to Sequence 6-Scene: 6 Scene Set [Game] by Carson-Dellosa .... Source : www.amazon.ca

There are many other areas of application for sequence learning. How humans learn sequential procedures has been a long-standing research problem in cognitive science and currently is a major topic in neuroscience. Research work has been going on in several disciplines, including artificial intelligence, neural networks, and engineering. For a philosophical perspective, see Inductive reasoning and Problem of induction. For a theoretical computer-science perspective, see Solomonoff's theory of inductive inference and Inductive programming. For a mathematical perspective, see Extrapolation.

References

machine learning - How can recurrent neural networks be used for .... Source : stats.stackexchange.com

Further reading

Teach Preschoolers to Sequence with This Printable | Sequencing .... Source : www.pinterest.com

• Sun, Ron; Giles, C. Lee, eds. (2001). Sequence learning paradigms, algorithms, and applications. Lecture notes in computer science. 1828. New York/Berlin: Springer. ISBN 3-540-41597-1. 
• Keshet, Joseph; Bengio, Samy, eds. (2009). Automatic speech and speaker recognition: large margin and kernel methods. Chichester, UK/Hoboken, New Jersey: J. Wiley & Sons. ISBN 978-0-470-74204-4. 
• Riolo, Rick; Trent McConaghy; Ekaterina Vladislavleva, eds. (2010). Genetic Programming Theory and Practice VIII. Springer-Verlag New York Inc. ISBN 978-1-4419-7746-5. 
• Smilkstein, Rita. We're born to learn: using the brain's natural learning process to create today's curriculum (2nd ed.). Thousand Oaks, California: Corwin Press. ISBN 978-1-4129-7938-2. 
• Rowland LA & DR Shanks (April 2006). "Sequence learning and selection difficulty". Journal of Experimental Psychology. Human Perception and Performance. 32 (2): 287â€"299. doi:10.1037/0096-1523.32.2.287. ISSN 0096-1523. OCLC 109192123. PMID 16634671. 
• Spiegel, R & IP McLaren (April 2006). "Associative Sequence Learning in Humans". Journal of Experimental Psychology. Animal Behavior Processes. 32 (2): 150â€"163. doi:10.1037/0097-7403.32.2.150. ISSN 0097-7403. OCLC 109191993. PMID 16634658. 
• Savion-Lemieux, T, JA Bailey, and VB Penhune (May 2009). "Developmental Contributions to Motor Sequence Learning". Experimental Brain Research. 195 (2): 293â€"306. doi:10.1007/s00221-009-1786-5. ISSN 0014-4819. OCLC 319879934. PMID 19363605. CS1 maint: Multiple names: authors list (link)
• Gagliardi, C, A Tavano, A.C Turconi, U Pozzoli, and R Borgatti (2011). "Sequence Learning in Cerebral Palsy". Pediatric Neurology. 44 (3): 207â€"213. doi:10.1016/j.pediatrneurol.2010.10.004. ISSN 0887-8994. OCLC 701964470. PMID 21310337. CS1 maint: Multiple names: authors list (link)
• Song, S, JH J. Howard, and DV Howard (August 2008). "Perceptual Sequence Learning in a Serial Reaction Time Task". Experimental Brain Research. 189 (2): 145â€"158. doi:10.1007/s00221-008-1411-z. ISSN 0014-4819. OCLC 264650127. PMC 2672106 . PMID 18478209. CS1 maint: Multiple names: authors list (link)
• Simon, JR, M Stollstorff, LC Westbay, CJ Vaidya, JH J. Howard, and DV Howard (January 2011). "Dopamine Transporter Genotype Predicts Implicit Sequence Learning". Behavioural Brain Research. 216 (1): 452â€"457. doi:10.1016/j.bbr.2010.08.043. ISSN 0166-4328. OCLC 680073165. PMC 2975813 . PMID 20817043. CS1 maint: Multiple names: authors list (link)
• Bo, J & RD Seidler (April 2010). "Spatial and Symbolic Implicit Sequence Learning in Young and Older Adults". Experimental Brain Research. 201 (4): 837â€"851. doi:10.1007/s00221-009-2098-5. ISSN 0014-4819. OCLC 603785018. PMID 19949778. 
• Swett, Bruce (25 January 2007). "The neural substrates of graphomotor sequence learning". Dissertation. hdl:1903/6687. 
• Malmgren, Helge (1997). "Perceptual fulfilment and temporal sequence learning". University of Gothenburg. Department of Philosophy. hdl:2077/19246. 
• Gureckis TM & Love, BC (2010). "Direct Associations or Internal Transformations? Exploring the Mechanism Underlying Sequential Learning Behavior" (PDF). Cognitive Science. 34 (1): 10â€"50. doi:10.1111/j.1551-6709.2009.01076.x. PMC 2853039 . PMID 20396653. 
• Song, Sunbin; James H. Howard, Jr, and Darlene V. Howard; Howard, D. V. (2007). "Implicit probabilistic sequence learning is independent of explicit awareness". Learning & Memory. Cold Spring Harbor Laboratory Press. 14 (3): 167â€"76. doi:10.1101/lm.437407. CS1 maint: Multiple names: authors list (link)
• Seidler, R. D.; A. Purushotham, S.-G. Kim, K. Ugurbil, D. Willingham, and J. Ashe; Kim, S-G.; Ugurbil, K.; Willingham, D.; Ashe, J. (August 2005). "Neural correlates of encoding and expression in implicit sequence learning". Experimental Brain Research. Springer-Verlag. 165 (1): 114â€"124. doi:10.1007/s00221-005-2284-z. hdl:2027.42/46543. PMID 15965762. CS1 maint: Multiple names: authors list (link)
• Vidoni, Eric D; Boyd, Lara A (25 July 2008). "Motor sequence learning occurs despite disrupted visual and proprioceptive feedback". Behavioral and Brain Functions. 4: 32. doi:10.1186/1744-9081-4-32. PMC 2507714 . PMID 18655715. 
• Landau, Susan M.; Mark D'Esposito (2006). "Sequence learning in pianists and nonpianists: An fMRI study of motor expertise" (PDF). Cognitive, Affective, & Behavioral Neuroscience. 6 (3): 246â€"59. doi:10.3758/cabn.6.3.246. 

Artificial Intelligence with Python â€" Sequence Learning [Video .... Source : www.packtpub.com