nucleation

learning-and-conditioning

Graph View

80 items with this tag.

Nov 03, 2026
THEORY-1324: In Ryan, Mims and Koestner's experiment, the same expected reward for doing well left less later free-choice engagement when given with controlling feedback than with informational feedback, and in both styles less than no reward with the same feedback: the interpersonal style of a performance-contingent reward changes its effect, and the reward lowers intrinsic motivation even when the information it carries is held fixed
- motivation
- learning-and-conditioning
Oct 30, 2026
LIT-1846: Experimental reductions of delay discounting and impulsive choice: A systematic review and meta-analysis
Oct 30, 2026
THEORY-1178: In slices of striatum, visual and prefrontal cortex and hippocampus, Hebbian co-activation leaves a synaptic eligibility trace, lasting about 1 s in striatum, 3 to 10 s in cortex and about 2 s in CA1, that a later neuromodulator or plateau potential converts into a weight change and whose sign it can set: experimental support for three-factor learning rules on behavioural time scales
- neuroscience
- learning-and-conditioning
Oct 30, 2026
THEORY-1180: In foraging tasks, higher stress or anxiety goes consistently with less exploration, and in one task with a predator to check for, people higher in somatic anxiety checked less and did worse, a reduction associated with greater aversion to detecting the predator
Oct 30, 2026
THEORY-1182: Across seven computational learning studies selected without a systematic search, anxiety goes with altered adjustment of learning rate to uncertainty, mostly for aversive outcomes, while overall learning rate, choice consistency and outcome valuation show little relation to it
- psychopathology-and-treatment
- learning-and-conditioning
Oct 30, 2026
THEORY-1184: In three laboratory studies of healthy humans, offering a costless avoidance response for a stimulus never paired with the aversive outcome led people to use it, and withdrawing the response then raised their expectancy of the outcome for that stimulus; signalling of the response is a confound
- learning-and-conditioning
- psychopathology-and-treatment
Oct 30, 2026
THEORY-1186: Across computational studies of exploration in reward-based bandit tasks, mostly in sub-clinical samples and not yet replicated, directed exploration tends to rise with trait or cognitive anxiety and to fall with state or somatic anxiety
Oct 30, 2026
THEORY-1189: In laboratory avoidance learning in healthy humans, an avoidance response that remains available during extinction persists, in some participants for hundreds of unpunished trials, and keeps expectancy of the aversive outcome higher than in people denied it; the more effective and the cheaper the response, the slower it extinguishes
- learning-and-conditioning
- psychopathology-and-treatment
Oct 30, 2026
THEORY-1190: In a Markov decision process, an agent that evaluates actions as if it will fail to avoid danger at later steps, while in fact choosing optimally at each step, spreads threat value to states far from the danger and avoids early and widely, which reproduces qualitatively exaggerated threat appraisal, fear generalization and several laboratory findings associated with anxiety
- psychopathology-and-treatment
- learning-and-conditioning
Oct 30, 2026
THEORY-1191: In a simulated active inference agent, a habit learned by counting the agent's own state transitions and policy choices emerges from goal-directed behaviour, and once acquired it persists, and reinforces itself, after the reward is devalued, while an agent devalued before acquisition switches at once
Oct 30, 2026
THEORY-1193: How far fear falls during an extinction or exposure session, or across sessions, does not predict how much fear is expressed at follow-up, in animals, human laboratory samples and fearful human samples
- psychopathology-and-treatment
- learning-and-conditioning
Oct 29, 2026
QUESTION-307: In dialectical behaviour therapy, do skills-homework completion and phone coaching predict falling urges and less frequent target behaviour once baseline functioning and motivation are controlled and patients with missing diary data are kept, and does skill use between sessions mediate the change?
- psychopathology-and-treatment
- learning-and-conditioning
Oct 29, 2026
QUESTION-311: Do synaptic eligibility traces on the scale of seconds carry learning from delayed outcomes in behaving animals, so that interfering with the trace between action and outcome abolishes learning from the delayed outcome but not from immediate ones?
- neuroscience
- learning-and-conditioning
Oct 29, 2026
QUESTION-313: When a habit is modelled as a prior over policies that grows by counting, do the counts fitted to an animal's or a person's own choice history predict when behaviour becomes insensitive to devaluation, and when it still switches at once?
Oct 29, 2026
QUESTION-325: Is persistent avoidance in anxiety maintained by an inflated uncertainty estimate about the avoided states, as Brown, Price and Dombrovski propose, or by a pessimistic evaluation of one's own future avoidance, as Zorowitz, Momennejad and Daw propose, rather than by an inflated threat value?
- psychopathology-and-treatment
- learning-and-conditioning
Oct 29, 2026
QUESTION-327: Does available avoidance leave threat expectancy uncorrected in proportion to how few unavoided disconfirming trials it allows, in people with anxiety disorders as in healthy controls, and does performing and then losing an unsignalled avoidance response raise threat expectancy for a stimulus never paired with harm, scaling with how much the person avoided?
- learning-and-conditioning
- psychopathology-and-treatment
Oct 29, 2026
QUESTION-328: Does an implemented model-based or latent-cause model of human avoidance, compared on the same data with the model-free two-factor implementations, reproduce the phenomena Mancinelli and Bach rate A or B, including residual avoidance after signalled outcome omission, and does a model without an inferential component fail them?
- learning-and-conditioning
- cognition
Oct 29, 2026
QUESTION-329: In people with fear-based anxiety disorders against controls, does a systematic search with meta-analysis, or a large preregistered study, find that what differs is the adjustment of learning rate to the kind of uncertainty, noise against volatility, mainly for aversive outcomes, while overall learning rate, choice consistency and outcome valuation do not?
- psychopathology-and-treatment
- learning-and-conditioning
Oct 29, 2026
QUESTION-330: How does anxiety change exploration across tasks and facets: does it reduce foraging exploration once stress and effort cost are controlled, does somatic anxiety reduce checking for threat through aversion to detecting it rather than a lower value placed on the information, and, in the same participants across more than one bandit task, does directed exploration rise with trait or cognitive anxiety and fall with state or somatic anxiety?
Oct 29, 2026
QUESTION-331: In a second, preferably pre-registered sample with a cost attached to avoiding, do anxiety-disorder patients again avoid a safety cue more than controls but danger cues no more, keep a higher threat expectancy after effective avoidance, and report more relief at omissions, with rated aversiveness matched or controlled?
- psychopathology-and-treatment
- learning-and-conditioning
Oct 29, 2026
QUESTION-333: Does how far fear falls within or across exposure or extinction sessions predict fear at follow-up once initial fear is controlled, in the studies Craske et al. 2014 cite or a later meta-analysis, and in well-powered clinical samples?
- psychopathology-and-treatment
- learning-and-conditioning
Oct 28, 2026
ARG-027: The record's iterated-learning readings show that pragmatic stances and footing are stabilized by transmission
Oct 24, 2026
LIT-1476: Active inference and learning
Oct 24, 2026
LIT-1477: A systematic review of human avoidance learning: Cognition, computation, and methods
- learning-and-conditioning
- psychopathology-and-treatment
Oct 24, 2026
LIT-1479: Anxiety as a disorder of uncertainty: implications for understanding maladaptive anxiety, anxious avoidance, and exposure therapy
Oct 24, 2026
LIT-1483: The influence of anxiety on exploration: A review of computational modeling studies
Oct 24, 2026
LIT-1490: Impaired action-safety learning and excessive relief during avoidance in patients with anxiety disorders
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
LIT-1494: Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules
Oct 24, 2026
LIT-1496: Anxiety, Avoidance, and Sequential Evaluation
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
LIT-1500: Maximizing exposure therapy: An inhibitory learning approach
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
LIT-1505: Learning Through Reinforcement and Replicator Dynamics
- game-theory
- learning-and-conditioning
Oct 24, 2026
THEORY-897: In Brown, Price and Dombrovski's reading of seven computational learning studies they selected without a systematic search, with mixed directions, anxiety goes with altered adjustment of learning rate to uncertainty, mostly for aversive outcomes, while overall learning rate, choice consistency and outcome valuation show little relation to it
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-900: A systematic review of 116 studies of avoidance learning in healthy humans finds the evidence contradicting two-factor and other associative theories and favouring expectancy and inference-based accounts, but also finding residual avoidance after the outcome is visibly removed, which a purely inferential account does not predict
- learning-and-conditioning
- cognition
Oct 24, 2026
THEORY-901: As Mancinelli and Bach's systematic review of avoidance learning in healthy humans reports it, rating both A, an avoidance response left available during extinction persists, in some participants for hundreds of unpunished trials, and keeps expectancy of the aversive outcome higher than in people denied it (nine studies); and less effective or costlier responses extinguish faster (six studies, one exception)
- learning-and-conditioning
- psychopathology-and-treatment
Oct 24, 2026
THEORY-907: As Chou, Wilson and Smith review them, in about six foraging studies, mostly sub-clinical, higher stress or anxiety went with less exploration, and in one task with a predator to check for (Trier et al. 2023), people higher in trait somatic anxiety checked less and did worse, a reduction the study's further analyses associated with greater aversion to detecting the predator
Oct 24, 2026
THEORY-909: As reviewed by Gerstner et al. (2018) from five papers, mostly in slices and one laboratory per region, pairing pre- and postsynaptic activity changed the synapse when a neuromodulator or plateau potential followed within about 1 s in striatum, within 5 s (noradrenaline, LTP after pre-before-post pairing) or 2.5 s (serotonin, LTD after post-before-pre pairing) in visual and prefrontal cortex, and within about 2 s in CA1, and not at longer delays; the reviewers read this as a decaying synaptic eligibility trace and as experimental support for three-factor learning rules on behavioural time scales
- neuroscience
- learning-and-conditioning
Oct 24, 2026
THEORY-910: Brown, Price and Dombrovski propose, without a model run or data, that in aversive environments avoiding uncertain states keeps their uncertainty high and so perpetuates avoidance, that anxiety strengthens this loop by misreading noise as change, and that exposure works by reducing the uncertainty rather than an excess of learned threat
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-912: In a picture-based avoidance task, treatment-seeking patients with OCD or PTSD avoided a safety cue more than healthy controls and, after effective avoidance, still expected the aversive picture more; patients with panic disorder with agoraphobia or PTSD reported more relief when it was omitted; the groups did not differ in avoiding the danger cues
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-914: In fear conditioning, extinction does not erase the original threat association but adds a competing inhibitory one, which is why extinguished fear can return with time, a change of context, an unsignalled aversive event or renewed pairing
- learning-and-conditioning
- psychopathology-and-treatment
Oct 24, 2026
THEORY-915: In Zorowitz, Momennejad and Daw's simulations of a Markov decision process, an agent that evaluates actions as if it will fail to avoid danger at later steps, while in fact choosing optimally at each step, spreads threat value to states far from the danger and avoids early and widely, which reproduces qualitatively exaggerated threat appraisal, fear generalization and several laboratory findings associated with anxiety
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-917: Chou, Wilson and Smith read about eight computational studies of exploration in reward-based bandit tasks, mostly in sub-clinical samples, with mixed results and none replicated, as suggesting that directed exploration rises with trait or cognitive anxiety and falls with state or somatic anxiety; none they review links random exploration to anxiety
Oct 24, 2026
THEORY-920: As Mancinelli and Bach's systematic review reports it, rating it B, in three laboratory studies of healthy humans a signalled, costless avoidance response offered for a stimulus never paired with the aversive outcome was used, and withdrawing it raised expectancy of the outcome for that stimulus, though Xia et al. (2019) found no change in skin conductance or startle; every study signalled the response's availability, which may itself have read as a danger cue
- learning-and-conditioning
- psychopathology-and-treatment
Oct 24, 2026
THEORY-921: As Craske et al.'s 2014 review reports it, citing six studies and reporting no data of its own, how far fear falls during an extinction or exposure session, or across sessions, does not predict how much fear is expressed at follow-up, in animals, human laboratory samples and fearful, mostly analog, human samples
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-922: Among 56 of 88 patients in one DBT intensive outpatient programme, kept because they finished a four-month cycle and gave enough diary data, skills-homework completion in months 1–3 correlated with larger falls in suicide and substance-use urges (r ≈ .35) and phone-coaching frequency with a larger fall in self-harm urges (r = .31); neither correlated with change in how often the behaviours occurred, and only homework separated patients with and without a target behaviour in month 4
- psychopathology-and-treatment
- learning-and-conditioning
Oct 24, 2026
THEORY-923: In one simulated T-maze task with hand-set parameters, run once per condition, an active inference agent's habit, learned by counting its own state transitions and policy choices, emerged from goal-directed behaviour, and once acquired it persisted, and reinforced itself, after the reward was devalued, while an agent devalued before acquisition switched at once
Oct 24, 2026
THEORY-934: Under Bush–Mosteller learning with negative payoffs, the continuous-time limit is a replicator term in benefits plus a probability-matching term, which alone drives choice probabilities to success probabilities
- game-theory
- learning-and-conditioning
Oct 24, 2026
THEORY-938: Cross learning has the expected motion of the replicator dynamic and follows it on any finite horizon in the continuous-time limit, but for every learning speed the discrete process converges with probability one to a pure strategy profile, even in games where the replicator dynamic cycles
- game-theory
- learning-and-conditioning
Oct 23, 2026
CLAIM-443: A learned prior over which processes govern, P(g | z, H) ∝ exp(βQ(g, z) + b_H(g, z)), its bias b_H trained by reward-modulated Hebbian updates to the relations by which one process recruits or endorses another, is a candidate mechanism for durable authority and for amortized governance; but persistence is not amortization, which is shown only when earlier work replaces later computation, communication or recruitment, and a prior over authority differs from a prior over actions only when what is appropriate changes
Oct 23, 2026
LIT-1434: The power of goal-directed processes in the causation of emotional and other actions
Oct 23, 2026
LIT-1461: Liking, wanting, and the incentive-sensitization theory of addiction
Oct 23, 2026
LIT-1465: A taxonomy of technology design features that promote potentially addictive online behaviours
Oct 23, 2026
THEORY-895: Incentive sensitization: repeated drug exposure can make the mesolimbic 'wanting' system lastingly hyper-reactive to drug cues and contexts, so that cue-triggered incentive salience grows, persists for years and even increases during abstinence, while 'liking' need not rise and may fall; sensitized 'wanting' can oppose the person's cognitive desire, and incentive salience can run without any reportable change in feeling
Oct 19, 2026
QUESTION-170: When no single setting of a regulator is stable in every environment it may meet, must any system that comes to keep its essential variables within limits carry a channel from those variables to the parameters of its regulation, whether or not it adapts by trial and error?
- complex-systems
- learning-and-conditioning
Oct 16, 2026
LIT-1184: Factorized embedding of goal and uncertainty in the lateral prefrontal cortex guides stably flexible learning
Oct 16, 2026
LIT-1199: Brain–computer interfaces and communication in paralysis: Extinction of goal directed thinking in completely paralysed patients?
Oct 16, 2026
LIT-1200: Spelling interface using intracortical signals in a completely locked-in patient enabled via auditory neurofeedback training
- neuroscience
- learning-and-conditioning
Oct 16, 2026
THEORY-484: The brain implements hierarchical reinforcement learning with options: dorsolateral prefrontal cortex represents which option is active, dorsolateral striatum holds option-specific policies, orbitofrontal cortex holds option-specific values, and dopamine carries option-level prediction errors at subtask boundaries
Oct 16, 2026
THEORY-489: Chains of human function learners, each trained on the previous learner's responses, forget their starting function and in 28 of 32 families converge within a few generations to a positive linear function, the bias earlier studies report, whatever function trained the first learner; this is convergence to the learners' favoured function, not shown to be convergence to their prior
Oct 16, 2026
THEORY-688: In an actor-critic learner that can choose temporally extended options as well as primitive actions, options that fit the task speed learning, while options with ill-placed subgoals slow it, and options that fit an earlier layout keep the agent from finding a newly opened shortcut, so hierarchy helps only with the right subroutines
Oct 14, 2026
THEORY-307: Adaptation by trial and error in a large system finishes in a practicable time only if partial adaptations are retained, and retention requires that the system not be fully joined: parts must be separated, at least temporarily, by constancies, and where later learning shares parts with earlier learning it destroys it
Oct 14, 2026
THEORY-324: A system adapts by trial and error to an environment whose effect on its essential variables it does not know only if a second feedback, through those variables, changes the parameters of its primary feedback; and if that feedback changes them whenever, and for as long as, an essential variable is outside its limits, every equilibrium the whole can reach is an adapted one
Oct 11, 2026
LIT-906: The effect of brief mindfulness training on momentary impulsivity
Oct 10, 2026
CLAIM-234: The record's iterated-learning readings bear on lexical, structural and functional transmission, and none measures stance, footing or speech-act function along a chain
Oct 05, 2026
LIT-754: Effects of reward on intrinsic motivation—Negative, neutral, and positive: Comment on Deci, Koestner, and Ryan (1999)
Oct 05, 2026
THEORY-154: Whether an expected tangible reward lowers or raises later intrinsic motivation depends on how tightly its stated contingency ties it to performance and success
Oct 03, 2026
LIT-541: Relational Frame Theory: Some Implications for Understanding and Treating Human Psychopathology
Oct 03, 2026
LIT-549: Relational Frame Theory: A Post-Skinnerian Account of Human Language and Cognition
Oct 03, 2026
LIT-556: Reinforcement, Reward, and Intrinsic Motivation: A Meta-Analysis
Oct 03, 2026
LIT-557: A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation
Oct 03, 2026
LIT-562: Pervasive negative effects of rewards on intrinsic motivation: The myth continues
Oct 03, 2026
LIT-580: Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control
Oct 03, 2026
LIT-581: Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
Oct 03, 2026
LIT-583: Breakdown of Will
Oct 03, 2026
LIT-584: Model-based and model-free Pavlovian reward learning: Revaluation, revision, and revelation
Oct 03, 2026
LIT-586: Précis of Breakdown of Will
Oct 03, 2026
THEORY-044: In relational frame theory the self is verbal behaviour's content, its process and its context, and the self as context is a perspective learned from deictic relations that cannot itself be found as content
Oct 03, 2026
THEORY-046: Expected tangible rewards for merely engaging in an interesting task lower later free-choice engagement with it
Oct 03, 2026
THEORY-049: Whether an external event lowers or raises intrinsic motivation depends on whether it is experienced as controlling or as information about competence
Oct 03, 2026
THEORY-050: Psychological inflexibility, in which verbal relations give private events aversive functions and make experiential avoidance a general strategy, is a transdiagnostic process in psychopathology
Oct 03, 2026
THEORY-062: Model-based and model-free predictions both operate in instrumental and in Pavlovian learning, and which one controls behaviour follows their relative reliability, not the preference of a supervising system

Created with Quartz v5.0.0 © 2026

Repository
Quartz