Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body
The metabolic energy is crucial for neural processing related to learning, which modulates computational capabilities, neuronal quantities, synaptic connections, and long-term memory formation. From the evolutionary perspective, these neural processes have shaped organisms' adaptive responses t...
| Main Author: | |
|---|---|
| Format: | Thesis (University of Nottingham only) |
| Language: | English |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://eprints.nottingham.ac.uk/78727/ |
| _version_ | 1848801100372639744 |
|---|---|
| author | Jiang, Jiamu |
| author_facet | Jiang, Jiamu |
| author_sort | Jiang, Jiamu |
| building | Nottingham Research Data Repository |
| collection | Online Access |
| description | The metabolic energy is crucial for neural processing related to learning, which modulates computational capabilities, neuronal quantities, synaptic connections, and long-term memory formation. From the evolutionary perspective, these neural processes have shaped organisms' adaptive responses to environmental stimuli and enhanced survival chances. Studies have highlighted that associative conditioning extends the lifespan across various species. Also, insects modulate memory types based on ecological determinants.
This thesis concentrates on the olfactory nervous system in Drosophila's Mushroom Body (MB), as a structure paralleling the mammalian brain hippocampus, presenting as a model organism for unraveling memory formation intricacies, given its genetic accessibility and well studied olfactory processing.
This research posits that energy constraints might represent evolutionary adaptations promoting survival and learning efficiency. By dissecting the fruit fly's learning processes—specifically regarding metabolic energy—this study aims to assess potential lifespan extensions via energy modulation during learning and to gauge the efficacy of learning under energy constraints.
We identified three adaptive reinforcement learning variations, each influenced by the energy dynamics observed in fruit flies. The first variation underscores the capability of energy-driven memory pathway regulation to augment the fruit fly's lifespan, particularly when synergized with dopamine regulation. The subsequent variation reveals that the strategy of depressing synapses linked to undesired actions demonstrates high efficiency in synaptic adjustments across both aversive and appetitive conditioning contexts. The final variation applies the energy-adaptive methods to the conventional multi-armed bandit algorithms, such as the Upper Confidence Bound (UCB) and Bayesian-based Thompson Sampling (TS), and emphasizes the capacity of energy-adaptive methods to prolong the agents' lifespan without significant sacrifice in regret.
In summary, the thesis delineates the integral role of energy dynamics in shaping and optimizing learning processes and behaviors, drawing inspiration from the olfactory learning in the MB. These findings contribute to our understanding of the nature of energy, learning, and survival. |
| first_indexed | 2025-11-14T21:02:05Z |
| format | Thesis (University of Nottingham only) |
| id | nottingham-78727 |
| institution | University of Nottingham Malaysia Campus |
| institution_category | Local University |
| language | English |
| last_indexed | 2025-11-14T21:02:05Z |
| publishDate | 2024 |
| recordtype | eprints |
| repository_type | Digital Repository |
| spelling | nottingham-787272024-12-13T04:40:09Z https://eprints.nottingham.ac.uk/78727/ Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body Jiang, Jiamu The metabolic energy is crucial for neural processing related to learning, which modulates computational capabilities, neuronal quantities, synaptic connections, and long-term memory formation. From the evolutionary perspective, these neural processes have shaped organisms' adaptive responses to environmental stimuli and enhanced survival chances. Studies have highlighted that associative conditioning extends the lifespan across various species. Also, insects modulate memory types based on ecological determinants. This thesis concentrates on the olfactory nervous system in Drosophila's Mushroom Body (MB), as a structure paralleling the mammalian brain hippocampus, presenting as a model organism for unraveling memory formation intricacies, given its genetic accessibility and well studied olfactory processing. This research posits that energy constraints might represent evolutionary adaptations promoting survival and learning efficiency. By dissecting the fruit fly's learning processes—specifically regarding metabolic energy—this study aims to assess potential lifespan extensions via energy modulation during learning and to gauge the efficacy of learning under energy constraints. We identified three adaptive reinforcement learning variations, each influenced by the energy dynamics observed in fruit flies. The first variation underscores the capability of energy-driven memory pathway regulation to augment the fruit fly's lifespan, particularly when synergized with dopamine regulation. The subsequent variation reveals that the strategy of depressing synapses linked to undesired actions demonstrates high efficiency in synaptic adjustments across both aversive and appetitive conditioning contexts. The final variation applies the energy-adaptive methods to the conventional multi-armed bandit algorithms, such as the Upper Confidence Bound (UCB) and Bayesian-based Thompson Sampling (TS), and emphasizes the capacity of energy-adaptive methods to prolong the agents' lifespan without significant sacrifice in regret. In summary, the thesis delineates the integral role of energy dynamics in shaping and optimizing learning processes and behaviors, drawing inspiration from the olfactory learning in the MB. These findings contribute to our understanding of the nature of energy, learning, and survival. 2024-12-13 Thesis (University of Nottingham only) NonPeerReviewed application/pdf en cc_by https://eprints.nottingham.ac.uk/78727/1/Jiang%2C%20Jiamu%2C%2020196784%2C%20final.pdf Jiang, Jiamu (2024) Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body. PhD thesis, University of Nottingham. Reinforcement Learning Synaptic Plasticity Survival Analysis Drosophila |
| spellingShingle | Reinforcement Learning Synaptic Plasticity Survival Analysis Drosophila Jiang, Jiamu Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title | Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title_full | Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title_fullStr | Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title_full_unstemmed | Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title_short | Energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| title_sort | energy dependent reinforcement learning based on the neuronal mechanisms of the olfactory processing in mushroom body |
| topic | Reinforcement Learning Synaptic Plasticity Survival Analysis Drosophila |
| url | https://eprints.nottingham.ac.uk/78727/ |