Controle De Sinal Fisiológico Humano Baseado Em Aprendizado Por Reforço: Uma Abordagem Competitiva

Título: Controle De Sinal Fisiológico Humano Baseado Em Aprendizado Por Reforço: Uma Abordagem Competitiva

Autores: Araújo, Iamar Zuza de; Martins, Weber

Resumo: This paper shows a reinforcement learning model, that is mainly based on the adjustment of probabilistic transitions among states on a competitive way. The application controls the physiologic signal GSR [16,20] (Galvanic Skin Resistence) using musical estimulation by the measurement of GSC (Galvanic Skin Conductance), its inverse. The GSC signal have been studied as a measure of human physical tension. We have studied methods from reinforcement learning field and from competitive learning, on the search for system adaptation towards low galvanic conductance. We use a matrix (dice) musical structure where a transition from any cell on a column to any cell in the next column is valid, in such way that music remains continuous, that is, transitions are not sensed. The last column can be combined with the first column in such way that we have an endless source of music. The agent goal is to find musical sequences that gets lowers GSC values. Note that this is a case of nonstationary environment since the preference of musical sequences changes over time. The experiments, so far, have shown the desired effect (the decrease of GSC) by 30% when music is controlled intelligently by the Reinforcement Learning agent compared with the agent that performs music by random choices.

Palavras-chave:

Páginas: 6

Código DOI: 10.21528/CBRN2001-096

Artigo em pdf: 5cbrn_096.pdf

Arquivo BibTex: 5cbrn_096.bib