Information Model of Non-Verbal Signals of Acoustic and Visual Communication Channels, Taking into Account the Individual Psychological Characteristics of the Profiled Personality

Authors

  • Sergey A. Aleynikov ITMO University
  • Olga O. Hoffman ITMO University
  • Oleg O. Basov ITMO University

DOI:

https://doi.org/10.52575/2687-0932-2022-49-3-630-640

Keywords:

digital profiling, nonverbal communication, acoustic channel, visual channel, polymodal infocommunication system

Abstract

The transition of most communications to the virtual space, accelerated by the coronovirus pandemic and its consequences, as well as the increase in the stability of communication interaction through technical means, determined the transition to the digital space and personnel profiling. However, the analysis of non-verbal signals of interpersonal communication necessary for him turned out to be limited, even with sufficiently developed means of infocommunications. Under these conditions, increasing the effectiveness of digital profiling is facilitated by the development of intelligent methods for replenishing the non-verbal component of human behavior in the course of online communication with staff members, based on objective materials (data obtained through non-verbal communication channels and characterizing the current state of the interlocutors and (or) the results of modeling such interactions), and creating interpretable predictive models of such behavior. As part of the study, an information model of non-verbal signals of acoustic and visual communication channels has been developed, which makes it possible to present the process of digital profiling at the meta level - to describe the behavior and intentions of communicators. Its detailing at the micro and mesa levels will make it possible to carry out predictive modeling of the behavior of a profiled personality based on machine learning algorithms, including deep learning.

 

Acknowledgements
This research is financially supported by The Russian Science Foundation, Agreement № 22-21-00604.

Downloads

Download data is not yet available.

Author Biographies

Sergey A. Aleynikov, ITMO University

engineer, ITMO University,
St. Petersburg, Russia

Olga O. Hoffman, ITMO University

Candidate of Psychological Sciences, Senior Researcher, ITMO University, Research Center on Artificial Intelligence "Strong Artificial Intelligence in Industry",
St. Petersburg, Russia

Oleg O. Basov, ITMO University

Doctor of Technical Sciences, Associate Professor, Professor of the Faculty of Digital Transformations, ITMO University,
St. Petersburg, Russia

References

Басов О.О., Саитов И.А. 2013. Основные каналы межличностной коммуникации и их проекция на инфокоммуникационные системы. Труды СПИИРАН, выпуск 30: 122–140.

Винер Н. 1968. Кибернетика. М., Сов. радио, 311.

Гулевич О.А. 2007. Психология коммуникации. М., Московский психологосоциальный институт, 384.

Гусев А.Н., Сильницкая А.С. 2013. Сравнительный анализ влияния демонстративности, гипертимности и дистимности на интонационные параметры речи. Национальный психологический журнал. 1(9): 110–120.

Гусев А.Н., Сильницкая А.С. 2014. Влияние демонстративности и коммуникативной активности личности на интонационные параметры речи в разных ситуациях общения. Вестник ТвГУ. Серия: Педагогика и психология (2): 77–97.

Канеман Д. Думай медленно... решай быстро [пер. с англ. А. Андреева, Ю. Деглиной, Н. Парфеновой]. Москва, АСТ (cop. 2015), 653.

Меграбян А.А. 2001. Психодиагностика невербального поведения. Санкт-Петербург, Речь, 256.

Саитов С.И. 2016. Частные задачи оптимизации функциональных характеристик полимодальных инфокоммуникационных систем. Научные ведомости БелГУ. Сер. Экономика. Информатика. Вып. 37, 2(223): 178–181.

Смирнов А.В., Безручко В.В., Басов О.О. 2019. Теоретические основы построения социокиберфизических систем. Научные ведомости Белгородского государственного университета. Серия: Экономика. Информатика. 46 (3): 532–539. DOI 10.18413/2411-3808-2019-46-3-532-539.

Aguinis H., Henle C.A. 2001. Effects of nonverbal behavior on perceptions of a female employee's power bases. The Journal of Social Psychology, 141(4): 537–549.

Aguinis H., Simonsen M.M., Pierce C.A. 1998. Effects of nonverbal behavior on perceptions of power bases. The Journal of Social Psychology, 138(4): 455–469.

Brey E., Shutts K. 2014. Children Use Nonverbal Cues to Make Inferences About Social Power. Child Development. 86(1): 276–286. DOI: 10.1111/cdev.12334.

Brooks C.I., Church M.A., Fraser L. 1986. Effects of duration of eye contact on judgments of personality characteristics. The Journal of Social Psychology, 126(1): 71–78.

Carton J.S., Carton E.E.R. 1998. Nonverbal Maternal Warmth and Children's Locus of Control of Reinforcement. Journal of Nonverbal Behavior, 22: 77–86. DOI: 10.1023/A:1022904626582.

Carton J.S., Nowicki S. 1997. Origins of Generalized Control Expectancies: Reported Child Stress and Observed Maternal Control and Warmth. The Journal of Social Psychology. DOI: 10.1080/00224545.1996.9712251

DePaulo B.M. 1992. Nonverbal behavior and self-presentation. Psychological Bulletin, 111(2): 203–243. DOI: 10.1037/0033-2909.111.2.203.

Dipboye R.L., Macan T., Shahani-Denning C. 2012. The selection interview from the interviewer and applicant perspectives: Can't have one without the other. In N. Schmitt (Ed.), The Oxford handbook of personnel assessment and selection. Oxford University Press: 323–352. DOI: 10.1093/oxfordhb/9780199732579.013.0015.

Feldman R.S., Philippot P., Custrini R.J. 1991. Social Competence and Nonverbal Behavior. In R.S. Feldman, B. Rime (Eds.), Fundamentals of Nonverbal Behaviour. New York, Cambridge University Press: 329–520.

Feldman R.S., Tomasian J.C., Coats E.J. 1999. Nonverbal Deception Abilities and Adolescents' Social Competence: Adolescents with Higher Social Skills are Better Liars. Journal of Nonverbal Behavior, 23: 237–249. DOI: 10.1023/A:1021369327584.

Hall J.A., Coats E.J., LeBeau L.S. 2005. Nonverbal Behavior and the Vertical Dimension of Social Relations: A Meta-Analysis. Psychological Bulletin, 131(6): 898–924.

Lakin J.L. Automatic cognitive processes and nonverbal communication. In V. Manusov & M.L. Patterson (Eds.), The SAGE handbook of nonverbal communication. Thousand: 59–77.

Levashina J., Campion M.A. 2006. A Model of Faking Likelihood in the Employment Interview. International Journal of Selection and Assessment, 14(4): 299–316. DOI: 10.1111/j.1468-2389.2006.00353.x

Lippa R. 1998. The Nonverbal Display and Judgment of Extraversion, Masculinity, Femininity, and Gender Diagnosticity: A Lens Model Analysis. Journal of Research in Personality, 32(1): 80–107.

Matsumoto D., Hwang H.S. 2013. Cultural influences on nonverbal behavior. In D. Matsumoto, M.G. Frank, H.S. Hwang (Eds.), Nonverbal communication: Science and applications. Sage Publications, Inc.: 97–120. DOI: 10.4135/9781452244037.n5.


Abstract views: 128

Share

Published

2022-09-30

How to Cite

Aleynikov, S. A., Hoffman, O. O., & Basov, O. O. (2022). Information Model of Non-Verbal Signals of Acoustic and Visual Communication Channels, Taking into Account the Individual Psychological Characteristics of the Profiled Personality. Economics. Information Technologies, 49(3), 630-640. https://doi.org/10.52575/2687-0932-2022-49-3-630-640

Issue

Section

INFOCOMMUNICATION TECHNOLOGIES