Research Study to Develop Datasets for Determining the Impact of Face Masks on the Voice Recognition, Face Recognition, and Deepfake Detection Systems

This research study aims to gauge the impact of face masks on voice recognition and face recognition system. It also includes studying the impact of facemasks on deepfake detection system. Our long term goal is to design the algorithms to reverse the affect which is caused by facemask in the audio/image/video signals, so that existing biometrics system work without any problem.
By using mobile applications, the PI invites students of Oakland University to submit 40 minutes of videos (20 videos each of 2 minute in length) via the apps. These videos will be stored to the secure server hosted by Oakland University.
The collected videos will never be shared with public/ other researchers/students involved in the research to protect the privacy of the subjects. However, the PI will use the various programming libraries to extract the features of the collected videos (in form of numbers to represent the signal of audio/video/image ) of both type of videos: with face mask and without face mask.
Only microphone and video camera of the smart phones will be used to capture audio and video data by our mobile apps. The collected data could consist of either environment sound or a human speech and video without any personal identifier information. Participants are highly encouraged to record samples in different ambience (different noise level in surroundings) settings.


Compensation
Data collection will take about 40-45 min to record and upload files. Upon completion participants will receive a one-time compensation in the form of a $20 electronic gift card.

Who can participate? Participants in the research should meet following criteria:
 Can speak English. To have diverse collection of audios, native English speakers, minorities and international students are encouraged to participate.
 Only individuals 18 years of age or older can participate.
 Minimum of high school education is required to participate in this study.
 Both male and female students are encouraged to participate in this study.


To ask questions please contact: Khalid Mahmood Malik, PhD
Associate Professor
Department of Computer Science and Engineering
532 EC 115 Library Drive
Rochester MI 48309-4479
(248) 370-3542 (Direct Line)