Video and image based face analysis with extreme learning machines

Simple item page
dc.contributorGraduate Program in Computational Science and Engineering.
dc.contributor.advisorSalah, Albert Ali.
dc.contributor.advisorKaya, Heysem.
dc.contributor.authorGürpınar, Furkan.
dc.date.accessioned2023-03-16T10:02:39Z
dc.date.available2023-03-16T10:02:39Z
dc.date.issued2017.
dc.description.abstractAutomatic analysis of human behavior has been a difficult problem due to noise, environmental differences and lack of annotation. While lab-controlled data provides an easier learning experiment, “in the wild” datasets require systems complex enough to fit to unseen data, at the same time, deal with the problem of overlearning. In this thesis, we propose a fast and robust multimodal system that analyzes humans from facial images, videos and voice. We extract dense appearance descriptors as well as Deep Convolutional Neural Network (DCNN) features from the faces and we train kernel Extreme Learning Machine (ELM) classifiers, which are then combined by various fusion schemes. We apply our pipeline to a number of affective and biometric challenges and we show that ELM provides fast and accurate learning compared to traditional learning methods. We also show that multimodal fusion and DCNN finetuning improves the accuracy in almost all tasks. Our method has ranked 2nd in the Emotion Recognition in the Wild (EmotiW) challenge and 1st in the second round of ChaLearn Apparent Personality Analysis from First Impressions (FI) challenge as well as the ChaLearn Job Candidate Screening (JCS) challenge. Our results show that using extreme learning machine, efficient learning can be performed in terms of both time and computational complexity while preserving high performance.
dc.format.extent30 cm.
dc.format.pagesxiii, 76 leaves ;
dc.identifier.otherCSE 2017 G87
dc.identifier.urihttps://digitalarchive.library.bogazici.edu.tr/handle/123456789/12333
dc.publisherThesis (M.S.) - Bogazici University. Institute for Graduate Studies in Science and Engineering, 2017.
dc.subject.lcshHuman face recognition (Computer science)
dc.subject.lcshImage analysis -- Data processing.
dc.subject.lcshImaging systems.
dc.subject.lcshFace -- Computer simulation.
dc.subject.lcshFacial expression -- Analysis.
dc.titleVideo and image based face analysis with extreme learning machines

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
b1840808.028444.001.PDF
Size:
3 MB
Format:
Adobe Portable Document Format
Download

Collections

M.S. Theses