Sergio Escalera

University Full professor

ORCID: 0000-0003-0617-8873

Scopus Author ID: 22634035000

Researcher ID: L-2998-2015

Knowledge area: Llenguatges i Sistemes Informàtics

Research group:

Computer Vision and Machine Learning at the University of Barcelona (CVMLUB)
Grup d'Intel·ligència Artificial i Data Science a la Universitat de Barcelona

Teaching Innovation Groups: Innovació Docent en Matemàtiques i Informàtica

Contact Information
Department of Mathematics and Computer Science
Gran Via 585
934020853
sescalera(a)ub.edu

My profile

Sergio Escalera obtained the P.h.D. degree on Multi-class visual categorization systems at Computer Vision Center, UAB. He obtained the 2008 best Thesis award on Computer Science at Universitat Autònoma de Barcelona. He leads the Human Pose Recovery and Behavior Analysis Group at UB, CVC, and the Barcelona Graduate School of Mathematics. He is an associate professor at the Department of Mathematics and Informatics, Universitat de Barcelona. He is an adjunct professor at Universitat Oberta de Catalunya, Aalborg University, and Dalhousie University. He has been visiting professor at TU Delft and Aalborg Universities. He is a member of the Visual and Computational Learning consolidated research group of Catalonia. He is also a member of the Computer Vision Center at UAB. He is series editor of The Springer Series on Challenges in Machine Learning. He is Editor-in-Chief of American Journal of Intelligent Systems and editorial board member of more than 5 international journals. He is vice-president of ChaLearn Challenges in Machine Learning, leading ChaLearn Looking at People events. He is co-creator of Codalab open source platform for challenges organization. He is co-founder of PhysicalTech and Care Respite companies. He is also member of the AERFAI Spanish Association on Pattern Recognition, ACIA Catalan Association of Artificial Intelligence, INNS, and Chair of IAPR TC-12: Multimedia and visual information systems. He has different patents and registered models. He has published more than 250 research papers and participated in the organization of scientific events, including CCIA04, ICCV11, CCIA14, AMDO16, FG17, NIPS17, NIPS18, FG19, and workshops at ICCV11, ICMI13, ECCV14, CVPR15, ICCV15, CVPR16, ECCV16, ICPR16, NIPS16, CVPR17, ICCV17, NIPS17, ICPR18. He has been guest editor at JMLR, TPAMI, IJCV, TAC, PR, MVA, JIVP, Expert Systems, and Neural Comp. and App. He has been area chair at WACV16, NIPS16, AVSS17, FG17, ICCV17, WACV18, FG18, BMVC18, NIPS18, FG19 and competition and demo chair at FG17, NIPS17, NIPS18 and FG19. His research interests include, statistical pattern recognition, affective computing, and human pose recovery and behavior understanding, including multi-modal data analysis, with special interest in characterizing people: personality and psychological profile computing - info

More Information: Personal webpage (http://sergioescalera.com/)

Academic training

Informatics engineering . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2003 . (Diploma / Degree / Activities)

Master in Computer Vision . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2004 . (Diploma / Degree / Activities)

PhD on Machine Learning . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2008 . (Ph.D.)

Imparted Teaching (last 10 years)

Aprenentatge, Percepció i Reconeixement (University Master's Degree) - Inteligencia Artificial - Universidad de Barcelona.

Administració de Sistemes (Technical Engineering) - Informática de Sistemas - Universidad de Barcelona.

Research interests

Computer Vision

Human Behavior Analysis

Machine Learning

Deep Learning

Face, hands, and body analysis

Participation in Projects

MEDIMINDER: SISTEMA AUTÓNOMO DOMÉSTICO ASISTENCIAL PARA PACIENTES CON DEMENCIA Y ALZHEIMER . 2012 - 2012 . Ref.247/2011 DE 15-04-2011 . Instituto de Mayores y Servicios Sociales (IMSERSO) . PI: Sergio Escalera

Sistema automático de visión artificial para el asesoramiento en diálogo jurídico y soporte a la víctima . 2012 - 2013 . Ref.JUS/237/2011 . Ministerio de Justicia . PI: Sergio Escalera

ReMedi: Multi-modal Home Assistive Technology for Dementia and Alzheimer's diseases . 2012 - 2013 . Ref.Recercaixa-306684 . Fundació Caixa de Pensions 'La Caixa' . PI: Oriol Pujol Vila

Mesura de la Qualitat en la Comunicació no Verbal del Personal Docent com a Competència Transversal: Sistema Objectiu Automàtic d’Intel∙ligència Artificial . 2012 - 2013 . Ref.2012PID‐UB/152 . Vicerectorat de Política Docent i Científica. Universitat de Barcelona . PI: SERGIO ESCALERA GUERRERO

The European Network on Integrating Vision and Language (iV&L Net): Combining Computer Vision and Language Processing For Advanced Search, Retrieval, Annotation and Description of Visual Data . 2013 . Ref.ICT COST Action IC1307 . Unió Europea . PI: Dr. Anja BELZ

NeuroChild EyeTracking: Rehabilitación cognitiva de Niños con Daño Cerebral Adquirido basada en Serious Games para dispositivos móviles y con control visual de atención (subcontratación proyecto Sergio Escalera) . 2014 . Ref.RTC-2014-2228-1 . Ministerio de Ciencia e Innovación (MICINN) . PI: ICA INFORMATICA

Plataforma Better At Home Solución integral de teleasistencia (indoor & outdoor) basada en monitorización mediante sensores, sistemas de autoaprendizaje y tecnología móvil . 2014 . Ref.RTC-2014-2148-1 . Ministerio de Ciencia e Innovación (MICINN) . PI: TECMOVA E-ASISTENCIA SL

ChaLearn Looking at People challenge organizations . 2015 . Microsoft Research . PI: Sergio Escalera Guerrero

Care Respite . 2015 . Ref.CaixaImpulse CareRespite . La Caixa . PI: Sergio Escalera

SEE.4C
SpatiotEmporal ForEcasting: Coopetition to meet Current Cross-modal Challenges . 2016 - 2017 . Ref.SEE.4C - H2020 . EU, H2020 . PI: Florin Popescu

Relevant publications (Journal Publications and Other publications - last 10 years)

Corneanu, C.; Oliu, M.; Cohn, J.; Escalera, S (2016). Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-related Applications. IEEE Transactions on Pattern Analysis and Machine Intelligence . ISSN: 0162-8828

Escalera, S.; González, J.; Baró, X.; Shotton, J. (2016). Guest Editors' Introduction to the Special Issue on Multimodal Human Pose Recovery and Behavior Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 . ISSN: 0162-8828

Escalera, S.; Athitsos, V.; Guyon, I. (2016). Challenges in multimodal gesture recognition. Journal of Machine Learning Research, 17, pp. 1 - 54 . ISSN: 1532-4435

Bautista, M.; Pujol, O.; De la Torre, F.; Escalera, S (2017). Error-Correcting Factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(10) . https://doi.org/10.1109/TPAMI.2017.2763146 . ISSN: 0162-8828

Hernanez-Vela, A.; Escalera, S.; Sclaroff, S. (2015). Poselet-basedContextual Rescoring for Human Pose Estimation via Pictorial Structures. International Journal of Computer Vision . ISSN: 0920-5691

Palmero, C.; Clapés, A.; Bahnsen, C.; Møgelmose, A.; Moeslund, T.B.; Escalera, S. (2016). Multi-modal RGB-Depth-Thermal Human Body Segmentation. International Journal of Computer Vision . ISSN: 0920-5691

Palmero, C.; Esquirol, J.; Bayo, V.; Cos, M.; Ahmadmonfared, P.; Salabert, J.; Sánchez, D.; Escalera, S. (2016). Automatic Sleep System Recommendation by Multi-modal RBG-Depth-Pressure Anthropometric Analysis. International Journal of Computer Vision . ISSN: 0920-5691

Perez-Sala, X.; De la Torre, F.; Igual, L.; Escalera, S.; Angulo, C. (2016). Subspace Procrustes Analysis. International Journal of Computer Vision, 121(3), pp. 1 - 17 . Institutional Repository . ISSN: 0920-5691

Escalera, S.; Gonzàlez, J.; Escalante, H.; Baró, X.; Guyon, I. (2018). Looking at People Special Issue. International Journal of Computer Vision . https://doi.org/10.1007/s11263-017-1058-y . ISSN: 0920-5691

Direction of Thesis, Minor Thesis and Research Reports (last 10 years)

Xavier Pérez-Sala . (2015) . Extending Procrustes Analysis: Building Multi-view 2-D Models from 3-D Human Shape Samples (Ph.D. Thesis) . Universitat Politecnica de Catalunya.

Ciprian Adrian Corneanu . (2015) . Facial expression analysis of neurologically ompaired children (Master's Thesis) . UAB.

Miguel Angel Bautista . (2016) . Learning Error-Correcting Representations For Multi-class Problems (Ph.D. Thesis) . University of Barcelona.

Víctor Ponce López . (2016) . Evolutionary bags of space-time features for human analysis (Ph.D. Thesis) . University of Barcelona.

Mohammad Ali Bagheri . (2016) . Ensemble Learning for Visual Recognition (Ph.D. Thesis) . Dalhousie University.

Miguel Reyes . (2017) . Human Pose Analysis and Gesture Recognition from Depth Maps: Methods and Applications (Ph.D. Thesis) . .

Frederic Sampedro . (2017) . Automatic image quantification strategies in clinical nuclear medicine and neuroradiology (Ph.D. Thesis) . .

Meysam Madadi . (2017) . Human Segmentation, Pose Estimation and Applications (Ph.D. Thesis) . Universitat Autonoma de Barcelona.

Conferences and Participations in Congresses (last 10 years)

Baro, X.; Gonzalez, J.; Fabian, J.; Bautista, M.; Oliu, M.; Escalante, H.; Guyon, I.; Escalera, S. (2015). ChaLearn looking at people 2015 challenges: action spotting and cultural event recognition. (Presentation of communication) . CVPR workshops . UNITED STATES

Ali Bagheri, M.; Gao, Q.; Escalera, S.; Clapes, A.; Nasrollahi, K.; Holte, M.; Moeslund, T. (2015). Keep it accurate and diverse: enhancing action recognition performance by ensemble learning. (Presentation of communication) . CVPR Worlshops . UNITED STATES

Irani, R.; Nasrollahi, K.; Bahnsen, C.; Lundtoft, D.; Moeslund, T.; Oliu, M.; Corneanu, C.; Escalera, S.; Pedersen, T.; Klitgaard, M.; Petrini, L. (2015). Spatio-temporal analysis of rgb-t facial Images for multimodal pain level recognition. (Presentation of communication) . CVPR Workshops . UNITED STATES

Wan, J.; Zhao, Y.; Zhou, S.; Guyon, I.; Escalera, S. (2016). ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. (Presentation of communication) . CVPR . UNITED STATES

Yuan, S.; Garcia-Hernando, G.; Stenger, B.; Moon, G.; Chang, J.; Lee, K.; Molchanov, P.; Kautz, J.; Honari, S.; Ge, L.; Yuan, J.; Chen, X.; Wang, G.; Yang, F.; Akiyama, K.; Wu, Y.; Wan, Q.; Madadi, M.; Escalera, S.; Li, S.; Lee, D.; Oikonomidis, I.; Argyros, A.; Kim, T. (2018). Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. (Poster) . Computer Vision and Pattern Recognition, CVPR . UNITED STATES

Perez-Sala, X.; De la Torre, F.; Igual, L.; Escalera, S.; Angulo, C. (2014). Subspace Procrustes Analysis. (Presentation of communication) . ECCV Workshop on ChaLearn Looking at People . SWITZERLAND

Ponce-López, V.; Chen, B.; Oliu, M.; Corneanu, C.; Clapés, A.; Guyon, I.; Baró, X.; Jair, H.; Escalera, S. (2016). ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results. (Presentation of communication) . ChaLearn Apparent Personality Analysis workshop, ECCV . NETHERLANDS

Antonio Hernández-Vela; Stan Sclaroff; Sergio Escalera (2014). Contextual rescoring for Human Pose Estimation. (Poster) . British Machine Conference on Computer Vision - BMVC . UNITED KINGDOM

Ponce-López, Victor.; Escalante, H.; Escalera, S.; Baró, X (2015). Gesture and Action Recognition by Evolved Dynamic Subgestures. (Poster) . British Machine Vision Conference, BMVC . UNITED KINGDOM

Clapés, A.; Tuytelaars, T.; Escalera, S. (2017). Darwintrees for action recognition. (Presentation of communication) . ICCV . ITALY

Asadi-Aghbolaghi, M.; Bertiche, H.; Roig, V.; Kasaei, S.; Escalera, S. (2017). Action Recognition from RGB-D Data: Comparison and Fusion of Spatio-temporal Handcrafted Features and Deep Strategies. (Presentation of communication) . ICCV . ITALY

Wan, J.; Escalera, S.; Anbarjafari, G.; Escalante, H.; Baro, X.; Guyon, I.; Madadi, M.; Allik, J.; Gorbova, J.; Lin, C.; Xie, Y. (2017). Results and Analysis of ChaLearn LAP Multi-modal Isolated and ContinuousGesture Recognition, and Real versus Fake Expressed Emotions Challenges. (Presentation of communication) . ICCV . ITALY

Patents, Software and Database

ADiBAS Posture: Automatic Digital Biometry Analysis System (SPAIN, 2011)

Método y sistema de visión artificial para el control de calidad de servicios públicos municipales (SPAIN, 2011)

Software para la transmisión de información y documentación de casos complejos en salud (---, 12/09/2013)

Procedimiento para identificar el gesto de una mano (---, 01/08/2014)

A computer-implemented method and a system for remotely monitoring a user, and a computer program product implementing the method (UNITED KINGDOM, 30/07/2014)