Sergio Escalera

Catedràtic d'Universitat

ORCID: 0000-0003-0617-8873

Scopus Author ID: 22634035000

Researcher ID: L-2998-2015

Àrea de coneixement : Llenguatges i Sistemes Informàtics

Grup de Recerca:

Computer Vision and Machine Learning at the University of Barcelona (CVMLUB)
Grup d'Intel·ligència Artificial i Data Science a la Universitat de Barcelona

Grups d'Innovació Docent: Innovació Docent en Matemàtiques i Informàtica

Informació de contacte
Departament de Matemàtiques i Informàtica
Gran Via 585
934020853
sescalera(a)ub.edu

El meu perfil

Sergio Escalera obtained the P.h.D. degree on Multi-class visual categorization systems at Computer Vision Center, UAB. He obtained the 2008 best Thesis award on Computer Science at Universitat Autònoma de Barcelona. He leads the Human Pose Recovery and Behavior Analysis Group at UB, CVC, and the Barcelona Graduate School of Mathematics. He is an associate professor at the Department of Mathematics and Informatics, Universitat de Barcelona. He is an adjunct professor at Universitat Oberta de Catalunya, Aalborg University, and Dalhousie University. He has been visiting professor at TU Delft and Aalborg Universities. He is a member of the Visual and Computational Learning consolidated research group of Catalonia. He is also a member of the Computer Vision Center at UAB. He is series editor of The Springer Series on Challenges in Machine Learning. He is Editor-in-Chief of American Journal of Intelligent Systems and editorial board member of more than 5 international journals. He is vice-president of ChaLearn Challenges in Machine Learning, leading ChaLearn Looking at People events. He is co-creator of Codalab open source platform for challenges organization. He is co-founder of PhysicalTech and Care Respite companies. He is also member of the AERFAI Spanish Association on Pattern Recognition, ACIA Catalan Association of Artificial Intelligence, INNS, and Chair of IAPR TC-12: Multimedia and visual information systems. He has different patents and registered models. He has published more than 250 research papers and participated in the organization of scientific events, including CCIA04, ICCV11, CCIA14, AMDO16, FG17, NIPS17, NIPS18, FG19, and workshops at ICCV11, ICMI13, ECCV14, CVPR15, ICCV15, CVPR16, ECCV16, ICPR16, NIPS16, CVPR17, ICCV17, NIPS17, ICPR18. He has been guest editor at JMLR, TPAMI, IJCV, TAC, PR, MVA, JIVP, Expert Systems, and Neural Comp. and App. He has been area chair at WACV16, NIPS16, AVSS17, FG17, ICCV17, WACV18, FG18, BMVC18, NIPS18, FG19 and competition and demo chair at FG17, NIPS17, NIPS18 and FG19. His research interests include, statistical pattern recognition, affective computing, and human pose recovery and behavior understanding, including multi-modal data analysis, with special interest in characterizing people: personality and psychological profile computing - info

Més Informació: Personal webpage (http://sergioescalera.com/)

Formació acadèmica

Informatics engineering . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2003 . (Diplomatura / Llicenciatura / Grau)

Master in Computer Vision . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2004 . (Diplomatura / Llicenciatura / Grau)

PhD on Machine Learning . Escola Tècnica Superior d'Enginyeria, UAB . 01/06/2008 . (Doctorat )

Docència Impartida (últims 10 anys)

Aprenentatge, Percepció i Reconeixement (Màster oficial) - Intel·ligència Artificial - Universidad de Barcelona.

Administració de Sistemes (Enginyeria tècnica) - Enginyeria Tècnica en Informàtica de Sistemes - Universidad de Barcelona.

Línies de Recerca

Computer Vision

Human Behavior Analysis

Machine Learning

Deep Learning

Face, hands, and body analysis

Participació en Projectes

MEDIMINDER: SISTEMA AUTÓNOMO DOMÉSTICO ASISTENCIAL PARA PACIENTES CON DEMENCIA Y ALZHEIMER . 2012 - 2012 . Ref.247/2011 DE 15-04-2011 . Instituto de Mayores y Servicios Sociales (IMSERSO) . IP: Sergio Escalera

Sistema automático de visión artificial para el asesoramiento en diálogo jurídico y soporte a la víctima . 2012 - 2013 . Ref.JUS/237/2011 . Ministerio de Justicia . IP: Sergio Escalera

ReMedi: Multi-modal Home Assistive Technology for Dementia and Alzheimer's diseases . 2012 - 2013 . Ref.Recercaixa-306684 . Fundació Caixa de Pensions 'La Caixa' . IP: Oriol Pujol Vila

Mesura de la Qualitat en la Comunicació no Verbal del Personal Docent com a Competència Transversal: Sistema Objectiu Automàtic d’Intel∙ligència Artificial . 2012 - 2013 . Ref.2012PID‐UB/152 . Vicerectorat de Política Docent i Científica. Universitat de Barcelona . IP: SERGIO ESCALERA GUERRERO

The European Network on Integrating Vision and Language (iV&L Net): Combining Computer Vision and Language Processing For Advanced Search, Retrieval, Annotation and Description of Visual Data . 2013 . Ref.ICT COST Action IC1307 . Unió Europea . IP: Dr. Anja BELZ

NeuroChild EyeTracking: Rehabilitación cognitiva de Niños con Daño Cerebral Adquirido basada en Serious Games para dispositivos móviles y con control visual de atención (subcontratación proyecto Sergio Escalera) . 2014 . Ref.RTC-2014-2228-1 . Ministerio de Ciencia e Innovación (MICINN) . IP: ICA INFORMATICA

Plataforma Better At Home Solución integral de teleasistencia (indoor & outdoor) basada en monitorización mediante sensores, sistemas de autoaprendizaje y tecnología móvil . 2014 . Ref.RTC-2014-2148-1 . Ministerio de Ciencia e Innovación (MICINN) . IP: TECMOVA E-ASISTENCIA SL

ChaLearn Looking at People challenge organizations . 2015 . Microsoft Research . IP: Sergio Escalera Guerrero

Care Respite . 2015 . Ref.CaixaImpulse CareRespite . La Caixa . IP: Sergio Escalera

SEE.4C
SpatiotEmporal ForEcasting: Coopetition to meet Current Cross-modal Challenges . 2016 - 2017 . Ref.SEE.4C - H2020 . EU, H2020 . IP: Florin Popescu

Publicacions rellevants (publicacions en revistes i altres publicacions - últims 10 anys)

Corneanu, C.; Oliu, M.; Cohn, J.; Escalera, S (2016). Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-related Applications. IEEE Transactions on Pattern Analysis and Machine Intelligence . ISSN: 0162-8828

Escalera, S.; González, J.; Baró, X.; Shotton, J. (2016). Guest Editors' Introduction to the Special Issue on Multimodal Human Pose Recovery and Behavior Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 . ISSN: 0162-8828

Escalera, S.; Athitsos, V.; Guyon, I. (2016). Challenges in multimodal gesture recognition. Journal of Machine Learning Research, 17, pp. 1 - 54 . ISSN: 1532-4435

Bautista, M.; Pujol, O.; De la Torre, F.; Escalera, S (2017). Error-Correcting Factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(10) . https://doi.org/10.1109/TPAMI.2017.2763146 . ISSN: 0162-8828

Hernanez-Vela, A.; Escalera, S.; Sclaroff, S. (2015). Poselet-basedContextual Rescoring for Human Pose Estimation via Pictorial Structures. International Journal of Computer Vision . ISSN: 0920-5691

Palmero, C.; Clapés, A.; Bahnsen, C.; Møgelmose, A.; Moeslund, T.B.; Escalera, S. (2016). Multi-modal RGB-Depth-Thermal Human Body Segmentation. International Journal of Computer Vision . ISSN: 0920-5691

Palmero, C.; Esquirol, J.; Bayo, V.; Cos, M.; Ahmadmonfared, P.; Salabert, J.; Sánchez, D.; Escalera, S. (2016). Automatic Sleep System Recommendation by Multi-modal RBG-Depth-Pressure Anthropometric Analysis. International Journal of Computer Vision . ISSN: 0920-5691

Perez-Sala, X.; De la Torre, F.; Igual, L.; Escalera, S.; Angulo, C. (2016). Subspace Procrustes Analysis. International Journal of Computer Vision, 121(3), pp. 1 - 17 . Repositori Institucional . ISSN: 0920-5691

Escalera, S.; Gonzàlez, J.; Escalante, H.; Baró, X.; Guyon, I. (2018). Looking at People Special Issue. International Journal of Computer Vision . https://doi.org/10.1007/s11263-017-1058-y . ISSN: 0920-5691

Direcció de Tesis, Tesines i Treballs de Recerca (últims 10 anys)

Xavier Pérez-Sala . (2015) . Extending Procrustes Analysis: Building Multi-view 2-D Models from 3-D Human Shape Samples (Tesi Doctoral) . Universitat Politecnica de Catalunya.

Ciprian Adrian Corneanu . (2015) . Facial expression analysis of neurologically ompaired children (Tesi de Masters) . UAB.

Miguel Angel Bautista . (2016) . Learning Error-Correcting Representations For Multi-class Problems (Tesi Doctoral) . University of Barcelona.

Víctor Ponce López . (2016) . Evolutionary bags of space-time features for human analysis (Tesi Doctoral) . University of Barcelona.

Mohammad Ali Bagheri . (2016) . Ensemble Learning for Visual Recognition (Tesi Doctoral) . Dalhousie University.

Miguel Reyes . (2017) . Human Pose Analysis and Gesture Recognition from Depth Maps: Methods and Applications (Tesi Doctoral) . .

Frederic Sampedro . (2017) . Automatic image quantification strategies in clinical nuclear medicine and neuroradiology (Tesi Doctoral) . .

Meysam Madadi . (2017) . Human Segmentation, Pose Estimation and Applications (Tesi Doctoral) . Universitat Autonoma de Barcelona.

Conferències i Participacions a Congressos (últims 10 anys)

Baro, X.; Gonzalez, J.; Fabian, J.; Bautista, M.; Oliu, M.; Escalante, H.; Guyon, I.; Escalera, S. (2015). ChaLearn looking at people 2015 challenges: action spotting and cultural event recognition. (Presentació comunicació) . CVPR workshops . ESTATS UNITS D'AMÈRICA

Ali Bagheri, M.; Gao, Q.; Escalera, S.; Clapes, A.; Nasrollahi, K.; Holte, M.; Moeslund, T. (2015). Keep it accurate and diverse: enhancing action recognition performance by ensemble learning. (Presentació comunicació) . CVPR Worlshops . ESTATS UNITS D'AMÈRICA

Irani, R.; Nasrollahi, K.; Bahnsen, C.; Lundtoft, D.; Moeslund, T.; Oliu, M.; Corneanu, C.; Escalera, S.; Pedersen, T.; Klitgaard, M.; Petrini, L. (2015). Spatio-temporal analysis of rgb-t facial Images for multimodal pain level recognition. (Presentació comunicació) . CVPR Workshops . ESTATS UNITS D'AMÈRICA

Wan, J.; Zhao, Y.; Zhou, S.; Guyon, I.; Escalera, S. (2016). ChaLearn Looking at People RGB-D Isolated and Continuous Datasets for Gesture Recognition. (Presentació comunicació) . CVPR . ESTATS UNITS D'AMÈRICA

Yuan, S.; Garcia-Hernando, G.; Stenger, B.; Moon, G.; Chang, J.; Lee, K.; Molchanov, P.; Kautz, J.; Honari, S.; Ge, L.; Yuan, J.; Chen, X.; Wang, G.; Yang, F.; Akiyama, K.; Wu, Y.; Wan, Q.; Madadi, M.; Escalera, S.; Li, S.; Lee, D.; Oikonomidis, I.; Argyros, A.; Kim, T. (2018). Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals. (Poster) . Computer Vision and Pattern Recognition, CVPR . ESTATS UNITS D'AMÈRICA

Perez-Sala, X.; De la Torre, F.; Igual, L.; Escalera, S.; Angulo, C. (2014). Subspace Procrustes Analysis. (Presentació comunicació) . ECCV Workshop on ChaLearn Looking at People . SUÏSSA

Ponce-López, V.; Chen, B.; Oliu, M.; Corneanu, C.; Clapés, A.; Guyon, I.; Baró, X.; Jair, H.; Escalera, S. (2016). ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results. (Presentació comunicació) . ChaLearn Apparent Personality Analysis workshop, ECCV . PAÏSOS BAIXOS

Antonio Hernández-Vela; Stan Sclaroff; Sergio Escalera (2014). Contextual rescoring for Human Pose Estimation. (Poster) . British Machine Conference on Computer Vision - BMVC . REGNE UNIT

Ponce-López, Victor.; Escalante, H.; Escalera, S.; Baró, X (2015). Gesture and Action Recognition by Evolved Dynamic Subgestures. (Poster) . British Machine Vision Conference, BMVC . REGNE UNIT

Clapés, A.; Tuytelaars, T.; Escalera, S. (2017). Darwintrees for action recognition. (Presentació comunicació) . ICCV . ITÀLIA

Asadi-Aghbolaghi, M.; Bertiche, H.; Roig, V.; Kasaei, S.; Escalera, S. (2017). Action Recognition from RGB-D Data: Comparison and Fusion of Spatio-temporal Handcrafted Features and Deep Strategies. (Presentació comunicació) . ICCV . ITÀLIA

Wan, J.; Escalera, S.; Anbarjafari, G.; Escalante, H.; Baro, X.; Guyon, I.; Madadi, M.; Allik, J.; Gorbova, J.; Lin, C.; Xie, Y. (2017). Results and Analysis of ChaLearn LAP Multi-modal Isolated and ContinuousGesture Recognition, and Real versus Fake Expressed Emotions Challenges. (Presentació comunicació) . ICCV . ITÀLIA

Patents, Programari i Base de Dades

ADiBAS Posture: Automatic Digital Biometry Analysis System (ESPANYA, 2011)

Método y sistema de visión artificial para el control de calidad de servicios públicos municipales (ESPANYA, 2011)

Software para la transmisión de información y documentación de casos complejos en salud (---, 12/09/2013)

Procedimiento para identificar el gesto de una mano (---, 01/08/2014)

A computer-implemented method and a system for remotely monitoring a user, and a computer program product implementing the method (REGNE UNIT, 30/07/2014)