Books and Proceedings

Michel Valstar, Andrew French, and Tony Pridmore (Eds.), 'Proceedings of the 25th British Machine Vision Conference', Nottingham, September 2014

Book Chapters

Michel Valstar and Maja Pantic. 'Facial Actions as Social Signals', in 'Social Signal Processing Book', A. Vinciarelli, M. Pantic, J. Burgoon, N. Magnenat-Thalmann (eds.), Cambridge University Press, 2014/2015 (to appear).

Michel Valstar, 'Chapter 8: Automatic Facial Expression Recognition', in 'Understanding facial expressions in communication', Manas Mandal and Avinash Awasthi (Eds.), Springer 2014.

Michel Valstar, Stefanos Zafeiriou, and Maja Pantic. 'Chapter 8: Facial Action Recognition in 2D and 3D', in 'Face Recognition in Adverse Conditions', Maria de Marsico, Maichel Nappi, and Massimo Tistarelli (Eds.), IGI Global publishing 2014.

Reports

Independent Accuracy Verification Reports of Aurora's Face Recognition software: Report A - Simple Identification Statistics, Report B - Simple Verification Statistics, Report C - Comparative Analysis

Chris Hollis, Jennifer Martin, S. Amani, R. Cotton, M. Denis, S. Lewis, 'Chapter 4. Technological innovations in mental healthcare', in Davies, S.C. Annual Report of the Chief Medical Officer 2013, Public Mental Health Priorities: Investing in the Evidence, London: Department of Health, 9th September, 2014

Note the MindTech statement on authorship of CMO report.

Peer reviewed publications

2017

Brais Martinez, Michel Valstar, Bihan Jiang, and Maja Pantic, Automatic Analysis of Facial Actions: A Survey, Transactions on Affective Computing, 2017

Shashank Jaiswal, Michel F. Valstar, Alinda Gillott, and David Daley (2017). Automatic detection of ADHD and ASD from expressive behaviour in RGBD data. In: 12th IEEE International Conference on Face and Gesture Recognition (FG 2017), 30 May - 3 June 2017, Washington, DC, USA. (In Press).

Mercedes Torres Torres, Michel F. Valstar, Caroline Henry, Carole Ward, and Don Sharkey (2017). Small sample deep learning for newborn gestational age estimation. In: 12th IEEE International Conference on Face and Gesture Recognition (FG 2017), 30 May - 3 June 2017, Washington, DC, USA. (In Press)

Joy Onyekachukwu Egede, Michel F. Valstar, and Brais Martinez (2017). Fusing deep learned and hand-crafted features of appearance, shape, and dynamics for automatic pain estimation. In: 12th IEEE Conference on Face and Gesture Recognition (FG 2017), 30 May-3 June 2017, Washington, D.C., U.S.A.. (In Press)

2016

Michel F. Valstar, Tobias Baur, Angelo Cafaro, Alexandru Ghitulescu, Blaise Potard, Johannes Wagner, Elisabeth André, Laurent Durieu, Matthew Aylett, Soumia Dermouche, Catherine Pelachaud, Eduardo Coutinho, Björn Schuller, Yue Zhang, Dirk Heylen, Mariët Theune, and Jelte van Waterschoot (2016). Ask Alice: an artificial retrieval of information agent. In: 18th ACM International Conference on Multimodal Interaction (ICMI 2016), 12-16 Nov 2016, Tokyo, Japan

Enrique Sanchez Lozano, Brais Martinez, Yorgos Tzimiropoulos, and Michel Valstar, Cascaded Continuous Regression for Real-time Incremental Face Tracking, Proc. European Conference on Computer Vision (ECCV2016), 2016

Andry Chowanda, Peter Blanchfield, Martin Flintham, and Michel Valstar, Playing with Social and Emotional Game Companions, Proc. Intelligent Virtual Agents (IVA2016), 2016

Wenjue Zhu, Andry Chowanda, and Michel Valstar, Topic Switch Models for Dialogue Management in Virtual Humans, Proc. Intelligent Virtual Agents (IVA2016), 2016

Andry Chowanda, Peter Blanchfield, Martin Flintham, and Michel Valstar, Computational Models of Emotion, Personality, and Social Relationships for Interactions in Games, Proc. 15th Int'l Conf. Autonomous Agents and Multiagent Systems (AAMAS2016), 2016

Enrique Sánchez Lozano, Brais Martinez and Michel Valstar, Cascaded Regression with Sparsified Feature Covariance Matrix for Facial Landmark Detection, Pattern Recognition Letters, 2016

Shashank Jaiswal and Michel Valstar, Deep Learning the Dynamic Appearance and Shape of Facial Action Units, Winter Conference on Applications of Computer Vision (WACV), 2016

2015

Brais Martinez and Michel Valstar, L2; 1-based regression and prediction accumulation across views for robust facial landmark detection , Image and Vision Computing, 2015

Timur Almaev, Brais Martinez, and Michel Valstar, Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection, Proc. Int'l Conf. Computer Vision (ICCV), 2015

Xiaomeng Wang, Michel Valstar, Brais Martinez, Haris Khan, and Tony Pridmore, TRIC-track: Tracking by Regression with Incrementally Learned Cascades, Proc. Int'l Conf. Computer Vision (ICCV), 2015

Fabien Ringeval, Björn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie and Maja Pantic, AV+ EC 2015--The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data, Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge (AVEC), ACM Multimedia, Brisbane, Australia, 2015

Min S. H. Aung, Sebastian Kaltwang, Bernardino Romera-Paredes et al., The automatic detection of chronic pain-related expression: requirements, challenges and a multimodal dataset, Transactions on Affective Computing, in print, 2015

Cynthia Solomon, Michel Valstar, Richard Morris and John Crowe, Objective Methods for Reliable Detection of Concealed Depression, Frontiers in ICT - Human Media Interaction, 2015

Shashank Jaiswal, Brais Martinez and Michel F. Valstar, Learning to combine local models for Facial Action Unit detection, Proc. IEEE Int'l Conf. Face and Gesture Recognition, 2015

Michel Valstar, Jeff Girard, Timur Almaev, Gary McKeown, Marc Mehu, Lijun Yin, Maja Pantic, Jeff Cohn, FERA 2015 - Second Facial Expression Recognition and Analysis Challenge, Proc. IEEE Int'l Conf. Face and Gesture Recognition, 2015

2014

Haris Khan, Michel Valstar, and Tony Pridmore, 'MTS: A Multiple Temporal Scale Tracker Handling Occlusion and Abrupt Motion Variation', Proc. Asian Conf. Computer Vision (ACCV), 2014

Michel Valstar, 'Automatic Behaviour Understanding in Medicine', Proc. Int'l Conference Multimodal Interaction (workshop section), 2014

Max L. Wilson, Susan Ali, and Michel Valstar, 'Finding Information about Mental Health in Microblogging Platforms: a Case Study of Depression', Proc. Int'l Information Interaction in Context conference (IIiX), 2014

Andry Chowanda, Peter Blanchfield, Martin Flintham, and Michel Valstar, 'ERiSA: Building Emotionally Realistic Social Game-Agents Companions', Proc. Int'l Intelligent Virtual Agents (IVA), 2014

Haris Khan, Michel Valstar, and Tony Pridmore, 'A Generalized Search Method for Multiple Competing Hypotheses in Visual Tracking', Proc. Int'l Conf. Pattern Recognition (ICPR), 2014

Bihan Jiang, Brais Martinez, Michel Valstar, and Maja Pantic, 'Decision Level Fusion of Domain Specific Regions for Facial Action Recognition', Proc. Int'l Conf. Pattern Recognition (ICPR), 2014

Michel Valstar, Bjoern Schuller, Kirsty Smith, Timur Almaev, Florian Eyben, Jarek Krajewski, Roddy Cowie, and Maja Pantic, 'AVEC 2014 - 3D Dimensional Affect and Depression Recognition Challenge', proc. 4th ACM international workshop on Audio/visual emotion challenge, 2014

Bihan Jiang, Michel Valstar, Brais Martinez, and Maja Pantic, 'A Dynamic Appearance Descriptor Approach to Facial Actions Temporal Modelling', IEEE Transactions on Cybernetics, 44(2), pp 161-174, 2014

2013

Shashank Jaiswal, Timur Almaev, Michel F. Valstar, 'Guided Unsupervised Learning of Mode Specific Models for Facial Point Detection in the Wild', Proc. IEEE Int'l Conf. Computer Vision (ICCV) Workshops, pp. 370-377, December 2013

Timur Almaev, Anil Yüce, and Michel F. Valstar, 'Distribution-based Iterative Pairwise Classification of Emotions in the Wild Using LGBP-TOP', Proc. ACM Int'l. Conf. Multimodal Interaction, in press, Sidney, 2013

Timur Almaev, Michel Valstar, 'Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition', Proc. Affective Computing and Intelligent Interaction, pp. 356-361, 2013

Michel F. Valstar, Björn Schuller, Kirsty Smith, Florian Eyben, Bihan Jiang, Sanjay Bilakhia, Sebastian Schnieder, Roddy Cowie, and Maja Pantic, 'AVEC 2013 - The Continuous Audio/Visual Emotion and Depression Recognition Challenge', proc. 3rd ACM international workshop on Audio/visual emotion challenge, pp 3-10, 2013

Brais Martinez, Michel Valstar, Xavier Binefa, and Maja Pantic, 'Local Evidence Aggregation for Regression Based Facial Point Detection', Transactions on Pattern Analysis and Machine Intelligence, vol. 35(5), pp 1149-1163, 2013

2012

Bihan Jiang, Michel Valstar, and Maja Pantic, 'Facial Action Detection using Block-based Pyramid Appearance Descriptors', proc. ASE/IEEE Int'l conf on Social Computing, Amsterdam, pp. 429-434, September 2012

Michel Valstar, Marc Mehu, Bihan Jiang, Maja Pantic, and Klaus Scherer, 'Meta-Analysis of the First Facial Expression Recognition Challenge', IEEE Transactions on Systems, Man, and Cybernetics-B, vol. 42(4), pp. 966-979, 2012.

Björn Schuller, Michel F. Valstar, Florian Eyben, Roddy Cowie, and Maja Pantic, 'AVEC 2012 – The Continuous Audio/Visual Emotion Challenge', proc. ACM Int'l Conf. Multimodal Interaction, pp. 449-456, October 2012

Michel F. Valstar and Maja Pantic, 'Fully Automatic Recognition of the Temporal Phases of Facial Actions', IEEE Transactions on Systems, Man, and Cybernetics-B, 42(1), pp. 28-43, February 2012

Gary McKeown, Michel Valstar, Roddy Cowie, Maja Pantic, and Marc Schröder, 'The SEMAINE database: annotated multimodal records of emotionally coloured conversations between a person and a limited agent', IEEE Transactions on Affective Computing, vol. 3, pp 5-17, 2012

2011

M Schröder, E bevacqua, R Cowie, F Eyben, H Gunes, D Heylen, M Ter Maat, G McKeown, S Pammi, M Pantic, C Pelachaud, B Schuller, E De Sevin, M Valstar, M Wöllmer, 'Building Autonomous Sensitive Artificial Listeners', IEEE Transactions on Affective Computing, vol. 3(2), pp. 165-183, October 2011

Jeroen Lichtenauer, Jie Shen, Michel Valstar, Maja Pantic, 'Cost-effective solution to synchronised audio-visual data capture using multiple sensors, Image and Vision Computing', Image and Vision Computing, vol. 29(10), pp 666-680, 2011

Xiaofan Sun, Jeroen Lichtenauer, Michel Valstar, Anton Nijholt, and Maja Pantic, 'A Multimodal Database for Mimicry Analysis', Proc. Affective Computing and Intelligent Interaction, 2011

Björn Schuller, Michel Valstar, Florian Eyben, Gary McKeown, Roddy Cowie, and Maja Pantic, 'AVEC 2011 – The First International Audio/Visual Emotion Challenge', Proc. Affective Computing and Intelligent Interaction, pp. 415-424, 2011

Michel F. Valstar, Bihan Jiang, Marc Mehu, Maja Pantic, and Klaus Scherer, 'The First Facial Expression Recognition and Analysis Challenge', IEEE Int'l. Conf. Face and Gesture Recognition (FG'11), pp. 921-926, March 2011

Bihan Jiang, Michel F. Valstar, and Maja Pantic, 'Action Unit detection using sparse appearance descriptors in space-time video volumes', IEEE Int'l. Conf. Face and Gesture Recognition (FG'11), pp. 314-321, March 2011

Florian Eyben, Martin Woellmer, Michel F. Valstar, Hatice Gunes, Björn Schuller and Maja Pantic, 'String-based Audiovisual Fusion of Behavioural Events for the Assessment of Dimensional Affect', IEEE Int'l. Conf. Face and Gesture Recognition (FG'11), pp. 322-329, March 2011

2010

David Tax, Michel F. Valstar, Maja Pantic and Emile Hendrix, 'The detection of concept frames using Clustering Multi-Instance Learning', Proc. Int’l Conf. Pattern Recognition (ICPR’10), pp. 2917-2920, Istanbul, Turkey, August 2010

Gary McKeown, Michel F. Valstar, Roderick Cowie, and Maja Pantic, 'The SEMAINE Corpus of Emotionally Coloured Character Interactions', Proc. IEEE Int’l Conf. Multimedia & Expo (ICME’10), pp. 1079-1084, Singapore, July 2010

Michel F. Valstar, Brais Martinez, Xavier Binefa, and Maja Pantic 'Facial Point Detection using Boosted Regression and Graph Models', IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 2729-2736, San Francisco, USA, June 2010

Michel F. Valstar, and Maja Pantic, 'Induced Disgust, Happiness and Surprise: an Addition to the MMI Facial Expression Database', Proc. 3rd Intern. Workshop on EMOTION (satellite of LREC): Corpora for Research on Emotion and Affect, Valletta, Malta. ELRA, pp. 65-70, 2010

2009

J. Lichtenauer, M. Valstar, J. Shen and M. Pantic, 'Cost-effective solution to synchronized audio-visual capture using multiple sensors', Proc. IEEE Int’l Conf. Advanced Video and Signal Based Surveillance (AVSS’09), pp. 324-329, September 2009

M. Schröder, E. Bevacqua, F. Eyben, H. Gunes, D. Heylen, M. Maat, S. Pammi, M. Pantic, C. Pelachaud, B. Schuller, E. Sevin, M. Valstar, and M. Wöllmer, 'A Demonstration of Audiovisual Sensitive Artificial Listeners', Proc. IEEE Int’l Conf. Affective Computing and Intelligent Interaction (ACII’09), Vol. 1, pp. 263-264, Amsterdam, Netherlands, September 2009. Best Demo Award.

2008

E. Robinson, M.F. Valstar, A. Hammers, A. Ericsson, D. Edward, D. Rueckert, 'Multivariate Statistical Analysis of Whole Brain Structural Networks Obtained Using Probabilistic Tractography', in Int'l conf. on medical image computing and computer assisted intervention, pp 486-493, 2008

S. Colton, M.F. Valstar and M. Pantic, 'Emotionally aware automated portrait painting', Proc. ACM Int’l Conf. Digital Interactive Media in Entertainment and Arts (DIMEA’08), pp. 304-311, Athens, Greece, September 2008

2007

M.F. Valstar, H. Gunes and M. Pantic, 'How to Distinguish Posed from Spontaneous Smiles using Geometric Features', in Proceedings of ACM Int'l Conf. Multimodal Interfaces (ICMI'07), pp. 38-45, Nagoya, Japan, November 2007 (Copyright 2007 ACM Press)

M.F. Valstar and M. Pantic, 'Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics', in Proceedings of IEEE Workshop on Human Computer Interaction (HCI'07), in conjunction with IEEE ICCV'07, Rio de Janeiro, Brazil, October 2007. Best Paper Award

2006

M.F. Valstar, M. Pantic, Z. Ambadar and J.F. Cohn, 'Spontaneous vs. posed facial behavior: automatic analysis of brow actions', Proc. ACM Intl. conf. on Multimodal Interfaces (ICMI'06), pp. 162—170, Banff, Canada, November 2006

M.F. Valstar and M. Pantic, 'Biologically vs. logic inspired encoding of facial actions and emotions in video', Proc. IEEE Int'l Conf. on Multimedia and Expo (ICME '06), pp. 325-328, Toronto, Canada, July 2006

M.F. Valstar and M. Pantic, 'Fully automatic facial action unit detection and temporal analysis', Proc. IEEE Int'l Conf. on Computer Vision and Pattern Recognition (CVPR'06), pp. 149-156, New York, USA, June 2006

2005

M. Pantic, I. Patras and M.F. Valstar, 'Learning spatiotemporal models of facial expressions', Proc. Int'l Conf. Measuring Behaviour (MB'05), pp. 7-10, Wageningen, The Netherlands, September 2005

M. Pantic, M.F. Valstar, R. Rademaker and L. Maat, 'Web-based database for facial expression analysis', Proc. IEEE Int'l Conf. on Multimedia and Expo (ICME '05), pp. 317-321, Amsterdam, The Netherlands, July 2005 (Copyright 2005 IEEE Press)

M.F. Valstar, I. Patras and M. Pantic, 'Facial Action Unit Detection using Probabilistic Actively Learned Support Vector Machines on Tracked Facial Point Data', IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 3, pp. 76-84, San Diego, june 2005

2004

M.F. Valstar, I. Patras and M. Pantic, 'Motion history for facial action detection in video', Proc. IEEE Int'l Conf. Systems Man and Cybernetics, vol 1, pp. 635-640, Den Haag, October 2004

M.F. Valstar, I. Patras and M. Pantic, 'Facial action unit recognition using temporal templates', Proc. IEEE Int'l Workshop on Robot Human Interaction (ROMAN), Kurashiki, september 2004


Theses

Michel F. Valstar, Timing is everything: A spatio-temporal approach to the analysis of facial actions, Ph.D. Thesis, Department of Computing, Imperial College London, February 2008

Michel F. Valstar, Facial Action Unit Detection in Face Video, M.Sc. Thesis, EEMCS, Delft University of Technology, June 2005