Francois Pitie
Ussher Assistant Professor, Electronic & Elect. Engineering

Biography

François Pitié is an Ussher Assistant Professor in Media Signal Processing, Trinity College Dublin. Ussher professors are part of Trinity's strategy to recruit excellent academics in areas where Trinity has proven strengths. He has made several key contributions in the field of Video Processing and Computer Vision and published over 40 publications, with a combined total of 670+ citations. He has attracted over 400,000 euros in research funding and is the recipient of a Google Faculty Research Award. He has participated in the writing of 7 successful research proposals and was PI of a EI commercialisation fund project and the TCD research lead for a 3 year FP7 EU project. He has supervised 1 postdoc, 4 Ph.D. students and 13 M.Sc. students. He is a reviewer in first tier conferences and journals such as Siggraph and IEEE Transactions in Image Processing, co-chair of IMVIP 2015 and CVMP 2017, organised a number of workshops. Dr François Pitié is holder of 3 patents and developed algorithms and software that are used by companies such as Google, Disney, The Foundry and Weta Digital, and by post-production artists all over the world. He is also the founder and director of PixelPuffin, a TCD Campus company for commercialising media post- production technology.

Publications and Further Research Outputs

Peer-Reviewed Publications

François Pitié, Rank Reduced Alternative Matting Laplacian, CVMP 2016 Proceedings of the 13th European Conference on Visual Media Production (CVMP 2016), London, United Kingdom, December 12-13, ACM, 2016 Conference Paper, 2016 DOI

François Pitié, An alternative matting Laplacian, Image Processing (ICIP), 2016 IEEE International Conference on, Phoenix, Arizona, IEEE, 2016, pp3623 - 3627 Conference Paper, 2016 DOI URL

Rozenn Dahyot, Gerard Lacey, Kenneth Dawson-Howe, François Pitié, David Moloney (Editors), IRISH MACHINE VISION & IMAGE PROCESSING Conference proceedings 2015, Irish Pattern Recognition & Classification Society (ISBN 978-0-9934207-0-2), 2015, 1 - 139pp Book, 2015 Handle TARA - Full Text Other

Gary Baugh, Anil Kokaram, François Pitié, Advanced video debanding, CVMP '14: Proceedings of the 11th European Conference on Visual Media Production, CVMP '14: Proceedings of the 11th European Conference on Visual Media Production, ACM, 2014, ppa7- Conference Paper, 2014 TARA - Full Text

Francois Pitie and Damien Kelly and Thierry Foucu and Naomi Harte and Anil C. Kokaram , Assessment of Audio/Video synchronisation in streaming media., International Workshop on Quality of Multimedia Experience, Singapore, 2014, pp171 - 176 Conference Paper, 2014

Elgharib, M.A., Pitite, F., Kokaram, A., Saligrama, V. , User-assisted reflection detection and feature point tracking, ACM International Conference Proceeding Series, ACM International Conference, 6-7 Nov, 2013, ppa13- Conference Paper, 2013 TARA - Full Text DOI

Rowley-Brooke, R., Pitié, F., Kokaram, A. , Nonrigid recto-verso registration using page outline structure and content preserving warps, M International Conference Proceeding Series, M International Conference , 2013, pp8-13 Conference Paper, 2013 DOI

Elgharib, Mohamed A Pitié, François Kokaram, Anil , Blotch and scratch removal in archived film using a semi-transparent corruption model and a ground-truth generation technique , EURASIP Journal on Image and Video Processing , 2013 , (1 ), 2013, p1 - 20 Journal Article, 2013 TARA - Full Text

Raimbault, F., Pitié, F., Kokaram, A. , User-assisted sparse stereo-video segmentation, ACM International Conference Proceeding Series, ACM International Conference, 6-7 Nov, 2013, ppa3- Conference Paper, 2013 DOI TARA - Full Text

Róisín Rowley-Brooke, François Pitié, and Anil Kokaram, Degraded manuscript restoration: A case study, Annual Conference of the Society for Musicology in Ireland, 2013 Conference Paper, 2013

Rowley-Brooke, R., Pitie, F., Kokaram, A. , A non-parametric framework for document bleed-through removal, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 6619224, 2013, pp2954-2960 Conference Paper, 2013 DOI

Pitié, François and Baugh, Gary and Helms, John, Depthartist: a stereoscopic 3d conversion tool for cg animation, 9th European Conference on Visual Media Production, London, United Kingdom, ACM, 2012, pp32 - 39 Conference Paper, 2012 DOI

F. Raimbault, F. Pitié and A. Kokaram, Stereo Video Completion for Rig and Artefact Removal, Workshop on Image Analysis for Multimedia Interactive Services, 2012 Conference Paper, 2012

Rowley-Brooke, R., Pitié, F., Kokaram, A. , A ground truth bleed-through document image database, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 7489 LNCS, 2012, p185-196 Journal Article, 2012 DOI

M. Ahmed, F. Pitie and A. Kokaram, Reflection Detection in Image Sequences, IEEE Conference on Computer Vision and Pattern Recognition, 2011 Conference Paper, 2011

D. Corrigan, F. Pitié and A. Kokaram, Restoring Image Burnout in 3D-Stereoscopic Media using Temporally Consistent Disparity Maps, Irish Signals and Systems Conference, Dublin, Ireland, 2011 Conference Paper, 2011

M. Ahmed, F. Pitie and A. Kokaram, Motion Estimation for Regions of Reflections Through Layer Separation, IEEE European Conference on Visual Media Production, London, 2011 Conference Paper, 2011

D. Corrigan, F. Pitié and A. Kokaram. , Restoration of Image Burnout in 3D-Stereoscopic Media using Inter-View Gradient Interpolation, European Signal Processing Conference, Barcelona, Spain., Eurasip, 2011 Conference Paper, 2011

Advances in automated restoration of archived video in, Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks, CRC Press, 2011, pp299 - 322, [Kokaram, Anil and Pitié, François and Corrigan, David and Vitulano, Domenico and Bruni, Vittoria and Crawford, Andrew] Book Chapter, 2011

D. Corrigan, F. Pitié, V. Morris, A. Rankin, M. Linnane, G. Kearney, M. Gorzel, M. O'Dea, C. Lee and A. Kokaram, A Video Database for the Development of Stereo-3D PostProduction Algorithms, European Conference on Visual Media Production, London, 2010 Conference Paper, 2010

F. Pitié and A. Kokaram, Matting with a Depth Map, International Conference on Image Processing, Hong Kong, 2010 Conference Paper, 2010

D. Corrigan, F. Pitié, V. Morris, A. Rankin, M. Linnane, G. Kearney, M. Gorzel, M. O'Dea, C. Lee, and A. Kokaram., A video database for the development of stereo-3d post-production algorithms, European Conference on Visual Media Production, London, 2010 Conference Paper, 2010

F. Pitie , Using One Graph-Cut to Fuse Multiple Candidate Maps in Depth Estimation., IEEE European Conference on Visual Media Production (CVMP), London, UK, 2009, pp1-8 Conference Paper, 2009 TARA - Full Text URL

Ahmed, Mohamed A.; Pitie, Francois; Kokaram, Anil C., Extraction of Non-Binary Blotch Mattes. , Image Processing (ICIP), 2009 16th IEEE International Conference on , IEEE Conference on image Processing (ICIP'09). , Cairo, Egypt, IEEE, 2009, pp2757 - 2760 Conference Paper, 2009 DOI TARA - Full Text

D. Ring and F. Pitie, Feature-Assisted Sparse to Dense Motion Estimation using Geodesic Distances., IEEE Irish Machine Vision and Image Processing conference (IMVIP '09, Dublin, Ireland, September 2-4, IEEE, 2009, pp7-12 Conference Paper, 2009 DOI TARA - Full Text

D. Kelly, F. Pitie,A.Kokaram, F. Boland,, A Comparative Error Analysis of Audio-Visual Source Localization, International Workshop on Multi Camera and Multi-modal Sensor Fusion, ECCV 2008, Marsaille, October 2008, 2008 Conference Paper, 2008 TARA - Full Text

Enhancement of digital photographs using color transfer techniques in, editor(s)Rastislav Lukac , Single-Sensor Imaging: Methods and Applications for Digital Cameras, CRC Press, 2008, pp295 - 321, [Francois Pitié, Rozenn Dahyot and Anil Kokaram] Book Chapter, 2008 URL

Action Recognition in Multimedia Streams in, editor(s)Petros Maragos, Alexandros Potamianos, Patrick Gros , Multimodal Processing and Interaction, Springer Verlag. , 2008, pp127 - 142, [Daire Lennon, Naomi Harte, and Anil Kokaram, Rozenn Dahyot, Francois Pitie] Book Chapter, 2008

Gigonzac, G. Pitie, F. Kokaram, A. , Electronic slide matching and enhancement of a lecture video, Visual Media Production, IETCVMP. 4th European Conference on Visual Media Production, 2007., London, 27-28 Nov. 2007 , 2007, 1 - 7 Conference Paper, 2007 URL TARA - Full Text

F. Pitie, A. Kokaram and R. Dahyot, Automated Colour Grading using Colour Distribution Transfer , Computer Vision and Image Understanding, 107, 2007, p123 - 137 Journal Article, 2007

Pitie, F. Kokaram, A. , The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer, Visual Media Production, 4th European Conference on Visual Media Production, London, UK , 27-28 Nov. 2007, 2007, pp1 - 9 Conference Paper, 2007 URL TARA - Full Text

F. Pitie; B. Kent; B. Collis; A. C. Kokaram;, Localised deflicker of moving images, 3rd European Conference on Visual Media Production, 2006, 2006, pp134 - 143 Conference Paper, 2006 TARA - Full Text URL

Francois Pitie, Statistical Signal Processing Techniques for Visual Post-Production, 2006 Thesis, 2006

A. Kokaram, F. Pitié, R. Dahyot, N. Rea and S. Yeterian, Content Controlled Image Representation for Sports Streaming, IEEE workshop on Content Based Multimedia Indexing (CBMI'05), Riga, Latvia, June, (ISBN: 952-15-1364-0), Suvisoft, 2005 Conference Paper, 2005 TARA - Full Text URL

F. Pitié, S-A. Berrani, R. Dahyot and A. Kokaram, Off-line multiple object tracking using candidate selection and the viterbi algorithm , IEEE International Conference on Image Processing (ICIP'05), Genoa, Italy, 11-14 Sept., 3, 2005, pp109 - 112 Conference Paper, 2005 DOI URL TARA - Full Text URL

Pitie, F. Kokaram, A.C. Dahyot, R., Towards automated colour grading, Visual Media Production, The 2nd IEE European Conference on Visual Media Production, 2005. , 30 Nov. - 1 Dec. 200, 2005, pp9 - 16 Conference Paper, 2005 URL

F. Pitié, A. Kokaram and R. Dahyot, N-dimensional probability density function transfer and its aplication to colour transfer, IEEE International Conference on Computer Vision (ICCV'05), Beijing, China, 17-21 Oct., 2, 2005, pp1434 - 1439 Conference Paper, 2005 DOI URL URL TARA - Full Text

Andrew Crawford, Hugh Denman, Francis Kelly, Francois Pitié and Anil Kokaram, Gradient Based Dominant Motion Estimation with Integral Projections for Real Time Video Stabilisation,, IEEE International Conference on Image Processing (ICIP'04), Singapore, 24-27 Oct., 5, 2004, pp3371 - 3374 Conference Paper, 2004 TARA - Full Text DOI URL URL

F. Pitié, A. Kokaram and R. Dahyot, Oriented Particle Spray: A New Probabilistic Contour Tracing with Directional Information,, Irish Machine Vision and Image Processing (IMVIP), , Dublin, Sept , 2004, pp159 - 165 Conference Paper, 2004

Pitié, F., Dahyot, R., Kelly, F., Kokaram, A., A new robust technique for stabilizing brightness fluctuations in image sequences, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 3247, 2004, p153-164 Journal Article, 2004

A. Crawford, H. Denman, F. Kelly, F. Pitie and A. Kokaram , Gradient Based Dominant Motion Estimation with Integral Projections, IEEE International Conference on Image Processing, Singapore, 2004 Conference Paper, 2004

F. Pitié, A. C. Kokaram and R. Dahyot, Oriented Particle Spray: A New Probabilistic, Irish Machine Vision and Image Processing, Dublin, 2004 Conference Paper, 2004

F. Pitié, R. Dahyot, F. Kelly and A. Kokaram, A New Robust Technique for Stabilizing Brightness Fluctuations in Image Sequences, , 2nd Workshop on Statistical Methods in Video Processing In conjunction with ECCV, Prague, Czech Republic, 16 May, edited by Dorin Comaniciu, Kenichi Kanatani, Rudolf Mester and David Suter , LNCS 3247, Springer Verlag, 2004, pp153 - 164 Conference Paper, 2004 URL

Anil C. Kokaram, Rozenn Dahyot, Francois Pitié, Hugh Denman, Simultaneous Luminance and Position Stabilization for Film and Video, , Visual Communications and Image Processing, San Jose, California USA, Jan , 5022, 2003, pp688 - 699 Conference Paper, 2003 URL

F. Pitié, R. Dahyot and A. Kokaram, Suppression du bruit de pompage dans les vidéos,, GRETSI conference on signal and image processing, Paris, France., September 2003, 2003 Conference Paper, 2003

François Pitié, Removing Flicker from Old Movies,, 2002 Thesis, 2002 URL

Non-Peer-Reviewed Publications

Damien Kelly, Frank Boland, Francois Pitie, Anil Kokaram, 'Automated video production system and method ', USPTO, US9305600 B2, 2016, Provost Fellows And Scholars Of The College Of The Holy And Undivided Trinity Of Queen Elizabeth, Near Dublin Patent, 2016 URL

Steve Woods, John Scott, Philip Connaughton, Michelle Boulé, François Pitié, Matt Porter , 'iDuet', 2015, - Film production, 2015 URL

Crawford, Andrew and Kokaram, Anil and Kelly, Francis and Denman, Hugh and Pitié, François, 'Dominant motion estimation for image sequence processing', USPTO, US8385418 B2, 2013, Google, Inc Patent, 2013 URL

PixelPuffin, 'DepthArtist', 2012, - Software, 2012

Sophie Merry, Francois Pitie, Anil Kokaram, Trevor Whelan, Chris Timms, 'Clockhead', 2011, - Film production, 2011

Francois Pitie, Anil Kokaram, 'Method for matching color in images', USPTO, US 7796812 B2, 2010, Google, Inc Patent, 2010 URL

The Foundry, 'Deflicker2, part of the Academy Award winning software suite Furnace', 2008, - Software, 2008

The Foundry, 'MatchGrade, part of the Academy Award winning software suite Furnace', 2007, - Software, 2007

GreenParrotPictures, 'FilmFix', 2004, - Software, 2004

Research Expertise

Projects

  • Title
    • Advanced Video Debanding
  • Summary
    • Improving the quality of online videos is a key challenge for video streaming companies. We considered in this project the issue of banding, which is a quantisation artefact that affects most videos and does not go away by simply increasing the allowed bandwidth. We built on our experience in developing tools for the movie-postproduction industry to produce a solution that targets the whole range of videos, from low-bandwidth to high quality movies.
  • Funding Agency
    • Google Research Award
  • Date From
    • 2013
  • Date To
    • 2013
  • Title
    • 3DScam
  • Summary
    • Producing stereoscopic 3D content for TV's and cinema turns out to be be a very expensive task. In the case of animated movies, a 3D stereo version can in theory be simply created by rendering the 3D object data from the two views for left and right eye. This however consumes a huge amount of rendering time, has a massive impact on the traditional production pipeline and thus result in an dramatically increased production cost. It was proposed in 3DSCAM to create a technology suite that allows digital artists to have full artistic control over the creation of a stereoscopic scene in its final version, while not requiring any change to the production pipeline. Technology issued from this project has been licensed to PixelPuffin (www.pixelpuffin.com).
  • Funding Agency
    • Enterprise Ireland
  • Date From
    • 2011
  • Date To
    • 2013

Keywords

Computer Vision and Image Processing; Signal, Video & Audio Processing; VIDEO PROCESSING