Leonid Sigal

Disney Research Pittsburgh / Department of Computer Science, Carnegie Mellon University

 
 
 

Menu

Home | About | Biography | CV Students and Collaborators | Research | Teaching | Publications | by Type | by Year | Talks | Code and Data |

Contact

Disney Research Pittsburgh
4615 Forbes Ave
Pittsburgh, PA 15213

Phone: (412) 802-6154
Email: lsigal at disneyresearch.com

2017

Weakly-supervised Visual Grounding of Phrases with Linguistic Structures, F. Xiao, L. Sigal and Y. J. Lee, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
Paper: [pdf]

Story Albums: Creating Fictional Stories from Personal Photograph Sets, O. Radiano, Y. Graber, M. Mahler, L. Sigal and A. Shamir, Computer Graphics Forum, Volume 36, 2017. (accepted)
Paper: [pdf]

Learn How to Choose: Independent Detectors versus Composite Visual Phrases, G. Rozenthal, A. Shamir and L. Sigal, Winter Conference on Applications of Computer Vision (WACV), 2017.
Paper: [pdf]



2016

Real-time Physics-based Motion Capture with Sparse Sensors, S. Andrews, I. Huerta, T. Komura, L. Sigal and K. Mitchell, European Conference on Visual Media Production (CVMP), 2016.
Paper: [pdf]
Video: [mp4]

Heterogeneous Knowledge Transfer in Video Emotion Recognition, Attribution and Summarization, B. Xu, Y. Fu, Y.-G. Jiang, B. Li and L. Sigal, IEEE Transactions on Affective Computing (TAC), 2016.
Paper: [pdf]

Learning Language-Visual Embedding for Movie Understanding with Natural-Language, A. Torabi, N. Tandon and L. Sigal, arXiv:1609.081241, 2016.
Paper: [pdf]

Semi-supervised Vocabulary-informed Learning, Y. Fu and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Paper: [pdf]

Learning Activity Progression in LSTMs for Activity Detection and Early Detection, S. Ma, L. Sigal and S. Sclaroff, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Paper: [pdf]

Harnessing Object and Scene Semantics for Large-Scale Video Understanding, Z. Wu, Y. Fu, Y.-G. Jiang and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
Paper: [pdf]

Video Emotion Recognition with Transferred Deep Feature Encodings, B. Xu, Y. Fu, Y.-G. Jiang, B. Li and L. Sigal, ACM International Conference in Multimedia Retrieval (ICMR), 2016.
Paper: [pdf]

Knowledge Transfer with Interactive Learning of Semantics Relationships, J. Choi, S. Hwang, L. Sigal and L. Davis, AAAI Conference on Artificial Intelligence (AAAI), 2016.
Paper: [pdf]

Exploiting View-Specific Appearance Similarities Across Classes for Zero-shot Pose Prediction: A Metric Learning Approach, A. Kuznetsova, S. Hwang, B. Rosenhahn and L. Sigal, AAAI Conference on Artificial Intelligence (AAAI), 2016.
Paper: [pdf]

Learning to Generate Posters of Scientific Papers, Y. Qiang, Y. Fu, Y. Guo, Z.-H. Zhou and L. Sigal, AAAI Conference on Artificial Intelligence (AAAI), 2016.
Paper: [pdf]



2015

Storyline Representation of Egocentric Videos with an Application to Story-based Search, B. Xiong, G. Kim and L. Sigal, IEEE International Conference on Computer Vision (ICCV), 2015.
Paper: [pdf]
Video: [mp4]

Learning from Synthetic Data Using a Stacked Multichannel Autoencoder, X. Zhang, Y. Fu, S. Jiang, L. Sigal and G. Agam, IEEE International Conference on Machine Learning and Applications (ICMLA), 2015.
Paper: [pdf]

Cross-Domain Matching with Squared-Loss Mutual Information, M. Yamada, L. Sigal, M. Raptis, M. Toyoda, Y. Chang and M. Sugiyama, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2015.
Paper: [pdf]

A Perceptual Control Space for Garment Simulation, L. Sigal, M. Mahler, S. Diaz, K. McIntosh, E. Carter, T. Richards and J. Hodgins, ACM Transactions on Graphics (Proc. SIGGRAPH), 2015.
Project: web page
Paper: [pdf]
Videos: [supplementary video (YouTube)]

Discovering Collective Narratives of Theme Parks from Large Collections of Visitors Photo Streams , G. Kim and L. Sigal, KDD 2015 (Practice).
Paper: [pdf]

Hierarchical Maximum-Margin Clustering, G.-T. Zhou, S. Hwang, M. Schmidt, L. Sigal and G. Mori, arXiv:1502.01827, 2015.
Paper: [pdf]

Joint Photo Stream and Blog Post Summarization and Exploration, G. Kim, S. Moon, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]

Ranking and Retrival of Image Sequences from Multiple Paragraph Queries, G. Kim, S. Moon, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]

Space-Time Tree Ensemble for Action Recognition S. Ma, L. Sigal, S. Sclaroff, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Paper: [pdf]

Expanding Object Detector's Horizon: Incremental Learning Framework for Object Detection in Videos, A. Kuznetsova, S.-J. Hwang, B. Rosenhahn, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.
Extended abstract: [pdf]
Paper: [pdf]
Supplemental: [pdf]
Video: [pdf]

Learning to Select and Order Vacation Photographs, F. Sadeghi, J. R. Tena, A. Farhadi, L. Sigal, IEEE Winter Conference on Applications of Computer Vision (WACV), 2015.
Download: [pdf]
Supplemental: [pdf]


      Best Paper Award

Family Member Identification from Photo Collections, Q. Dai, P. Carr, L. Sigal, D. Hoiem, IEEE Winter Conference on Applications of Computer Vision (WACV), 2015.
Download: [pdf]
Supplemental: [pdf]



2014

A Unified Semantic Embedding: Relating Taxonomies and Attributes, S.-J. Hwang, L. Sigal, Neural Information Processing Systems (NIPS), 2014.
Download: [pdf]

Parameterizing Object Detectors in the Continuous Pose Space, K. He, L. Sigal, S. Sclaroff, European Conference on Computer Vision (ECCV), 2014.
Download: [pdf]

Nonparametric Clustering with Distance Dependent Hierarchies, S. Ghosh, M. Raptis, L. Sigal, E. Sudderth, Conference on Uncertainty in Artificial Intelligence (UAI), 2014.
Download: [pdf]
Supplemental: [pdf]
Spotlight: [pdf]

Joint Summarization of Large-scale Collections of Web Images and Videos for Storyline Reconstruction, G. Kim, L. Sigal, E. P. Xing, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
Download: [pdf]
Videos: [1 Minute Spotlight Video (QuickTime)]

Domain Adaptation for Structured Regression, M. Yamada, Y. Chang and L. Sigal, International Journal of Computer Vision (IJCV), Special Issue on Domain Adaptation for Vision Applications, 2014. (to appear)
Download: [pdf]

High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso, M. Yamada, W. Jitkrittum, L. Sigal, E. P. Xing and M. Sugiyama, Neural Computation (NC), 26(1):185-207, 2014.
Publisher Web: [link]
Download: [pdf]



2013

Covariate Shift Adaptation for Discriminative 3D Pose Estimation, M. Yamada, L. Sigal and M. Raptis, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2013. (to appear)
Publisher Web: [link]
Download: [pdf]

Action is in the Eye of the Beholder: Eye-gaze Driven Model for Spatio-Temporal Action Localization, N. Shapovalova, M. Raptis, L. Sigal, G. Mori, Neural Information Processing Systems (NIPS), 2013.
Download: [pdf]
Videos: [Supplementary Video [low res] (QuickTime, 3mb)]

From Subcategories to Visual Composites: A Multi-Level Framework for Object Detection, T. Lan, M. Raptis, L. Sigal, G. Mori, IEEE International Conference on Computer Vision (ICCV), 2013.
Download: [pdf]

Poselet Key-framing: A Model for Human Activity Recognition, M. Raptis, L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013.
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 30mb)]

Dynamical Simulation Priors for Human Motion Tracking, M. Vondrak, L. Sigal and O. C. Jenkins, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 35(1):52-65, 2013.
Project: web page
Download: [pdf]
Videos: [supplementary video (YouTube)]
Code: [download]

Canonical Locality Preserving Latent Variable Model for Discriminative Pose Inference, Y. Tian, L. Sigal, F. De la Torre and Y. Jia, Image and Vision Computing (IVC), 31(3):223-230, 2013.
Download: [web link]



2012

Destination Flow for Crowd Simulation, S. Pellegrini, J. Gall, L. Sigal, L. van Gool, Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (ARTEMIS'12), 2012.
Download: [pdf]

No Bias Left Behind: Covariate Shift Adaptation for Discriminative 3D Pose Estimation, M. Yamada, L. Sigal, M. Raptis, European Conference on Computer Vision (ECCV), 2012.
Download: [pdf, supplimental]

Multi-linear Data-Driven Dynamic Hair Model with Efficient Hair-Body Collision Handling, P. Guan, L. Sigal, V. Reznitskaya, J. K. Hodgins, ACM/Eurographics Symposium on Computer Animation (SCA), 2012.
Project: soon
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 140mb)]

Video-based 3D Motion Capture through Biped Control, M. Vondrak, L. Sigal, J. K. Hodgins and Odest Jenkins, ACM Transactions on Graphics (Proc. SIGGRAPH), 2012.
Project: web page
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 81mb)]


      Best Paper Award

Human Context: Modeling human-human interactions for monocular 3D pose estimation, M. Andriluka and L. Sigal, VII Conference on Articulated Motion and Deformable Objects (AMDO), 2012.
Download: [pdf]

Social Roles in Hierarchical Models for Human Activity Recognition, T. Lan, L. Sigal and G. Mori, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
Download: [pdf]

Human attributes from 3D pose tracking, M. Livne, L. Sigal, N. Troje and D. Fleet, Computer Vision and Image Understanding (CVIU), 116:648-660, 2012.
Download: [pdf]

Shared kernel information embedding for discriminative inference, R. Memisevic, L. Sigal and D. Fleet, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 34(4):778-790, 2012.
Download: [pdf]

Loose-limbed People: Estimating Human Pose and Motion using Non-parametric Belief Propagation, L. Sigal, M. Isard, H. Haussecker and M. J. Black, International Journal of Computer Vision (IJCV), 98(1):15-48, 2012.
Download: [web link]

Recognizing Character-directed Utterances in Multi-child Interactions, H. Hajishirzi, J. Lehman, K. Kumatani, L. Sigal, and J. Hodgins, late-breaking report section of Human Robot Interaction (HRI), 2012.



2011

Facial Expression Transfer with Input-Output Temporal Restricted Boltzmann Machines, M. Zeiler, G. Taylor, L. Sigal, I. Matthews and R. Fergus, Neural Information Processing Systems (NIPS), 2011.
Download: [pdf]
Videos: [web page]

Visual Analysis of Humans: Looking at People, T. Moeslund, A. Hilton, V. Krüger and L. Sigal (Eds). ISBN: ISBN 978-0-85729-996-3. To be published by Springer Verlag in October 2011.

Benchmark Datasets for Pose Estimation and Tracking, M. Andriluka, L. Sigal and M. J. Black, Visual Analysis of Humans: Looking at People, T. Moeslund, A. Hilton, V. Krüger and L. Sigal (Eds). ISBN: ISBN 978-0-85729-996-3. To be published by Springer Verlag in October 2011.
Download: [web link]

Human Pose Estimation, L. Sigal, Encyclopedia of Computer Vision, Springer, 2011. (accepted)
Download: [draft pdf]

Motion Capture from Body-Mounted Cameras, T. Shiratori, H. S. Park, L. Sigal, Y. Sheikh and J. K. Hodgins, ACM Transactions on Graphics (Proc. SIGGRAPH), July 2011. (to appear)
Project: web page
Download: [pdf]
Videos: [Supplementary Video (QuickTime, 85mb)]

Inferring 3D Body Pose Using Variational Semi-parametric Regression, Y. Tian, Y. Jia, Y. Shi, Y. Liu, J. Hao and L. Sigal, IEEE International Conference on Image Processing (ICIP), 2011.
Download: [pdf]



2010

Latent Gaussian Mixture Regression for Human Pose Estimation, Y. Tian, L. Sigal, H. Badino, F. De la Torre and Y. Liu, Asian Conference on Computer Vision (ACCV), 2010.
Download: [postscript], [pdf]

Human Attributes from 3D Pose Tracking, L. Sigal, D. Fleet, N. Troje, M. Livne, European Conference on Computer Vision, ECCV 2010.
Download: [postscript], [pdf]
Videos: [Supplementary Video (12mb)].

Stable Spaces for Real-time Clothing, E. de Aguiar, L. Sigal, A. Treuille and J. K. Hodgins, ACM Trans. Graphics (Proc. SIGGRAPH), July 2010.
Project: web page
Download: [pdf]
Videos: [Supplementary Video (64mb)]

Dynamical Binary Latent Variable Models for 3D Human Pose Tracking, G. Taylor, L. Sigal, D. Fleet, G. Hinton, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010.
Download: [postscript], [pdf]
Suplimental Materials: Learning and Additional Experiments
Videos: [Supplementary Video - Multiview (13mb)], [Supplementary Video - Monocular (16mb)].

HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human Motion, L. Sigal, A. Balan and M. J. Black, International Journal of Computer Vision (IJCV), Special Issue on Evaluation of Articulated Human Motion and Pose Estimation, 2010.
Download: [postscript], [pdf]



2009

Estimating Contact Dynamics, M. Brubaker, L. Sigal, D. Fleet, IEEE International Conference on Computer Vision, ICCV 2009.
Download: [postscript], [pdf]
Videos: [Supplementary Video - Video Tracking (6mb)], [Supplementary Video - MoCap (4mb)].

Dynamics and Control of Multibody Systems, M. Vondrak, L. Sigal and O. C. Jenkins, Motion Control, A. Lazinica (Eds), ISBN978-953-7619-X-X, 2009. To be published by IN-TECH, Vienna in September 2009. (accepted)
Download: [postscript], [pdf]

Shared Kernel Information Embedding for Discriminative Inference, L. Sigal, R. Memisevic, D. Fleet, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009.
Download: [postscript], [pdf]

Video-Based People Tracking, M. Brubaker, L. Sigal and D. Fleet, Handbook on Ambient Intelligence and Smart Environments, H. Nakashima, H. Aghajan, and J.C. Augusto (Eds), Springer Verlag, 2009.
Download: [postscript], [pdf]



2008

Physical Simulation for Probabilistic Motion Tracking, M. Vondrak, L. Sigal and O. C. Jenkins, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008.
Download: [postscript], [pdf]
Videos: [Supplementary Video - DIVX (30mb)], [Supplementary Video - WMV (30mb)].
Talk: [pdf].
Talk Videos:
    Standard Controller [wmv, divx],
    Proposed Controller [wmv, divx],
    Multiview Walking [wmv, divx],
    Multiview Walking (vs. PF + smooth prior) [wmv, divx],
    Multiview Walking (vs. APF + smooth prior) [wmv, divx],
    Monocular Walking [wmv, divx],
    Monocular Walking (vs. PF + smooth prior) [wmv, divx],
    Multiview Jog [wmv, divx].

Continuous-state Graphical Models for Object Localization, Pose Estimation and Tracking, L. Sigal, PhD Thesis, May 2008.
Committee: Michael J. Black, William Freeman, John Hughes, David Mumford.
Download: [pdf]



2007

Combined discriminative and generative articulated pose and non-rigid shape estimation, L. Sigal, A. Balan and M. J. Black, Neural Information Processing Systems Conference, NIPS 2007.
Download: [postscript], [pdf]

Shining a Light on Human Pose: On Shadows, Shading and the Estimation of Pose and Shape, A. Balan, M. J. Black, H. Haussecker and L. Sigal, IEEE Conference on Computer Vision and Pattern Recognition, ICCV 2007.
Download: [postscript], [pdf]

Detailed Human Shape and Pose from Images, A. Balan, L. Sigal, M. J. Black, J. Davis and H. Haussecker, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007.
Download: [postscript], [pdf]



2006


    Best Paper Award

Predicting 3D People from 2D Pictures, L. Sigal and M. J. Black, IV Conference on Articulated Motion and Deformable Objects, AMDO 2006.
Download: [postscript], [pdf], [talk]
Videos: [2D to 3D Pose Inference (16mb)], [3D Tracking (75mb)].

Measure Locally, Reason Globally: Occlusion-sensitive Articulated Pose Estimation, L. Sigal and M. J. Black, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2006.
Download: [postscript], [pdf]

Hierarchical Approach for Articulated 3D Pose-Estimation and Tracking (extended abstract), L. Sigal and M. J. Black, Learning, Representation and Context for Human Sensing in Video Workshop (in conjunction with CVPR), 2006.
Download: [postscript], [pdf], [poster].

HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion, L. Sigal and M. J. Black, Techniacl Report CS-06-08, Brown University, 2006.
Download: [pdf].



2005

A Quantitative Evaluation of Video-based 3D Person Tracking, A. Balan, L. Sigal and M. J. Black, IEEE Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, VS-PETS 2005.
Download: [postscript], [pdf].



2004

Skin Color-Based Video Segmentation under Time-Varying Illumination, L. Sigal, S. Sclaroff and V. Athitsos, IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(7), pp. 862-877, July 2004.
Download: [postscript], [pdf].

Tracking Loose-limbed People, L. Sigal, S. Bhatia, S. Roth, M. J. Black and M. Isard, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2004.
Download: [postscript], [pdf].

Gibbs Likelihoods for Bayesian Tracking, S. Roth, L. Sigal and M. J. Black, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2004.
Download: [postscript], [pdf].

Tracking Complex Objects using Graphical Object Models, L. Sigal, Y. Zhu, D. Comaniciu and M. J. Black, 1st International Workshop on Complex Motion, Springer-Verlag LNCS 3417, pp. 227-238, 2004.
Download: [postscript], [pdf].
(also see related talk given at NIPS 2004 Workshop on Graphical Models and Kernels)

3D Human Limb Detection using Space Carving and Multi-view Eigen Models, S. Bhatia, L. Sigal, M. Isard and M. J. Black, IEEE Workshop on Articulated and Nonrigid Motion, 2004.
Download: [postscript], [pdf].



2003

Attractive people: Assembling loose-limbed models using non-parametric belief propagation, L. Sigal, M. Isard, B. H. Sigelman and M. J. Black, Advances in Neural Information Processing Systems 16, NIPS 2003.
Download: [postscript], [pdf].



2002

Implicit probabilistic models of human motion for synthesis and tracking, H. Sidenbladh, M. J. Black and L. Sigal, European Conference on Computer Vision, ECCV 2002, Springer-Verlag LNCS 2353, Vol. 1, pp. 784-800.
Download: [postscript], [pdf].



2001

3D Hand Pose Reconstruction Using Specialized Mappings, R. Rosales, V. Athitsos, L. Sigal and S. Sclaroff, International Conference on Computer Vision, ICCV 2001.
Download: [postscript], [pdf].



2000

Estimation and Prediction of Evolving Color Distributions for Skin Segmentation Under Varying Illumination, L. Sigal, S. Sclaroff and V. Athitsos, IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2000.
Download: [postscript], [pdf].