Article

Free access

Synthesizing realistic facial expressions from photographs

Authors:

David H. SalesinAuthors Info & Claims

SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques

Pages 75 - 84

https://doi.org/10.1145/280814.280825

Published: 24 July 1998 Publication History

PDF eReader

References

[1]

Takaaki Akimoto, Yasuhito Suenaga, and Richard S. Wallace. Automatic Creation of 3D Facial Models. IEEE Computer Graphics and Applications, 13(5): 16-22, September 1993.

Digital Library

Google Scholar

[2]

Alias I Wavefront, Toronto, Ontario. Alias V7.0, 1995.

Google Scholar

[3]

Thaddeus Beier and Shawn Neely. Feature-based Image Metamorphosis. In SIGGRAPH 92 Conference Proceedings, pages 35-42. ACM SIGGRAPH, July 1992.

Digital Library

Google Scholar

[4]

Philippe Bergeron and Pierre Lachapelle. Controlling Facial Expressions and Body Movements in the Computer-Generated Animated Short "Tony De Peltrie". In SIGGRAPH 85 Advanced Computer Animation seminar notes. July 1985.

Google Scholar

[5]

Christoph Bregler, Michele Covell, and Malcolm Slaney. Video Rewrite: Driving Visual Speech with Audio. In SIGGRAPH 97 Conference Proceedings, pages 353-360. ACM SIGGRAPH, August 1997.

Digital Library

Google Scholar

[6]

David T. Chen, Andrei State, and David Banks. Interactive Shape Metamorphosis. In 1995 Symposium on Interactive 3D Graphics, pages 43-44. ACM SIGGRAPH, April 1995.

Digital Library

Google Scholar

[7]

Chang S. Choi, Kiyoharu, Hiroshi Harashima, and Tsuyoshi Takebe. Analysis and Synthesis of Facial Image Sequences in Model-Based Image Coding. In IEEE Transactions on Circuits and Systems for Video Technology, volume 4, pages 257 - 275. June 1994.

Digital Library

Google Scholar

[8]

Cyberware Laboratory, Inc, Monterey, California. 4020/RGB 3D Scanner with Color Digitizer, 1990.

Google Scholar

[9]

Paul E. Debevec, Camillo J. Taylor, and Jitendra Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In SIGGRAPH 96 Conference Proceedings, pages 11-20. ACM SIGGRAPH, August 1996.

Digital Library

Google Scholar

[10]

Eben Ostby, Pixar Animation Studios. Personal communication, January 1997.

Google Scholar

[11]

Paul Ekman and Wallace V. Friesen. Unmasking the Face. A guide to recognizing emotions fron facial clues. Prentice-Hall, Inc., Englewood Cliffs, New Jersey, 1975.

Google Scholar

[12]

Paul Ekman and Wallace V. Friesen. Manual for the Facial Action Coding System. Consulting Psychologists Press, Inc., Palo Alto, California, 1978.

Google Scholar

[13]

Irfan Essa, Sumit Basu, Trevor Darrell, and Alex Pentland. Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video. In Computer Animation Conference, pages 68-79. June 1996.

Digital Library

Google Scholar

[14]

Gary Faigin. The Artist's Complete Guide to Facial Expression. Watson-Guptill Publications, New York, 1990.

Google Scholar

[15]

Olivier Faugeras. Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, Cambridge, Massachusetts, 1993.

Digital Library

Google Scholar

[16]

G. Golub and C. F. Van Loan. Matrix Computation, third edition. The John Hopkins University Press, Baltimore and London, 1996.

Digital Library

Google Scholar

[17]

Brian Guenter, Cindy Grimm, Daniel Wood, Henrique Malvar, and Fr6d6ric Pighin. Making Faces. In SIGGRAPH 98 Conference Proceedings. ACM SIGGRAPH, July 1998.

Digital Library

Google Scholar

[18]

Pat Hanrahan and Wolfgang Krueger. Reflection from Layered Surfaces Due to Subsurface Scattering. In SIGGRAPH 93 Conference Proceedings, volume 27, pages 165-174. ACM SIGGRAPH, August 1993.

Digital Library

Google Scholar

[19]

Bright Star Technologies Inc. Beginning Reading Software. Sierra On- Line, Inc., 1993.

Google Scholar

[20]

Horace H. S. Ip and Lijun Yin. Constructing a 3D Individualized Head Model from Two Orthogonal Views. The Visual Computer, 12:254- 266, 1996.

Crossref

Google Scholar

[21]

Gregory Ward J., Francis M. Rubinstein, and Robert D. Clear. A Ray Tracing Solution for Diffuse Interreflection. In SIGGRAPH 88 Conference Proceedings, volume 22, pages 85-92. August 1988.

Digital Library

Google Scholar

[22]

James R. Kent, Wayne E. Carlson, and Richard E. Parent. Shape Transformation for Polyhedral Objects. In SIGGRAPH 92 Proceedings Conference, volume 26, pages 47-54. ACM SIGGRAPH, July 1992.

Digital Library

Google Scholar

[23]

Rolf M. Koch, Markus H. Gross, Friedrich R. Carls, Daniel F. von Bfiren, George Fankhauser, and Yoav I. H. Parish. Simulating Facial Surgery Using Finite Element Methods. In SIGGRAPH 96 Conference Proceedings, pages 421-428. ACM SIGGRAPH, August 1996.

Digital Library

Google Scholar

[24]

Tsuneya Kurihara and Kiyoshi Arai. A Transformation Method for Modeling and Animation of the Human Face from Photographs. In Nadia Magnenat Thalmann and Daniel Thalmann, editors, Computer Animation 91, pages 45-58. Springer-Verlag, Tokyo, 1991.

Crossref

Google Scholar

[25]

A. Lanitis, C. J. Taylor, and T. F. Cootes. A Unified Approach for Coding and Interpreting Face Images. In Fifth International Conference on Computer Vision (ICCV 95), pages 368-373. Cambridge, Massachusetts, June 1995.

Digital Library

Google Scholar

[26]

C. L. Lawson and R. J. Hansen. Solving Least Squares Problems. Prentice-Hall, Englewood Cliffs, 1974.

Google Scholar

[27]

Seung-Yong Lee, Kyung-Yong Chwa, Sung Yong Shin, and George Wolberg. Image Metamorphosis Using Snakes and Free-Form Deformations. In SIGGRAPH 95 Conference Proceedings, pages 439-448. ACM SIGGRAPH, August 1995.

Digital Library

Google Scholar

[28]

Seung-Yong Lee, George Wolberg, Kyung-Yong Chwa, and Sung Yong Shin. Image Metamorphosis with Scattered Feature Constraints. IEEE Transactions on Visualization and Computer Graphics, 2(4), December 1996.

Digital Library

Google Scholar

[29]

Yuencheng Lee, Demetri Terzopoulos, and Keith Waters. Realistic Modeling for Facial Animation. In SIGGRAPH 95 Conference Proceedings, pages 55-62. ACM SIGGRAPH, August 1995.

Digital Library

Google Scholar

[30]

Yuencheng C. Lee, Demetri Terzopoulos, and Keith Waters. Constructing Physics-Based Facial Models of Individuals. In Proceedings of Graphics Interface 93, pages 1-8. May 1993.

Google Scholar

[31]

Francis H. Moffitt and Edward M. Mikhail. Photogrammetry. Harper & Row, New York, 3 edition, 1980.

Google Scholar

[32]

Shree K. Nayar, Katsushi Ikeuchi, and Takeo Kanade. Shape from Interreflections. International Journal of Computer Vision, 6:173-195, 1991.

Digital Library

Google Scholar

[33]

Gregory M. Nielson. Scattered Data Modeling. IEEE Computer Graphics and Applications, 13(1):60-70, January 1993.

Digital Library

Google Scholar

[34]

Frederic I. Parke. Computer Generated Animation of Faces. Proceedings ACM annual conference., August 1972.

Digital Library

Google Scholar

[35]

Frederic I. Parke. A Parametric Model for Human Faces. PhD thesis, University of Utah, Salt Lake City, Utah, December 1974. UTEC-CSc- 75 -047.

Digital Library

Google Scholar

[36]

Frederic I. Parke and Keith Waters. Computer Facial Animation. A K Peters, Wellesley, Massachusetts, 1996.

Digital Library

Google Scholar

[37]

W.H. Press, B. R Flannery, S. A. Teukolsky, and W. T. Vetterling. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, Cambridge, England, second edition, 1992.

Digital Library

Google Scholar

[38]

Karl Pulli, Michael Cohen, Tom Duchamp, Hugues Hoppe, Linda Shapiro, and Werner Stuetzle. View-based rendering: Visualizing real objects from scanned range and color data. In Proc. 8th Eurographics Workshop on Rendering. June 1997.

Digital Library

Google Scholar

[39]

Steven M. Seitz and Charles R. Dyer. View Morphing. In SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 21-30. ACM SIGGRAPH, August 1996.

Digital Library

Google Scholar

[40]

Chester C. Slama, editor. Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, Virginia, fourth edition, 1980.

Google Scholar

[41]

Richard Szeliski and Sing Bing Kang. Recovering 3D Shape and Motion from Image Streams using Nonlinear Least Squares. Journal of Visual Communication and Image Representation, 5(1): 10-28, March 1994.

Google Scholar

[42]

Richard Szeliski and Heung-Yeung Shum. Creating Full View Panoramic Image Mosaics and Texture-Mapped Models. In SIG- GRAPH 97 Conference Proceedings, pages 251-258. ACM SIG- GRAPH, August 1997.

Digital Library

Google Scholar

[43]

Demetri Terzopoulos and Keith Waters. Physically-based Facial Modeling, Analysis, and Animation. Journal of Visualization and Computer Animation, 1 (4):73-80, March 1990.

Crossref

Google Scholar

[44]

Kristinn R. Th6risson. Gandalf: An Embodied Humanoid Capable of Real-Time Multimodal Dialogue with People. In First ACM International Conference on Autonomous Agents. 1997.

Digital Library

Google Scholar

[45]

Michael W. Vannier, Jeffrey F. Marsh, and James O. Warren. Threedimentional Computer Graphics for Craniofacial Surgical Planning and Evaluation. In SIGGRAPH 83 Conference Proceedings, volume 17, pages 263-273. ACM SIGGRAPH, August 1983.

Digital Library

Google Scholar

[46]

Keith Waters. A Muscle Model for Animating Three-Dimensional Facial Expression. In SIGGRAPH 87 Conference Proceedings), volume 21, pages 17-24. ACM SIGGRAPH, July 1987.

Digital Library

Google Scholar

[47]

Lance Williams. Performance-Driven Facial Animation. In SIG- GRAPH 90 Conference Proceedings, volume 24, pages 235-242. August 1990.

Digital Library

Google Scholar

[48]

Z. Zhang, K. Isono, and S. Akamatsu. Euclidean Structure from Uncalibrated Images Using Fuzzy Domain Knowledge: Application to Facial Images Synthesis. In Proc. International Conference on Computer Vision (ICCV'98). January 1998.

Digital Library

Google Scholar

Cited By

View all

Day SXiao ZChaudhry EHooker MZhu XChang JIglesias AYou LZhang J(2024)Improving Realism of Facial Interpolation and Blendshapes with Analytical Partial Differential Equation-Represented PhysicsAxioms10.3390/axioms1303018513:3(185)Online publication date: 12-Mar-2024
https://doi.org/10.3390/axioms13030185
Xu HYu XCheng YXiao MYu Y(2024)Low-Rank Active Learning for Generating Speech-Drive Human Face AnimationIEEE Access10.1109/ACCESS.2024.337477712(38758-38764)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3374777
Yunshu DJianwei FZhihua XJianan LJian W(2023)Local similarity anomaly for general face forgery detectionJournal of Image and Graphics10.11834/jig.22100628:11(3453-3470)Online publication date: 2023
https://doi.org/10.11834/jig.221006
Show More Cited By

Index Terms

Synthesizing realistic facial expressions from photographs
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Reconstruction
  2. Computer graphics
    1. Animation
    2. Image manipulation
      1. Texturing

Recommendations

A morphable model for the synthesis of 3D faces
SIGGRAPH '99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques

In this paper, a new technique for modeling textured 3D faces is introduced. 3D faces can either be generated automatically from one or more photographs, or modeled directly through an intuitive user interface. Users are assisted in two key problems of ...
Synthesizing realistic facial expressions from photographs
SIGGRAPH '06: ACM SIGGRAPH 2006 Courses

We present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creating smooth transitions between different facial expressions by morphing between these different models. Starting from ...
Synthesizing realistic facial expressions from photographs
SIGGRAPH '05: ACM SIGGRAPH 2005 Courses

We present new techniques for creating photorealistic textured 3D facial models from photographs of a human subject, and for creating smooth transitions between different facial expressions by morphing between these different models. Starting from ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '98: Proceedings of the 25th annual conference on Computer graphics and interactive techniques

July 1998

472 pages

ISBN:0897919998

DOI:10.1145/280814

Chairmen:
Steve Cunningham
California State Univ. Stanislaus, Trulock, CA
,
Walt Bransford
Thrillistic
,
Michael F. Cohen,
General Chairs:
Srinivas Aluru
Georgia Institute of Technology
,
May Dongmei Wang
Georgia Institute of Technology and Emory University
,
Program Chairs:
Christopher C. Yang
Drexel University
,
T. M Murali
Virginia Tech

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 July 1998

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGGRAPH98

Sponsor:

SIGGRAPH

SIGGRAPH98: The 25th International Conference on Computer Graphics and Interactive Techniques

Acceptance Rates

SIGGRAPH '98 Paper Acceptance Rate 45 of 303 submissions, 15%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

460
Total Citations
View Citations
2,328
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)25

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Day SXiao ZChaudhry EHooker MZhu XChang JIglesias AYou LZhang J(2024)Improving Realism of Facial Interpolation and Blendshapes with Analytical Partial Differential Equation-Represented PhysicsAxioms10.3390/axioms1303018513:3(185)Online publication date: 12-Mar-2024
Xu HYu XCheng YXiao MYu Y(2024)Low-Rank Active Learning for Generating Speech-Drive Human Face AnimationIEEE Access10.1109/ACCESS.2024.337477712(38758-38764)Online publication date: 2024
Yunshu DJianwei FZhihua XJianan LJian W(2023)Local similarity anomaly for general face forgery detectionJournal of Image and Graphics10.11834/jig.22100628:11(3453-3470)Online publication date: 2023
Blanz VVetter T(2023)A Morphable Model For The Synthesis Of 3D FacesSeminal Graphics Papers: Pushing the Boundaries, Volume 210.1145/3596711.3596730(157-164)Online publication date: 1-Aug-2023
Vilchis CPerez-Guerrero CMendez-Ruiz MGonzalez-Mendoza M(2023)A survey on the pipeline evolution of facial capture and tracking for digital humansMultimedia Systems10.1007/s00530-023-01081-229:4(1917-1940)Online publication date: 1-Apr-2023
Zhao XZhao ZSchwing A(2023)Initialization and Alignment for Adversarial Texture OptimizationComputer Vision – ECCV 2022 Workshops10.1007/978-3-031-25066-8_34(587-604)Online publication date: 18-Feb-2023
(2023)Seminal Graphics Papers: Pushing the Boundaries, Volume 2undefinedOnline publication date: 1-Aug-2023
Zheng CXu F(2022)DTexFusion: Dynamic Texture Fusion Using a Consumer RGBD SensorIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.306484628:10(3365-3375)Online publication date: 1-Oct-2022
Zhao XZhao ZSchwing A(2022)Initialization and Alignment for Adversarial Texture OptimizationComputer Vision – ECCV 202210.1007/978-3-031-19812-0_37(641-658)Online publication date: 23-Oct-2022
You YSong LYang Y(2021)High-Quality Facial Expression Animation Synthesis System Based on Virtual RealityVR/AR and 3D Displays10.1007/978-981-33-6549-0_3(21-32)Online publication date: 3-Feb-2021
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A morphable model for the synthesis of 3D faces