research-article

Adaptive clustering and interactive visualizations to support the selection of video clips

Authors:

Andreas Girgensohn,

Lynn WilcoxAuthors Info & Claims

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

Article No.: 34, Pages 1 - 8

https://doi.org/10.1145/1991996.1992030

Published: 18 April 2011 Publication History

Abstract

Although people are capturing more video with their mobile phones, digital cameras, and other devices, they rarely watch all that video. More commonly, users extract a still image from the video to print or a short clip to share with others. We created a novel interface for browsing through a video keyframe hierarchy to find frames or clips. The interface is shown to be more efficient than scrolling linearly through all keyframes. We developed algorithms for selecting quality keyframes and for clustering keyframes hierarchically. At each level of the hierarchy, a single representative keyframe from each cluster is shown. Users can drill down into the most promising cluster and view representative keyframes for the sub-clusters. Our clustering algorithms optimize for short navigation paths to the desired keyframe. A single keyframe is located using a non-temporal clustering algorithm. A video clip is located using one of two temporal clustering algorithms. We evaluated the clustering algorithms using a simulated search task. User feedback provided us with valuable suggestions for improvements to our system.

References

[1]

C.-H. An, K. Berry, and A. Cosby. Fractal image compression by improved balanced tree clustering Proc. of SPIE, Vol. 3164, Applications of Digital Image Processing XX, 555--564, 1997.

[2]

G. Ciocca and R. Schettini. Hierarchical Browsing of Video Key Frames. Lecture Notes in Computer Science, Vol. 4425, Advances in Information Retrieval, 691--694, 2007.

Digital Library

[3]

M. Cooper and J. Foote. Scene Boundary Detection Via Video Self-Similarity Analysis. Proc. of Int. Conf. on Image Processing, 378--381, 2001.

[4]

S. Geva. K-tree: a height balanced tree structured vector quantizer. Proc. of 2000 IEEE Signal Processing Society Workshop. Vol. 1, 271--280, 2000.

[5]

A. Girgensohn, S. Bly, F. Shipman, J. Boreczky, and L. Wilcox. Home Video Editing Made Easy --- Balancing Automation and User Control. Proc. of INTERACT '01, IOS Press, 464--471, 2001.

[6]

M. Guillemot and P. Wellner. A Hierarchical Keyframe User Interface for Browsing Video over the Internet. Proc. of INTERACT '03, 769--776, 2003.

[7]

W. Hürst, G. Götz, and P. Jarvers. Advanced User Interfaces for Dynamic Video Browsing, Proc. of ACM Multimedia, 742--743, 2004.

Digital Library

[8]

J. Jiang and X.-P. Zhang. A New Hierarchical Key Frame Tree-Based Video Representation Method Using Independent Component Analysis. Advanced Intelligent Computing Theories and Applications. With Aspects of Artificial Intelligence. Lecture Notes in Computer Science, Vol. 6216/2010, 132--139, 2010.

Digital Library

[9]

J. Luo, C. Papin, and K. Costello. Towards Extracting Semantically Meaningful Key Frames From Personal Video Clips: From Humans to Computers. IEEE Transactions on Circuits and Systems for Video Technology, 19(2), 289--301, 2009.

Digital Library

[10]

C.-W. Ngo, T.-C. Pong, and H.-J. Zhang. On Clustering and Retrieval of Video Shots. Proc. of ACM Multimedia, 51--60, 2001.

Digital Library

[11]

J. H. Oh and K. A. Hua. Efficient and Cost-effective Techniques for Browsing and Indexing Large Video Databases. Proc. of ACM Conf. on Management of Data, 415--426, 2000.

Digital Library

[12]

Y. Rui, T. Huang, and S. Mehratra. Constructing Table-of-Contents for Videos. ACM Multimedia Systems, 7(5):359--368, 1999.

Digital Library

[13]

K. Schoeffmann, M. Taschwer, and L. Boeszoermenyi. The Video Explorer --- A Tool for Navigation and Searching within a Single Video based on Fast Content Analysis. Proc. of ACM Conf. on Multimedia Systems, 247--258, 2010.

Digital Library

[14]

F. Shipman, A. Girgensohn, and L. Wilcox. Hypervideo Expression: Experiences with Hyper-Hitchcock. Proc. of ACM Conf. on Hypertext and Hypermedia, 217--226, 2005.

Digital Library

[15]

K. Wittenburg, C. Forlines, T. Lanning, A. Esenther, S. Harada, and T. Miyachi. Rapid Serial Visual Presentation Techniques for Consumer Digital Video Devices. Proc. of ACM UIST, 115--124, 2003.

Digital Library

[16]

J. Xiao, X. Zhang, P. Cheatle, Y. Gao, C. B. Atkins. Mixed-Initiative Photo Collage Authoring. Proc. of ACM Multimedia, 509--518, 2008.

Digital Library

[17]

T. Zhang, R. Ramakrishnan, and M. Livny. BIRCH: An Efficient Data Clustering Method for Very Large Databases. Proc. of ACM Conf. on Management of Data, 103--114. 1996.

Digital Library

[18]

D. Zhong, H. Zhang and S.-F. Chang. Clustering Methods for Video Browsing and Annotation. Proc of SPIE Conf. on Storage and Retrieval for Image and Video Databases, 1997.

Cited By

Sadprasid BGutwin CBateman S(2024)Improving Video Navigation for Spatial Task Tutorials by Spatially Segmenting and Situating How-To VideosProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682103(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682103
Murakami TFujita KHara KTakashima KKitamura Y(2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642515
Wildemuth BMarchionini GFu XOh JYang M(2019)The usefulness of multimedia surrogates for making relevance judgments about digital video objectsInformation Processing and Management: an International Journal10.1016/j.ipm.2019.10209156:6Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1016/j.ipm.2019.102091
Show More Cited By

Index Terms

Recommendations

Hierarchical Adaptive Clustering

This paper studies an adaptive clustering problem. We focus on re-clustering an object set, previously clustered, when the feature set characterizing the objects increases. We propose an adaptive clustering method based on a hierarchical agglomerative ...
An adaptive algorithm for clustering cumulative probability distribution functions using the Kolmogorov-Smirnov two-sample test

An adaptive clustering algorithm has been proposed.The measure distance proposed is Kolmogorov-Smirnov statistics.A practical application of the algorithm proves its power.The proposed algorithm allows better clustering solar spectra data than classical ...
Ensemble clustering with voting active clusters

Clustering is an integral part of pattern recognition problems and is connected to both the data reduction and the data understanding steps. Combining multiple clusterings into an ensemble clustering is critical in many real world applications, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

April 2011

512 pages

ISBN:9781450303361

DOI:10.1145/1991996

General Chairs:
Francesco G. B. De Natale
University of Trento, Italy
,
Alberto Del Bimbo
University of Florence, Italy
,
Program Chairs:
Alan Hanjalic
University of Amsterdam, Netherlands
,
B. S. Manjunath
University of California, Santa Barbara
,
Shin'ichi Satoh
NII, Japan

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMR'11

Sponsor:

SIGMM

ICMR'11: International Conference on Multimedia Retrieval

April 18 - 20, 2011

Trento, Italy

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
349
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sadprasid BGutwin CBateman S(2024)Improving Video Navigation for Spatial Task Tutorials by Spatially Segmenting and Situating How-To VideosProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682103(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682103
Murakami TFujita KHara KTakashima KKitamura Y(2024)SwapVid: Integrating Video Viewing and Document Exploration with Direct ManipulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642515(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642515
Wildemuth BMarchionini GFu XOh JYang M(2019)The usefulness of multimedia surrogates for making relevance judgments about digital video objectsInformation Processing and Management: an International Journal10.1016/j.ipm.2019.10209156:6Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1016/j.ipm.2019.102091
Cobârzan CSchoeffmann KBailer WHürst WBlaźEk ALokoăź JVrochidis SBarthel KRossetto L(2017)Interactive video search toolsMultimedia Tools and Applications10.1007/s11042-016-3661-276:4(5539-5571)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s11042-016-3661-2
Girgensohn AMarlow JShipman FWilcox LBlustein JHerder ERubart JAshman H(2016)Guiding Users through Asynchronous Meeting Content with Hypervideo Playback PlansProceedings of the 27th ACM Conference on Hypertext and Social Media10.1145/2914586.2914597(49-59)Online publication date: 10-Jul-2016
https://dl.acm.org/doi/10.1145/2914586.2914597
Belo LCaetano CPatrocínio ZGuimarães S(2016)Summarizing video sequence using a graph-based hierarchical approachNeurocomputing10.1016/j.neucom.2015.08.057173:P3(1001-1016)Online publication date: 15-Jan-2016
https://dl.acm.org/doi/10.1016/j.neucom.2015.08.057
Schoeffmann KHudelist MHuber J(2015)Video Interaction ToolsACM Computing Surveys10.1145/280879648:1(1-34)Online publication date: 29-Sep-2015
https://dl.acm.org/doi/10.1145/2808796
Schoeffmann KHopfgartner FZhou XSmeaton ATian QBulterman DShen HMayer-Patel KYan S(2015)Interactive Video SearchProceedings of the 23rd ACM international conference on Multimedia10.1145/2733373.2807417(1321-1322)Online publication date: 13-Oct-2015
https://dl.acm.org/doi/10.1145/2733373.2807417
Sun SXu QGuo YLiang SFan Y(2015)3D Visualization of Multiscale Video Key FramesProceedings of the 2015 19th International Conference on Information Visualisation10.1109/iV.2015.48(223-227)Online publication date: 22-Jul-2015
https://dl.acm.org/doi/10.1109/iV.2015.48
Hudelist MSchoeffmann KXu Q(2015)Improving Interactive Known-Item Search in Video with the Keyframe Navigation TreeMultiMedia Modeling10.1007/978-3-319-14445-0_27(306-317)Online publication date: 2015
https://doi.org/10.1007/978-3-319-14445-0_27
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents