research-article

Chants and Orcas: semi-automatic tools for audio annotation and analysis in niche domains

Authors:

Steven R. Ness,

Matthew Wright,

L. Gustavo Martins,

George TzanetakisAuthors Info & Claims

MS '08: Proceedings of the 2nd ACM workshop on Multimedia semantics

Pages 9 - 16

https://doi.org/10.1145/1460676.1460680

Published: 31 October 2008 Publication History

Abstract

The recent explosion of web-based collaborative applications in business and social media sites demonstrated the power of collaborative internet scale software. This includes the ability to access huge datasets, the ability to quickly update software, and the ability to let people around the world collaborate seamlessly. Multimedia learning techniques have the potential to make unstructured multimedia data accessible, reusable, searchable, and manageable. We present two different web-based collaborative projects: Cantillion, and the Orchive. Cantillion enables ethnomusicology scholars to listen and view data relating to chants from a variety of traditions, letting them view and interact with various pitch contour representations of the chant. The Orchive is a project to digitize over 20,000 hours of Orcinus orca (killer whale) vocalizations, recorded over a period of approximately 35 years, and provide tools to assist their study. The developed tools utilize ideas and techniques that are similar to the ones used in general multimedia domains such as sports video or news. However, their niche nature has presented us with special challenges as well as opportunities. Unlike more traditional domains where there are clearly defined objectives one of the biggest challenges has been the desire to support researchers to formulate questions and problems related to the data even when there is no clearly defined objective.

References

[1]

A. Camacho. A Sawtooth Waveform Inspired Pitch Estimator for Speech and Music. PhD thesis, University of Florida, 2007.

Digital Library

[2]

O. Chappelle, B. Scholkopf, and A. Zien. Semi-Supervised Learning. MIT Press, Cambridge, MA, 2006.

[3]

V. Deecke, J. Ford, and P. Spong. Dialect change in resident killer whales (orcinus orca): implications for vocal learning and cultural transmission. Animal Behaviour, 60(5):619--638, 2000.

[4]

R. T. Fielding. Architectural Styles and the Design of Network-based Software Architectures. Phd dissertation, University Of California, Irvine.

Digital Library

[5]

J. Foote. Content-based Retrieval of Music and Audio, pages 138--147. 1997.

[6]

J. Ford. A catalogue of underwater calls produced by killer whales (orcinus orca) in british columbia. Technical Report 633, Canadian Data Report of Fisheries and Aquatic Science, 1987.

[7]

J. Ford. Acoustic behaviour of resident killer whales (orcinus orca) off vancouver island, british columbia. Canadian Journal of Zoology, 64:727--745, 1989.

[8]

J. Ford, E. G. M., and B. K. C. Killer Whales: The natural history and genealogy of Orcinus orca in British Columbia and Washington, 2nd ed. UBC, Vancouver, 2000.

[9]

A. Hauptman and et al. Informedia at trec 2003: Analyzing and searching broadcast news video. In Proc. of (VIDEO) TREC 2003, Gaithersburg, MD, 2003.

[10]

A. Hauptman and M. Witbrock. Informedia: News-on-demand Multimedia Information Acquisition and Retrieval. MIT Press, Cambridge, Mass, 1997.

[11]

T. Karp. Aspects of Orality and Formularity in Gregorian Chant. Northwestern University Press, Evanston, 1998.

[12]

Z. Kodaly. Folk Music of Hungary. Corvina Press, Budapest, 1960.

[13]

C. L. Krumhansl. Cognitive Foundations of Musical Pitch. Oxford University Press, Oxford, 1990.

[14]

K. Levy. Gregorian Chant and the Carolingians. Princeton University Press, Princeton, 1998.

[15]

L. McColl-Sylvester and F. Ponticelli. Professional haXe and Neko. Wiley Publishing, Inc., Indianapolis, IN, 2008.

Digital Library

[16]

K. Nelson. The Art of Reciting the Koran. University of Texas Press, Austin, 1985.

[17]

D. Thomas, D. Hansson, L. Breedt, M. Clark, J. D. Davidson, J. Gehtland, and A. Schwarz. Agile Web Development with Rails, 2nd Edition. Pragmatic Bookshelf, Flower Mound, TX, 2006.

Digital Library

[18]

L. Treitler. The early history of music writing in the west. Journal of the American Musicological Society, 35, 1982.

[19]

G. Tzanetakis. Song specific bootstrapping of singing voice structure. In Proc. Int. Conf. on Multimedia and Exposition ICME, TaiPei, Taiwan, 2004. IEEE.

[20]

G. Tzanetakis and P. Cook. Marsyas: A framework for audio analysis. Organized Sound, 4(3), 2000.

Digital Library

[21]

G. Tzanetakis, M. Lagrange, P. Spong, and H. Symonds. Orchive: Digitizing and analyzing orca vocalizations. In Proc. of the RIAO, Large-Scale Semantic Access to Content Conference. RIAO, 2007.

Digital Library

[22]

B. M. Weiss, F. Ladich, P. Spong, and H. Symonds. Vocal behavior of resident killer whale matrilines with newborn calves: The role of family signatures. The Journal of the Acoustical Society of America, 119(1):627--635, 2006.

[23]

G. Wigoder and et al. Masora, The Encyclopedia of Judaism. MacMillan Publishing Company, New York, 1989.

[24]

H. Zimmermann. Untersuchungen zur Musikauffassung des rabbinischen Judentums. Peter Lang, Bern, 2000.

Cited By

Ness SLerch ATzanetakis G(2011)Strategies for orca call retrieval to support collaborative annotation of a large archive2011 IEEE 13th International Workshop on Multimedia Signal Processing10.1109/MMSP.2011.6093798(1-6)Online publication date: Oct-2011
https://doi.org/10.1109/MMSP.2011.6093798
Ness SBiró DTzanetakis G(2010)Computer-assisted cantillation and chant research using content-aware web visualization toolsMultimedia Tools and Applications10.1007/s11042-009-0357-x48:1(207-224)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1007/s11042-009-0357-x
Ness STzanetakis GBiro D(2009)Content-Aware Web Browsing and Visualization Tools for Cantillation and Chant ResearchProceedings of the 2009 Seventh International Workshop on Content-Based Multimedia Indexing10.1109/CBMI.2009.46(81-86)Online publication date: 3-Jun-2009
https://dl.acm.org/doi/10.1109/CBMI.2009.46

Index Terms

Chants and Orcas: semi-automatic tools for audio annotation and analysis in niche domains
1. Information systems
  1. Information systems applications

Recommendations

Computer-assisted cantillation and chant research using content-aware web visualization tools

Chant and cantillation research is particularly interesting as it explores the transition from oral to written transmission of music. The goal of this work to create web-based computational tools that can assist the study of how diverse recitation ...
Content-Aware Web Browsing and Visualization Tools for Cantillation and Chant Research
CBMI '09: Proceedings of the 2009 Seventh International Workshop on Content-Based Multimedia Indexing

Chant and cantillation research is particularly interesting as it explores the transition from oral to written transmission of music. The goal of this work to create web-based computational tools that can assist the study of how diverse recitation ...
Automatic Identification of Traditional Colombian Music Genres Based on Audio Content Analysis and Machine Learning Techniques
Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications
Abstract
Colombia has a diversity of genres in traditional music, which allows to express the richness of the Colombian culture according to the region. This musical diversity is the result of a mixture of African, native Indigenous, and European ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MS '08: Proceedings of the 2nd ACM workshop on Multimedia semantics

October 2008

70 pages

ISBN:9781605583167

DOI:10.1145/1460676

General Chairs:
Farshad Fotouhi
Wayne State University, USA
,
William I. Grosky
University of Michigan-Dearborn, USA
,
Peter Stanchev
Kettering University, USA

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 31, 2008

British Columbia, Vancouver, Canada

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ness SLerch ATzanetakis G(2011)Strategies for orca call retrieval to support collaborative annotation of a large archive2011 IEEE 13th International Workshop on Multimedia Signal Processing10.1109/MMSP.2011.6093798(1-6)Online publication date: Oct-2011
https://doi.org/10.1109/MMSP.2011.6093798
Ness SBiró DTzanetakis G(2010)Computer-assisted cantillation and chant research using content-aware web visualization toolsMultimedia Tools and Applications10.1007/s11042-009-0357-x48:1(207-224)Online publication date: 1-May-2010
https://dl.acm.org/doi/10.1007/s11042-009-0357-x
Ness STzanetakis GBiro D(2009)Content-Aware Web Browsing and Visualization Tools for Cantillation and Chant ResearchProceedings of the 2009 Seventh International Workshop on Content-Based Multimedia Indexing10.1109/CBMI.2009.46(81-86)Online publication date: 3-Jun-2009
https://dl.acm.org/doi/10.1109/CBMI.2009.46

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents