Untangling Phase and Time in Monophonic Sounds

Henning Thielemann

.

DOI: 10.4236/jsip.2010.11001                

Abstract

We are looking for a mathematical model of monophonic sounds with independent time and phase dimensions. With such a model we can resynthesise a sound with arbitrarily modulated frequency and progress of the timbre. We propose such a model and show that it exactly fulfils some natural properties, like a kind of timeinvariance, robustness against non-harmonic frequencies, envelope preservation, and inclusion of plain resampling as a special case. The resulting algorithm is efficient and allows to process data in a streaming manner with phase and shape modulation at sample rate, what we demonstrate with an implementation in the functional language Haskell. It allows a wide range of applications, namely pitch shifting and time scaling, creative FM synthesis effects, compression of monophonic sounds, generating loops for sampled sounds, synthesise sounds similar to wavetable synthesis, or making ultrasound audible.

Keywords

Pitch Shifting, Time Stretching, Wave Table Synthesis

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	S. Owre, N. Shankar, J. M. Rushby and D. W. J. Stringer- Calvert, “The Prototype Verification System,” PVS System Guide, 2001.
[2]	H. Thielemann, “Optimally Matched Wavelets,” PhD. Thesis, Universit?t Bremen, March 2006.
[3]	G. Strang, “Eigenvalues of and Convergence of the Cascade Algorithm,” IEEE Transactions on Signal Processing, Vol. 44, 1996, pp. 233-238.
[4]	I. Daubechies and W. Sweldens, “Factoring Wavelet Transforms into Lifting Steps,” Journal of Fourier Analysis and Applications, Vol. 4, No. 3, 1998, pp. 245-267.
[5]	R. W. Hamming, “Digital Filters,” Signal Processing Series, Prentice Hall, Upper Saddle River, January 1989.
[6]	S. P. Jones, “Haskell 98 Language and Libraries, the Revised Report,” 1998. http://www.haskell.org/definition/
[7]	H. Thielemann, “Audio Processing Using Haskell,” DAFx: Conference on Digital Audio Effects, G. Evangelista and I. Testa, Eds., Federico II University of Naples, Italy, October 2004, pp. 201-206.
[8]	S. P. Jones, R. Leshchinskiy, G. Keller and Manuel M. T. Chakravarty, “Harnessing the Multicores: Nested Data Parallelism in Haskell,” IARCS Annual Conference on Foundations of Software Technology and Theoretical Computer Science (FSTTCS’08), 2008.
[9]	D. C. Massie, “Wavetable Sampling Synthesis,” in Applications of Digital Signal Processing to Audio and Acoustics, Mark Kahrs and Karlheinz Brandenburg, Eds., pp. 311–341. Kluwer Academic Press, 1998.
[10]	J. M. Clowning, “The Synthesis of Complex Audio Spectra by Means of Frequency Modulation,” Journal of the Audio Engineering Society, Vol. 21, No. 7, 1973, pp. 526-534.
[11]	B. Lang, “Einbettungsverfahren für Netzwerkgleichungen,” Ph.D. Thesis, Universit?t Bremen, Germany, November 2002.
[12]	U. Z?lzer, Ed., “DAFx: Digital Audio Effects,” John Wiley and Sons Ltd., Hoboken, February 2002.
[13]	S. Roucos and A. M. Wilgus, “High Quality Timescale Modification for Speech,” Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 1985, pp. 493-496.
[14]	J. Makhoul and A. El-Jaroudi, “Time-Scale Modification In Medium To Low Rate Speech Coding,” Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 1986, pp. 1705-1708.
[15]	S. Disch and U. Z?lzer, “Modulation and Delay Line Based Digital Audio Effects,” Proceedings DAFx-99: Workshop on Digital Audio Effects, Trondheim, December 1999, pp. 5-8.
[16]	C. Hamon, E. Moulines and F. Charpentier, “A Diphone Synthesis System Based on Time-Domain Prosodic Modifications of Speech,” Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 1989, pp. 238-241.
[17]	E. Moulines and F. Charpentier, “Pitch Synchronous Waveform Processing Techniques for Text to Speech SynThesis Using Diphones,” Speech communication, Vol. 9, No. 5-6, 1990, pp. 453-467.
[18]	S. Lemmetty, “Review of Speech Synthesis Technology,” M.S. Thesis, Helsinki University of Technology, March 1999.
[19]	M. Raspaud and S. Marchand, “Enhanced Resampling for Sinusoidal Modeling Parameters,” WASPAA’07, 2007.
[20]	F. X. Nsabimana and U. Z?lzer, “Audio Signal Decomposition for Pitch and Time Scaling,” ISCCSP 2008, March 2008.
[21]	A. Haghparast, H. Penttinen and V. V?lim?ki, “Real-Time Pitch-Shifting of Musical Signals by a Timevarying Factor Using Normalized Filtered Correlation Timescale Modification (NFC-TSM),” International Conference on Digital Audio Effects, September 2007, pp. 7-13.