View source for Spectral modeling synthesis

[[Image:Spectrum Modeling Synthesis overview (based on Curtis Roads 1996, Fig.4.23).jpg|thumb|link=Image:Spectrum Modeling Synthesis overview (based on Curtis Roads 1996, Fig.4.23).svg|Spectral modeling synthesis (based on {{harvnb|Roads|1996}}, p. 153)]]

'''Spectral modeling synthesis''' ('''SMS''') is an [[Acoustic Model|acoustic modeling]] approach for speech and other signals.
SMS considers [[Sound|sounds]] as a combination of [[Harmonic analysis|harmonic]] content and [[noise]] content.  Harmonic components are identified based on peaks in the [[frequency spectrum]] of the signal, normally as found by the [[short-time Fourier transform]]. The signal that remains following removal of the spectral components, sometimes referred to as the residual, is then modeled as [[AWGN|white noise]] passed through a time-varying filter.  The output of the model, then, are the frequencies and levels of the detected harmonic components and the [[coefficients]] of the time-varying filter.

Intuitively, the model can be applied to many types of audio signals.  Speech signals, for example, include slowly changing harmonic sounds caused by vibration of the [[vocal cords]] plus wideband, noise-like sounds caused by the lips and mouth. Musical instruments also produce sounds containing both harmonic components and percussive, noise-like sounds when the notes are struck or changed.

{{multiple image |direction=horizontal |align=center
 | image1 = SMS analysis (Bonada et al. 2001, Fig.1).svg  | width1=288
 | image2 = SMS synthesis (Bonada et al. 2001, Fig.2).svg | width2=303
 | footer = SMS analysis & synthesis block diagrams (based on {{harvnb|Bonada et al.|2001}}, Fig.1 & Fig.2)
}}

== See also ==
* [[Speech coding]]
* [[Code Excited Linear Prediction|CELP]]
* [[Source-filter model of speech production]]
* [[FM synthesis]]
* [[Sound synthesis]]
* [http://www.klingbeil.com/spear/ SPEAR - Sinusoidal Partial Editing Analysis and Resynthesis]

== References ==
*{{cite web
  | title     = Spectral Modeling Synthesis: Past and Present
  | url       = http://www.dtic.upf.edu/~xserra/presentacions/Spectral-Modeling-Synthesis-Past-and-Present.pdf
  | accessdate= May 11, 2010
  | first     = Xavier
  | last      = Serra
  | authorlink= Xavier Serra
  | year      = 2003
  | publisher =
  | pages     = 20
  | language  =
  | doi       =
  | archiveurl=
  | archivedate=
  | quote     =
 }}
*{{cite web
  | title     = Spectral Modeling Synthesis Tools
  | url       = http://mtg.upf.edu/technologies/sms
  | accessdate= May 11, 2010
  | first     = Xavier 
  | last      = Serra
  | authorlink= Xavier Serra
  | date      =
  | year      =
  | publisher =
  | pages     =
  | language  =
  | doi       =
  | archiveurl=
  | archivedate=
  | quote     =
}}
*{{cite web
  | title     = Spectral Modeling
  | url       = http://ccrma.stanford.edu/~jos/jnmr/Spectral_Modeling.html
  | accessdate= April 19, 2008
  | first     = Julius O.
  | last      = Smith III
  | authorlink= Julius O. Smith III
  | date      = 28 December 2005
  | publisher =
  | pages     =
  | language  =
  | doi       =
  | archiveurl=
  | archivedate=
  | quote     =
}}
*{{cite book | last      = Roads | first = Curtis
  | authorlink= Curtis Roads
  | chapter   = Figure 4.23: Overview of spectrum modeling synthesis. ...
  | title     = The Computer Music Tutorial
  |url=https://archive.org/details/computermusictut00road
  |url-access=limited
  | publisher = [[MIT Press]]
  | date = 1996
  | isbn      = 978-0-262-68082-0
  | page      = [https://archive.org/details/computermusictut00road/page/n171 153]
 }}
*{{cite journal |ref={{sfnref|Bonada et al.|2001}}
  |author1=Bonada, J. |author2=Loscos, A. |author3=Cano, P. |author4-link=Xavier Serra |author4=Serra, X. |author5=Kenmochi, H.
 | title     = Spectral Approach to the Modeling of the Singing Voice
  | work      = In Proc. of the 111th AES Convention<!-- , New York, USA, 2001 -->
  | date = 2001
 |citeseerx=10.1.1.75.2357 }}

{{DEFAULTSORT:Spectral Modeling Synthesis}}
[[Category:Speech recognition]]


{{science-software-stub}}