Trevor Bekolay
Centre for Theoretical Neuroscience
Follow along: http://bekolay.org/comp2
Train an
articulatory synthesizer to repeat utterances.
A phenomenological model of the synapse between the inner hair
cell and auditory nerve: long-term adaptation with power-law
dynamics.
Zilany, et al. The Journal of the Acoustical Society
of America, 126:2390–2412, 2009.
http://www.cs.colostate.edu/~ericson/ericsonFinal.pdf
A
computational model of filtering, detection, and compression in the
cochlea.
R. F. Lyon. In Proceedings of IEEE-ICASSP-82,
1282-1285, 1982.
Modeling consonant-vowel coarticulation for articulatory speech
synthesis.
Birkholz. PloS one, 8(4):e60603, 2013.
http://www.vocaltractlab.de/index.php?page=vocaltractlab-examples
http://www.vocaltractlab.de/index.php?page=birkholz-supplements
http://www.vocaltractlab.de/index.php?page=vocaltractlab-examples
http://www.vocaltractlab.de/index.php?page=birkholz-supplements
Name | Description | Min. | Max | Unit |
---|---|---|---|---|
HX | Horizontal hyoid position | 0.0 | 1.0 | |
HY | Vertical hyoid position | -6.0 | -3.4 | cm |
JX | Horizontal jaw displacement | -0.5 | 0.0 | cm |
JA | Jaw angle | -7.0 | 0.0 | deg |
LP | Lip protrusion | -1.0 | 1.0 | |
LD | Vertical lip distance | -2.0 | 4.0 | cm |
VS | Velum shape | 0.0 | 1.0 | |
VO | Velic opening | -0.1 | 1.0 | |
TCX | Tongue body center X | -3.0 | 4.0 | cm |
TCY | Tongue body center Y | -3.0 | 1.0 | cm |
TTX | Tongue tip X | 1.5 | 5.5 | cm |
TTY | Tongue tip Y | -3.0 | 2.5 | cm |
TBX | Tongue blade X | -3.0 | 4.0 | cm |
TBY | Tongue blade Y | -3.0 | 5.0 | cm |
TRX | Tongue root X | -4.0 | 2.0 | cm |
TRY | Tongue root Y | -6.0 | 0.0 | cm |
TS1 | Tongue side elevation 1 | -1.4 | 1.4 | cm |
TS2 | Tongue side elevation 2 | -1.4 | 1.4 | cm |
TS3 | Tongue side elevation 3 | -1.4 | 1.4 | cm |
TS4 | Tongue side elevation 4 | -1.4 | 1.4 | cm |
MA1 | Minimum area tongue back region | 0.0 | 0.3 | cm2 |
MA2 | Minimum area tongue tip region | 0.0 | 0.3 | cm2 |
MA3 | Minimum area lip region | 0.0 | 0.3 | cm2 |
minuC(u)=uTNus.t. J¨q=¨xref−˙J˙q¨xref=¨xd+Kd(˙xd−˙x)+Kp(xd−x)
Learning to control in operational space.
Peters & Schaal.
The International Journal of Robotics Research 27(2), 197-212,
2008
Generalize several utterances of the same category
Classify utterances corresponding to different categories
This presentation: http://bekolay.org/comp2
My progress: http://github.com/tbekolay/audition