Working on binary tree

I can't figure out how to construct it.
should 'p' and 'b' be closer or 'p' and 's'

The distance between the nodes is the distance between the values it represents. when things are in a binary tree, I don't really know how to keep them the same distance as the one from the paper.

looking at this link: http://ww4.aievolution.com/hbm1201/index.cfm?do=abs.viewAbs&abs=6470
It seems that there is a way of computing something called a "similiarity tree" from the similiarity matrix.

This study uses this paper: http://www.sciencedirect.com/science/article/pii/S0304397511007158
for constructing trees
 

Working in the lab

Set up Unity with the project.

At first it wouldn't compile. It took me until Thursday Morning to make the whole thing compile. I had to edit out all the GPU dependencies from the code.

Now it is friday morning. I just ran some propogations.

This is "t"

[0.01889388]:(onsonant_t@

onsonant_t:494.1513), (17_consonant_j_y.png:798.9461), (38_vowel_e_bird.png:800.9612), (07_consonant_tf_ch.png:918.0318), (08_consonant_h.png:932.5713), (37_dipthon_au_out.png:1202.313), (03_consonant_f.png:1400.457),....

this is the vowel from "bet"

[0.01889388]:(owel_3_bet@owel_

3_bet:139.6159), (26_dipthon_ei_eight.png:181.4589), (06_consonant_f_sh.png:189.3021), (33_vowel_u_foot.png:193.5665), (22_consonant_r.png:225.2484), (20_consonant_ng.png:296.1697), (16_consonant_d3_ju.png:301.0428), (15_consonant_3_jzu.png:310.3925), (03_consonant_f.png:318.9848), (23_consonant_w.png:427.7459),

 

 

Ah ha, I have a lot more to work on it seems. 

 

Oh, I didn't finish editing the paper. I don't think I'm going to until next week. I think it is more productive right now to keep on hacking at this code than writing the paper, especially because I'm extremely slow at papers.

Monday

Read through Pengfei's email Actually and took a look at the Unity code again.
I think this step will be more complicated than I originally thought.

Constructing the Hierarchy according to the paper "An Online Algorithm for Hierarchical Phoneme Classification". Sent Pengfei another question regarding how to connect this data, the matlab output and the Unix code together.

Will ask Mubassir about getting a computer in the lab. When I work on my laptop, the Unity code is way too slow. Unity crashed on me about 5 times today on my laptop.

my tree on paper right now

Back from spring break

Got off the plane a few hours ago.
This is my plan for this week:

Monday: Pengfei replied to my email about Unity. I will use the reply to take a look at the code base again. And put my data through the unity code.
Tuesday:  finish "Monday", and fix the proposal according to comments. (It takes me a long time to write)
Wednesday: Read some papers/research. From a battle plan for how to extract formants/other data. (matlab portion).
Thursday: Continue Wednesday. Start coding is possible.
Friday: catch up or more coding.

There's a Math midterm next Tuesday (the 19th). From Saturday until the midterm, I will not be very productive with this project.

Unity + Derp = Derpity

I was on schedule to run the whole pipeline once without any algorithm changes, and then I realized I have no idea how to use unity (haha). I finished generating the data file from the SPR portion of the pipeline when I was sleeping last night, and this morning I woke up ready to stuff it into unity.

Behold, I open up the project file, and I have no idea what any of the panels do. So I watched a bunch of tutorials. (like this one: http://www.youtube.com/watch?feature=player_embedded&v=hbjB80-Mc7E ).

Very helpful. Now I am reading the code, and trying to figure out how to specify which sound to propagate. Maybe pengfei will be in the lab tomorrow (thursday), he was busy today >x< ...

The code currently is weird in "initmap" of soundpropogator. I have a vague idea that somewhere i should be replacing the dataset, but I haven't yet found where that lives yet.

I think the code is fine in the init steps however. The reciever is outputting a signal. (I can't tell which signal but there is definatly a signal).

I'll take another look tomorrow.

Error using ==> spectrogram

I was getting this error for the longest time... It turns out its not the matlab code's fault. It's my test file's fault. The sound files need to be in mono instead of stereo. haha

here are some results. They look better than the last set of data i was using C:
now i need to do the hand-editing part where i stick all these files through photoshop. 



A comparison. on old data and new data

 above: new 'b'
below: old 'b'

====================================================================

 

 above: 'a' sound. a vowel
below: 'p' sound. a consonant

 above: 's' sound. A consonant, fricative, voiceless.
below: "ou" sound as in out. A dipthong

Met with pengfei today

Pengfei showed me the whole pipeline today. And was very helpful with the few questions I have.
I realized I actually understood the pipeline wrong.

TODO for alpha: run through the whole pipeline once with my data. I hope I can hit this pipeline.

1) generate images for sound extraction (done)
2) hand edit images (current)
3) run images through comparison code
4) propogate
5) compare

Sound sources using now:
 http://www.teachingenglish.org.uk/activities/phonemic-chart
http://manual.audacityteam.org/man/Tutorial_-_Recording_audio_playing_on_the_computer

I really liked the sound sources from the first link. So using the tutorial on recording within the computer, I am creating a new library of play-able sound.