t o n g u e b u t n o d o o r ( d o t ) n e t
tongue but no door ( dot ) net
  we can't keep our mouths shut
still babbling, but now it's summertime
On Deck for Connectionists Models
todd [decorative spacer] July 13, 2005 [decorative spacer] 11:27 PM

As if I needed more reasons to hope for admittance to UCSD. Here's a well written piece by Dr. Jeff Elman titled Connectionist Models of cognitive development: where next?. It appeared in TRENDS in Cognitive Science in March, and is a review of important and recent literature surrounding connectionist (those using neural networks) models of cognitive development. There is an emphasis on those models which deal with language acquisition.

I'm always telling people that computational models are good for directing research in the wet sciences, but I don't have a lot of concrete examples. This paper is full of them.

In one particularly cool bit, Elman discusses research which is attempting to discover how we learn to differentiate spoken words. Contrary to the way it seems to a practiced native speaker, there are no clear breaks in spoken language. Some computational models have apparently converged on one way in which this discrimination could take place:

... word boundaries are locations where the conditional probability of the next sound, given what has preceded it, is low. A network (or child) that attempts to anticipate what it (she) will hear next will tend to do worse at the onsets of words, and better as more of a word is heard. Error maxima thus constitute likely word boundaries.
Neat stuff. The paper has 74 references, and looks like a good place to start for anyone interested in recent advancements in this area. (Which, given the audience here, is basically me. Still.)

Comments:
Good luck on your admission. If you do end up in attendance, I might recommend Hecht-Nielsen's neurocomputing sequence. The three courses collectively cover feature-attractor networks, antecedent-support networks, and some hierarchical extensions toward language and vision modeling. Just a thought from a random alum.

Thanks a lot. Have you been here long? How'd you get here? Anything else you'd like to say? Maybe about getting in, or reasons you hated the place? :-)

Post a comment

Thanks for signing in, . Now you can comment. (sign out)

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)


Remember me?