Semantic Folding ...
Note the mention of Jeff Hawkins, who we connected with long ago. Posts re his Numenta company. Technical, with intriguing implications.
The Semantic Folding Theory (SFT) is the attempt to develop an alternative computational theory for the processing of language data. While nearly all current methods of processing natural language use word statistics, Semantic Folding uses a neuroscience based mechanism of distributional semantics. After capturing a given semantic universe of a reference set of documents by means of a fully unsupervised mechanism, the resulting semantic space is folded into each and every word-representation vector ....
These vectors are large, sparsely filled binary vectors. Every feature bit in this vector not only corresponds but also equals a specific semantic feature of the folded-in semantic space and is therefore semantically grounded. The resulting word-vectors are fully conforming to the requirements for valid word-SDRs (Sparse Distributed Representation) in the context of the Hierarchical Temporal Memory (HTM) theory by Jeff Hawkins. While the HTM theory focuses on the cortical mechanism for identifying, memorizing and predicting reoccurring sequences of SDR patterns, the Semantic Folding theory describes the encoding mechanism that converts semantic input data into a valid SDR format, directly usable by HTM networks. ... '
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment