Mei 2013

Home / Archives for Mei 2013

Wavelets and Expectations

Posted by dasfseegdse Jumat, 31 Mei 2013 0 komentar

Pinpointing something interesting in a stream of information is a big challenge. Recently, wavelets have provided a means by which temporal changes in structure can be identified. This provides a way of making distinctions in continuous data automatically using a fairly simple algorithm. With image data, video and sound, the techniques promise remarkable data processing capabilities, making things like automatic video description a reality - YouTube's recently acquired ability to pattern-match video content from computer games indicates where things are going (and how new areas of copyright infringement will emerge that we hadn't even thought of!)

Video is essentially a continuous function, and wavelet analysis requires this. Sound waves are ideal, and the data of pixels in a picture will also do quite nicely. But what about text? And, what about music represented in the form of notation? This kind of data is not continuous. There is, however, a continuous ebb and flow of expectation, but that ebb and flow is dependent on redundancies and entropies in the text. Text presents different problems because it is the result of decisions, which deep down in our consciousness may be a continuous function (although we don't know), but even if it is, it's a continuous function that we do not have direct access to. Indeed, musical decisions might be the closest we can get to the continuous function of consciousness.

We can speculate what happens in the continuous function with things like text. Mostly, with text it is redundancy. Mostly I think it serves to prolong expectations. The continuous function serves to structure expectations in some way. Sometimes expectations are transformed by some new event. The transformation of expectations is accompanied by new redundancies which in turn feeds new expectations. An expectation maintains itself over shifting redundancies. This is the essence of the art of variation as practiced by artists and composers.

The central question is whether there a way of charting the continuity. Is there a way of mapping the relationship between tension and release? I wonder if there might be a correlation between the length of the path of recursive meta-game tree and the degree of tension that is experienced. In essence that might map onto the length of a branch of a structure which is maintained by the continuous process. This might equate to entropy levels in choosing a next possible act. High entropy means tension. Low entropy means release. Similarly high tension would mean stimulating the creation of redundancy, and low tension would mean easing-off the creation of redundancy (after all, with the lowest entropy, there is little scope for redundancy).

Wavelets are good for removing redundancy. In compression algorithms like JPEG, wavelet analysis is used to remove the repetitions of bits in a process whereby those repetitions are coded as transformations of the wavelet. What it leaves behind are the 'edges' where distrinctions can be made. There are remakable advances currently underway in the analysis of sound waves and the recognition of patterns. And wavelet analysis is an important feature of more advanced data mining techniques like granular computing.

Because a wavelets repeat throughout the structure, its distortions indicate where the redundancy has really changed. That is an indication of where expectations may similarly have changed. At those moments where it does change, we can expect information transfer and meaningfulness to occur. Maybe.

The question is "which way round to look at this?". We could, for example, go down the route of an artificial psychology (actually, I would prefer an artificial sociology!), and model candidates for the continuous function and compare the utterances that it makes. If the morphogenetic process map onto things we see in reality, then it might be worth pursuing. But the most pressing issue is how we understand the information around us, and how we organise ourselves. The most pressing issues are political not epistemological!

That means sorting out a model of the continuous process which discounts those models of the process which lead to social pathologies. I think that many of our social pathologies stem from bad theory about cognition. A better theory demonstrably shows the nature of cognition as inherently convivial.

If such a model could be established, then we would run our institutions and governments differently...

Baca Selengkapnya ....

The Experience of Information and Symbol Grounding

Posted by dasfseegdse Selasa, 28 Mei 2013 0 komentar

In the theory of information, the symbol grounding problem refers to the inability to account for the emergence of signs and tokens (words) with referents from basic principles (http://en.wikipedia.org/wiki/Symbol_grounding) without recourse to apriori distinctions. The description of abstract mechanisms which show how structures of data can emerge and form the basis of proto-languages has been elusive, although there have been some interesting attempts by Holland (see his "echo" model) and Floridi. The symbol grounding problem is fundamentally a problem within the broader topic of morphogenesis, and indeed, the emergence of discrete symbols from basic principles is not dissimilar from the emergence of discrete forms from basic principles. They might well be one and the same!

There is, I think, a problem beneath the symbol grounding problem, and that is the problem of data itself. We tend to see data as essentially a synchronically structured facet of experience: it is never perceived to be diachronic. Yet, when I see '1.2345' there is a process of perception which is both synchronic and diachronic. "1.2345" must remain in my consciousness long enough for me to recognise it as data. Indeed, "1.2345" may well appear as meaningful to me before I recognise it as data.

The matters that need to be considered include:

Whether I expect to see "1.2345"
How my expectation of seeing "1.2345" relates to my expectation of what might come next

There is a suggestion in 1. that if I didn't expect to see "1.2345" then I might not perceive it at all: it would be a difference that didn't make a difference because there was no anticipatory mechanism to pick it up and be changed by it. But this isn't so simple. I may not have expected to see "1.2345", but "1.2345" might be a possible well-formed statement within the realm of my expectations, and so it would make a difference to me.

I think there may be a problem with Bateson's idea of information as "a difference that makes a difference".
A diachronic view of information would instead look at the expectations of an observer and the prolongation of those expectations through 'differences'. Information as difference serves to prolong the expectations that it makes a difference to.

There are clearly some pieces of information which are completely outside current expectations and yet have an enormous impact: a shocking piece of news, for example. To consider these means we have to consider a gradation in transformation of expectation. Some differences are small, others are big, others don't register at all.

What is important is the understanding of the medium through which information is gained. My information expectation is a combination of an expectation of possible differences (i.e. utterances) in the light of the possibilities of the medium. This means that expectation is partly ontological speculation: our concern is partly the nature of what is possible within what we believe to be reality.

There are always messages that are possible which transform the way we think about the medium, that change the way we think about reality. These messages have a transformative effect. The old expectations of the medium are overturned. There is a radical restructuring of expectation which we feel quite viscerally. Artists and terrorists have this capacity to "transform the medium" in common! What shocks us also compels us to engage with it. It is this basic fact that makes art and terrorism possible.

Expectations ebb and flow as the properties of the medium and its messages are discovered. Information is more like the substrate within which this happens rather than the main show: it is more ground than figure. The figure is expectation.

But the central question of the symbol grounding problem is how it is that increasingly sophisticated symbols are developed and form the basis of proto-languages.

If expectations are considered as structures which are maintained through being immersed in the substrate of information, then we should consider what happens when those structures are radically reorganised. In a brain, reorganisation effectively means that a particular network of neurons which fired in anticipation of a set of events now (in the light of a new transformative event) is either discarded or radically reorganised to fire in a different way. The question is, what happened to the old set of events? Because our experience of phenomena like music is that whilst transformation takes us somewhere new, at some point the thing that was discarded comes back ("we will not cease from exploration...")

So the structure must persist in some form. Yet I am uncomfortable in following Floridi in suggesting a 'memory' because I do not think that it is the 'informational content' which is preserved (as bits), but rather it is the discarded structure of decision-making which is somehow preserved. Is it possible that one branch of tree may wither, whilst another flourishes, but at the same time the ermergent conditions of the flourishing of the second branch create the conditions for the resurrection of the first? Modelling this kind of oscillation ought to be possible. Each branch produces the information as the substrate for the growth and development of the other.

What is distinct about a particular structure of decision-making and a person's anticipations? If a particular structure reflects the choosing of the appropriate next act, the structure will determine the implications of different acts according to their likely effects, and the effects of those effects, etc. The agency for particular effects need not be memorised as 'code', but need only be 'wired' into reflex actions (like singing for example). If such a structure loses its privilege to another structure (through radical reorganisation of expectations), then the wiring will be maintained but the capacity to fire not called upon until some new point of development whereby the old structure of anticipation might be reintegrated within the network for active decision-making. This moment might occur if an older structure becomes a shortcut for restructuring a newer structure. In this way, it is not surprising that 'eternal recurrence' is a feature of most art.

Baca Selengkapnya ....