The Game Loop: Part 5 In Search of the Fundamental Inputs II
Posted: Sat Jan 10, 2026 6:38 pm
The Game Loop
Part 5
In Search of the Fundamental Inputs II
Part 5
In Search of the Fundamental Inputs II
Google Doc version (easier to follow footnotes)
Part 1 Mental Pipelines
Part 2 Interleaved IO Flows I
Part 3 Interleaved IO Flows II
Part 4 In Search of the Fundamental Inputs I
Part 5 In Search of the Fundamental Inputs II
Previously, we saw that by trying to pin down the way in which we interact with the game flow, we were led to the elusive ‘event horizon’, where it feels as if our instinctive, yet intuitively oriented, willful pushing toward a future state (input) seems tightly correlated with the lighting up mental images (output), which then quickly fade away. Getting a more intimate experience of this elusive interface is not easy, primarily because it’s hard to overcome our familiar thinking habits. We continue to insist on seeing this event horizon as some output phenomenon in our field of consciousness. In other words, we insist on seeing in the output our ‘mental hand’ as an image that shapes other mental images. However, the reality of this process is precisely the tearing precipitating from the true horizon, which we cannot encompass as some mental or perceptual output but can only experience when we strive to sense how our dim intuitive inputs have something to do with the continuously precipitating mental images. Unlike the event horizon of a black hole, here we are not speaking of a spatial boundary but of a temporal one – the threshold between what could be our next state of existence and what has already become. Gaining clear awareness at this threshold requires new inner skills, normally not even hinted at in the traditional curricula, thus it’s worth trying to approach these realms of inner experience more gradually.
Consider the following caricature:

Unless we are a good chess player, it may have taken us a few seconds to get the joke. For many people, the mental process may have taken more or less the following sequence. When we first glance at the board and see the checkerboard and the knight, the intuitions related to chess stand out – we simply know what we see even without trying to analyze it. If we know nothing of chess, we see only a picture that evokes the intuitions of “checkerboard”, “horse statue”, and “carrots”. Since the horse is a herbivorous animal, it might occur to us that it must somehow reach the carrots to eat them. Now, if we have at least some basic experience with chess, what is also evoked is the intuition about how this output may transform. Then we begin applying in our imagination the gamma-shaped (Γ) move of the knight, and soon we think, “Wait a second, this is going nowhere. No matter how I move the knight (as long as the rules are respected), I can’t reach the middle square.” We can express this process symbolically:

Obviously, we do not see such stacking of mental images in our imagination. The animation only aims to symbolize a fact of our inner experience. It is like a first-person version of the cathode-ray tube analogy – mental images light up at maximum intensity across the horizon and immediately fade away, leaving only intuitive traces. Consider how in the first move we may feel a sort of enthusiasm, as if we say, “This is easy, I’ll solve it right away.” Now, imagine that on the second move, we have already forgotten about the previous, as if the images immediately dissolve without an intuitive trace. We now may feel the same enthusiasm and readiness to solve the puzzle. This can go on and on, as long as every move feels as if we have just started, like it could be if we suffer from anterograde amnesia. If we are mentally healthy, however, we soon feel that things are going nowhere. So there must be something changing in our experience from ‘frame to frame’ besides the momentary image of the board (the current move). It’s not only that we experience a momentary picture with the knight at a certain position, but the intuitive and feeling context also changes. When we look at the animation above, we see how the places where the knight has moved look like a well-trodden path, while the central square looks hollow. There’s something analogous that seems to happen in our inner flow. Even though we do not see stacking images, the possibility of remembering the chain of prior moves still reverberates as a kind of knowing embedded in the context of our experience. There’s something that intuitively feels like: “For some time now, I have imagined the knight in all these squares but never in the central one.” Note that we are not proposing any mechanism that ‘explains’ this effect. We are only stating facts of inner experience that anyone can survey for themselves.
It’s worth taking a moment to appreciate the nature of the animation above and the way we have used it. We are clear that such receding images – mental or perceptual – are nowhere to be found while we try to solve the puzzle. Nevertheless, if the reader has understood what the animation aims to convey (and it is really something very simple), it is grasped as a kind of art form, as if it metaphorically conveys facts of our inner experience. Facts that are trivial to intuitively grasp but cannot be discovered as an arrangement of perceptual outputs in the way we are used to behold outputs of the bodily spectrum (senses). If the reader objects that in science it is not admissible to use such metaphorical expressions and we should always be firmly grounded only in what can be beheld as perceptual outputs, they are encouraged to see if they can come up with an expression that conveys what the animation represents, in a way that is perceptually literal. Just because we do not grasp the ‘thickening’ of our intuition of past states as some literal color, sound, or tactile output, it doesn’t mean that we cannot be intuitively conscious of this process, and we are not allowed to express it in some way. We must repeat – this expression does not depict the supposed mechanism that lies behind our experience but expresses how the experience feels from within. This is something that needs to be internalized well because this mode of phenomenological expression will be primary to us.
As we think through the puzzle-solving process, each next first-person ‘frame’ of our mental flow seems to be largely suggested by our present experience of the output and intuitive context. Of all the innumerable states that could become the next state, the fact that we behold the output of the board and live in certain intuitions related to it, seems to greatly narrow down the possibilities. It is as if our mental flow is constrained within a tunnel that continuously bifurcates into two, since there are two possible moves at each step (one of which actually goes back to the previous position).

We are not concerned whether we are somehow ‘free’ when we choose which branch to take next or there are some hidden factors that determine the direction while we experience the illusion of making a choice. Nor do we suggest fantasizing that the not-taken tunnels exist somewhere ‘out there’ in parallel universes1. There are two facts of inner experience to survey from this. First, notice that each successive state is shown as stacking all the previous. This corresponds to our experience. If each state is experienced only as the momentary board configuration, this would correspond to the case where, as we make a move, we immediately forget the previous (as in anterograde amnesia). Normally, we take for granted that as we move through the tunnel, we should remember how we’ve reached our present position, but here this is symbolized explicitly. Thus, we should always remember that the intuitive context within our present state is enriched by the reverberations of all prior states. We are not implying that the past somehow influences our present out of some speculative time dimension of reality. We are fully centered in the here and now. It is the intuitive context of our ever-present flow that enriches as the game state metamorphoses. For this reason, although we presented the flow above as spatial tunnels, it would be better to grasp our flow of existence in its directly given nature – as a continually metamorphosing first-person phenomenological state within which we are always centered. Expressing our intuition about the sequence of metamorphosis as a path or a tunnel is, once again, only an art form. The branch of the tunnel that we have trodden is only a symbol for the recursively updated intuitive context of our ever-present state. Or, otherwise stated, the tunnel is our attempt to decompose our compounded present intuition over a spatial picture. Just like in video feedback (camera capturing its own output on a screen), the past images are not ‘in the past’ but are displayed by the presently illuminated screen pixels, so in our inner experience, when we remember the past, we are illuminating phenomenological pixels in our present based on the compounded intuition.

Second, we should feel how every state metamorphoses into the next based on some intuitive compatibility. For example, in the above example, every next move makes sense because it fits our overall intuition of chess rules. We may say that our present state is like a snowflake kernel that grows by accommodating new water vapor.

There’s a two-way relationship here. On one hand, the way the snowflake grows depends on its present structure. New crystal growth can only occur at the appropriate places, just like a blossom can bloom only where there has been prior vegetative growth. On the other hand, however, the new growth is not completely determined by the already existing structure – the qualities of the incoming vapor, its temperature, humidity, and chemical composition also play a part in what the new growth will look like. With this metaphor we are not implying that the game state builds up as some rigid crystal structure, but only trying to point attention to the dual nature of the process. We can pick many other metaphors that convey this fact, for example, the riverbed is not unitarily shaping the river flow, but the flow also erodes and transforms the riverbed; matter/energy flux doesn’t unitarily tell spacetime how to curve, but spacetime also tells matter/energy how to move, the phonograph needle is not only agitated by the wax groove but the needle can also impress its vibrations into it, and so on. Additionally, we are not trying to suggest that our future states condense from some speculative ‘state-matter’ (as the snowflake condenses from the surrounding vapor), but only to bring attention to this peculiar threshold of becoming – the event horizon that we speak of, which can only be grasped through this dual nature: that the next experiential state cannot be seen as proceeding completely deterministically from the prior, but nor the next state that we push toward can be completely arbitrary.
This simple example can help us better understand the place of thinking in our life. Consider what we do with the chess puzzle – we start by developing a certain intuitive ideal. In this case, it is a very concrete ideal – we seek to experience a mental state where the knight is at the central square. We set that ideal as a background intent, like an intuitive atmosphere that we seek to bring our mental images in resonance with (just like we seek to unfold our operational, tactical, and strategic IO flows within the overarching intuitive plot for winning the game). We begin transforming the mental images of the board according to the rules, as if we seek a path of metamorphosis that will close the gap between the intuition inherent in the momentary state and the background intuition of our goal state. Please note: the intuition of the goal is not ‘in the future’. It is also in the present moment as a kind of intuitive anticipation and guiding principle for our more detailed IO gestures. If we are vigilant, we’ll see that this is the nature of all thinking. When thinking, we seek the mental puzzle piece that will click snugly with the intuitive contextual flow set by the goal. However, it would be better to consider this puzzle piece not simply as a spatial form, but as a ‘clip’ of first-person phenomenal existence – we seek the mental movie segment that fits within an overarching plot, as if to fulfill it.
Thinking seems like something complicated only when we become tangled in mental pipelines that aim to represent it as some mechanism contained entirely in the output field, where we can do no more than picture the rippling output relations. From within our living experience, however, things are much more straightforward. Unless we are simply free-falling through existence, passively dragged by the flow, we always have some background attractor – whether it is something that we intuitively focus on or simply the compulsion of a feeling or a desire. Then, our mental flow is either like a more detailed explication of the attractor (we cast down the general intuition into more detailed mental images) or like an imaginative rehearsal of possible paths of experience that can transform our present flow into the dimly felt flow-shape of the ideal. These mental rehearsals are of the nature of a stream of memory images, except that we try to ‘remember’ something that has not yet happened. Nothing supernatural is implied in this; we’re not saying that we access the future located in some exotic time dimension of reality. When we remember the past, it is as if we gather mental images that fit our presently compounded intuition of existence. Unless we want to lapse into fantasy, we are very diligent in that we summon only images that fit very snugly into our intuitive context. If we do not feel this snug fit, we say, “I’m not sure, I can’t remember exactly.” The flow of thinking is as if trying to fantasize memory images, but in such a way that they still feel more or less in resonance with our compounded intuition of existence. In other words, we strive for our fantasized memories of the future to be ‘realistic’. This doesn’t guarantee that what we rehearse in this way can be realized in the wider output. Our images of the future are only as good as our presently developed intuition of the existential flow. And the same holds for memories. Just because we feel a snug fit between a memory image and our intuition, it is not guaranteed that we’re not mistaken. Maybe we do not take into account certain life events that have compounded our intuitive context in such a way that we get the false impression that a given mental image corresponds to our own experience, while it may simply be something we heard about.
In most cases, these mental rehearsals have an iterative character. It is like exploring a “what if” scenario. This is very clearly experienced in games like chess. Here in the background hovers our ideal – to win the game. Now, of all the possible moves we could make, we are only interested in those that close the gap between our present state and the desired future state. So before we make our next move, we begin mental rehearsals. We imagine a succession of mental images (a branch of the tunnel), whose metamorphosis is constrained by the ruleset. Then we may reach a state that we realize doesn’t fit well with our overall goal of winning. For example, in this rehearsal, we may have left some pieces exposed, giving the opponent an advantage. So we dismantle this stack of memory images, like we collapse a card tower; we backtrack the tunnel, and start over, trying a different fork. Notice that not only the compounding intuition of the currently explored branch of stacking mental images should be retained, but after dismantling each stack, something of it should also remain compounded in our state, if we are not to keep rehearsing branches that we have already explored2. It is quite the same process in all our thinking, except that the ruleset is not that clear. Through our life experiences, we have developed some intuition of what goes together with what. The rules consist of relations with people, how one would react if we do or say so and so, how animals, plants, rocks, and technical appliances behave, what happens if we interact with them, and so on. We keep iterating through such “what if” life scenarios. We build a stack of imagined life events by pipelining them according to our existential intuitions and see whether the resulting movie clip rings in resonance with our ideals and desires. If it doesn’t, we collapse the stack and start a new iteration until we feel satisfied with the resulting imagined state and decide to make it the active flow-curvature within which our bodily will should unfold.
We should really feel how the intuitive rules and the field of their application are not two separate domains of experience. Like the flow and the riverbed, everything that we think, feel, and do immediately compounds in the new game state, which is compatible with corresponding new paths of metamorphosis, and so on. We wouldn’t be solving the chess puzzle if, at some prior point in our flow of metamorphosis, we did not compound the intuition of the knight’s Γ-move. As such, we should feel how, at any momentary point of our existence, we actually have far less control than we often imagine. Most of the willful transformations of our states follow the curvatures of intuitions that we can recall integrating into our existential flow at some point in our lives. There are also curvatures that feel unknown, as if we are pushing into an unexplored territory. Nevertheless, we should also feel how our present intuitive pushing continuously augments the game context. Like building a house, we can’t simply transition from a state of ‘no house’ to one of ‘house’. Instead, we pass through a whole gradient of intermediary states where we tediously lay each brick. Each of these momentary acts seems insignificant compared to the whole endeavor, yet when they are all aligned with the intuitive curvature of our overarching goal of ‘building a house’, then they slowly build up and lead into new states that can themselves accommodate corresponding new states. For example, the flow of experience corresponding to ‘constructing the roof’ only becomes a viable fork in the tunnel if we have guided the game state through experiences of building the walls. These are all childishly simple observations, but it is astounding how often we fail to apply their conclusions to our practical life.
All of this can turn into a very valuable exercise that we can perform at any moment of our daily flow, granted that we at least for a moment snap out of the usual existential free fall. We can pay attention to even the tiniest movements of our body or the thoughts that pass through our mind, and try to feel what is there in our compounded intuitive context that makes them meaningful. For example, we flip a light switch. We can immediately try to feel how this act only makes sense because throughout our life we have seen others do that, and also we have done it countless times. The act is made meaningful through the intuition that relates two outputs – the flipping of the switch and illumination. But we can go even further. We can try to feel how the need for illumination fits in whatever we are presently doing. Maybe we are walking in the basement to get a tool that we need for our tactical garden work. The garden work fits in some way into our strategic life goals. There’s no need to philosophize about any of this. It takes only a split-second to become feelingly aware of these interleaved IO flows. It’s not about explicating them in words but simply to become aware of “I know how this fits in my intent to push toward a certain future state, and I know how everything compounded up until this moment makes this life situation sensible.”
It can be noted how we have gradually shifted the nature of our quest for knowledge. Traditionally, we feel that to know reality is to make a comprehensible picture of it, to construct a replica of its supposed potato pipeline. In that case, all our thinking is absorbed in an IO flow weaving intuitions and mental pictures about reality. Through what we have described so far, however, our thinking comes to feel more and more like an inseparable texture of the actual flow of reality. It is indispensable that we grasp this difference – in the first case, we’re completely absorbed in the IO flow of mental images, which are like the symbolic meaning read out from the display of the Minecraft computer (MC). We forget about the primary flow (of which the MC is woven) and live entirely in the symbolic meaning that it supposedly represents. In that way, our intellectual life feels to be virtual – true reality remains somewhere on the ‘other side’. On the other hand, when we begin to recognize the metamorphosis of our mental states as an intrinsic aspect of the existential flow, we snap out of the virtual flow and live in the primary experiential flow of metamorphosis. This is not to say that our mental images and bodily perceptions are now to be taken as some fundamental building blocks of reality. It’s only about the fact that we can now explore from within our experience how our IO flow is compounded, and how this, in turn, opens corresponding new forks of metamorphosis. Now our thinking process is not one of building a mental pipeline replica of the game process (MC) but of artistically, yet scientifically rigorously, expressing how the primary flow feels like, how we can orient within it and navigate it, and how we recognize the effects of our dim intuitive inputs within the primary output field. In the next part, we’ll see how the experience of this process can become even more focused.
Keynotes:
-----
1 A position held by the Many-Worlds interpretation of quantum mechanics.
2 Another way of looking at this is by imagining that we do not really move back through the tunnels. We always move forward. Collapsing our currently explored mental branch is like moving forward into a new one presenting similar pathways as in a prior junction. However, all states gone through so far are still stacked. In such a metaphor, it is clearer why the intuition of the previously explored forks remains as part of our current path. We’ll elaborate on this in one of the next parts.
