The Game Loop: Part 2 Interleaved IO flows I
Posted: Mon Dec 29, 2025 7:25 pm
The Game Loop
Part 2
Interleaved IO flows I
Part 2
Interleaved IO flows I
Google Doc version (easier to follow footnotes)
Part 1 Mental Pipelines
Part 2 Interleaved IO Flows I
Part 3 Interleaved IO Flows II
Part 4 In Search of the Fundamental Inputs I
Part 5 In Search of the Fundamental Inputs II
In the previous part we concluded that man has probably gotten a little carried away in his attempt to master the universal game entirely through building a mental replica of its supposed game loop pipeline. In this way, knowingly or unknowingly, we format all inputs and outputs through the palette of the mental game model. Such a model is, for example, the idea that the game state can be modeled as consisting of a spatial container filled with the variables of energy-matter fields. Those are being continuously updated by the game logic, which we call ‘laws of physics’.
On the other extreme we saw the attempt to experience the game output in its untainted purity, without being formatted by our mental pipeline proxy. This, however, goes so far that even the sense of being inwardly active is rejected (the illusion of input). Any sense of conscious input inevitably leads to questions like “What am I? What should I do?” and so on. Seeking answers to these questions is seen as a continuously branching tree that leads right back into the mental pipelines one tried to avoid. Thus, it is decided that the tree should be eliminated right from the seed. This does not suggest that we become a static rock, but it is imagined that all our actions and thoughts should be experienced in the output as happening on their own, driven by the mysterious game process. Some believe that if everyone were to do that, if we stopped interfering with the game flow through the illusion of input, the mysterious game process would ensure peace and harmony.
Now, instead of being an abstract game theoretician or simply lifting our hands off the controls, we’ll try to get back to the basics of our game experience. We need to once again get in the player seat and assume our first-person position within the phenomenal game flow. Even though we use the word ‘flow’, we should in no way imagine something beheld from a third-person perspective, similar to the way we can perceive a river from the side. Instead, we always imply the first-person metamorphosis of experience. This is the fundamental given in the mystery of existence. Our intellectual theorizing about what this existence is made of and how it functions is an aspect of the flow, a kind of mental overlay modulated over the carrier flow of primary experience (and thus, an inseparable part of it). If we, as far as possible, put aside for a moment our Minecraft computers through which we try to simulate the workings of reality, the basic question boils down to: (1) How can I increase my intuitive orientation within the transformations of the game state as known to me in the phenomenal totality of the output and its dynamics; (2) how do my inputs affect the transformations of the state and thus ripple through the output; and (3) what is worthy of becoming the goal of my gameplay? These questions cannot be answered separately – they are deeply intertwined. We can make sense of the output only by continuously interacting with the game, and we can refine inputs only based on the feedback of the output. Finally, only through the expanding intuition of this interaction we may see things in a bigger picture and decide what strategic goals are worthy of pursuit. Whether we live in a dream, a physical Cosmos, the Matrix, or whatever, these basic questions remain. When we say ‘questions,’ we should be clear that we no longer seek merely theoretical answers. It’s no longer about thrusting ourselves into a pipeline of mental potato processing and producing a satisfying Minecraft computer (MC). All knowledge should now be practical, applied knowledge. I may not know what happens behind the scenes when I press a button on the gamepad, but I can investigate how this affects the output and evolve my game strategy accordingly. Now one may immediately object: “But in this way we’ll forever remain on the naive surface of reality. We may find our way only through trial and error. On the other hand, if we develop an understanding of what happens behind the scenes, how the game loop’s pipeline functions, we may be able to master the game in completely new ways, maybe even ‘hack’ it.” This is true, and we do not dispute that a deeper comprehension of the game loop is absolutely needed. However, as it was noted in the previous part, throwing all our effort into sculpting the MC completely dismisses the possibility that we may not yet know the game controls sufficiently. Imagine that you have played a video game for a long time and have gotten decently good at it. Then, one day, you discover a previously unused button on the gamepad that causes the in-game character to jump. A new in-game degree of freedom has been found! Now completely new possibilities open. Game areas previously unreachable can now be explored, they may require completely new concepts and intuitions, and so on.
This example, however, shouldn’t be taken too literally. Doing so gives the impression that we already have more or less a good grasp on the controls of existence – we already hold the gamepad steadily, we know its overall geometry, etc. – but only miss a few details here and there within our already familiar volume of experience. Rather, we should equip ourselves with the humility and patience that we may need to seek the new controls in ways that are presently beyond the palette of our familiar imagination. By the same token, when a baby learns to speak and thus think, it not only finds new buttons on the already familiar controls but awakens to a wholly different mode of self-consciousness. Just as we cannot teach a baby to speak or think by explaining to it what to do (which would presuppose that verbal thinking is already mastered), so we can only gradually awaken to the unsuspected inputs, outputs, and corresponding modes of consciousness through active experimentation in unfamiliar directions. In a certain sense, these secret inputs and outputs will be found to have always been there in the ‘background of existence’, but we need to transform and grow into them in full consciousness. For this reason, we’ll start by exploring certain aspects of the gameplay that may seem obvious and trivial, yet contain nuances that ordinarily go by without clear awareness.

Above, we have depicted three distinct aspects of ordinary gameplay. First, we have our hands. When we focus on this aspect, we can observe how our whole inner process assumes a specific form. When we move our hands and fingers attentively, we live in meaningful patterns of input and output (IO). These patterns form a specific vocabulary of intuitive gestures. We live in the meaning of ‘index finger’, ‘pinkie’, ‘clenching fist’, ‘pointing’, even if we don’t sharply delineate the meaning into concepts and map words to them. The hand-moving IO patterns in themselves have some intuitively recognizable identities. Even if we cannot pinpoint it with intellectual clarity, we feel that there’s something we do differently if we are to move our index finger or pinkie, and we somehow know how to reach into these intuitive controls.
Since we’ll be using the term ‘intuition’ a lot, let’s be clear right from the start that nothing extraordinary is implied in this. The term is not about drawing upon some speculative data layer of reality. Let’s say someone is very clever, and we ask them, “Say, you are so smart – what do you do inside your mind in order to produce such clever thoughts?” They’ll most probably answer, “I don’t know. It all happens intuitively. I’m sure it has something to do with the effort I’ve put into my education, reading, and exercising. Maybe it’s also a good gene; who knows! It’s like asking a heavy-lifter what they do in order to lift that heavy weight. It’s not some smart trick that they can share, and I would immediately be able to do the same. It’s all the gradual buildup that has led them to the state where lifting that weight is a natural possibility. So in the same sense, I’m not in momentary control of my cleverness, but my psychic environment seems to have been so ordered over time that the right relations are the first to spark in my mind.” Thus, when we speak of intuition, we are only pointing at these purely experiential aspects of our psychic life – the fact that a great part of what we think and do feels meaningful, that it follows some logical patterns, yet we cannot encompass it in our intellect as some laid-down pipeline where we can name every cog and conveyor belt. In that sense, this intuition is not to be considered something that comes from some speculative dimension of reality, but is something intrinsic to the experience of the game state. It is the meaningful context of our momentary state. It is like the intuitive bulk of the iceberg beneath the surface that makes our game flow feel meaningfully connected. Moreover, this intuitive orientation is not a synonym for some faculty that always gives the right answer. It all depends on the way the game state has been developed so far1.
Returning to the gameplay aspects, we pass to the next – the game controls. These are operated by our hands2. When we focus on operating the gamepad, the first aspect seems to recede into the background of our attention. Now we live in a different ‘bandwidth’ of the flow of meaningful IO patterns. By using a word like ‘bandwidth’, we do not imply any pseudo-scientific ideas. We can only grasp this if we are willing to do experiments and inner observations. We can take a gamepad (or any other operable object) and first move our fingers on its surface while being completely focused on the sensations of the fingers themselves and the willing of their movements. Then we can switch attention to the object and operate its actionable elements. Try to observe how our inner cognitive vocabulary shifts. Now our inner process morphs through patterns like ‘press button A’, ‘push stick to the left’, ‘pull trigger halfway’, and so on. It is these completely experiential ‘superimposed flows’ of meaningful IO patterns that we point attention to. We say ‘superimposed’, because while we are engaged in the controller IO flow, our hand flow is still there, even if it is not at our focus. When we use such words (like bandwidth or superimposed), they shouldn’t hang in the air as abstractions but should point right back to our direct experience. And clearly, there is something the words can point to only if we have tried to experiment and come to know the experiential reality that the words symbolize.
Finally, we have the aspect of the gameplay itself. Here, once again, we must attune to a different flow of meaningful IO patterns. Now our intuitive vocabulary consists of ‘move left’, ‘jump’, ‘reload weapon’, ‘hide’, and so on. Just like a language, these intuitive patterns exist in certain relations – they flow into each other, one evokes another, some make intuitive sense when put in sequence, others contradict each other, and so on. All of this constitutes our overall intuitive grasp of the game, its rules, and how certain inputs transform the output representation of the game state. When we learn a new game, we first need to live in both the gamepad and gameplay intuitive flows. We first become familiar with what each button and stick does. In a sense, we gradually cross-reference the two flows. If we are getting our hands on an unfamiliar controller, we would have to do the same also for the first and second flow – we’ll have to learn how to use our hands to operate the unfamiliar control elements. As this cross-referencing becomes better established, we can gradually live primarily in the game’s intuitive flow. We no longer think, “Oh, what did I need to do for jumping?” but instead, we provide the intuitive input ‘jump’ and our hands carry out the rest almost automatically.
Readers who do not have much experience with games and thus cannot fully relate to the above examples may find the exact same three aspects in any other field, such as driving. Here we can once again distinguish the superimposed flows of intuitive IO – we use our hands and feet with their biological vocabulary, we operate the steering wheel and all other controls with vocabulary such as ‘turn the wheel’, ‘step on the pedal’, and finally we have the intuitive flow of the driving experience where we have a far more complicated IO vocabulary and relations such as ‘turning’, ‘accelerating’, ‘watching for traffic’, ‘assessing the road condition’, etc.
There are a few important observations that we can make from this. First, as previously mentioned, we can recognize how we can become absorbed or fully attuned to a certain intuitive IO flow. This is actually a sought-after experience in the context of video games. One usually seeks to be immersed in the flow of symbolic meaning. This is even more true in virtual reality games (VR), where it is desirable to completely forget that we are holding controls and instead live in the intuitive sense of our in-game body.
Second, we should nevertheless be aware that the other intuitive IO flows are still present. We can liken the process of being immersed in a particular flow to attunement to certain radio frequencies. Flows of other frequencies are still present, interleaved with the one we have heightened awareness of, but feel as receded in the background. Again, speaking of frequencies doesn’t suggest any metaphysical elements. We should not imagine the flows as ‘made of’ some speculative vibrating energies. These are only artistic words expressing the facts of our inner experience. As an example, at any point in the gameplay, we can ‘switch frequencies’ by becoming attentive to the flow of our interaction with the controls. This usually breaks the immersion, especially in VR, but in certain cases it might be desirable, for example, in racing games where we use a physical racing wheel and pedals. Here, feeling our hands on the wheel enhances the experience.
We should very clearly feel how in different cases we may have opposite goals. Sometimes we deliberately seek to be locked within a certain intuitive IO flow. This is usually when becoming sensitive to other flows feels dissonant. Dissonance here means that two or more streams we try to encompass in our conscious experience cannot be held together coherently; they do not ‘sound well’ together. For example, if we are driving and we talk with a passenger, usually the two flows can’t be experienced as a coherent whole. We find ourselves ‘task switching’ between the two. If we are driving on the highway in light traffic, the driving flow doesn’t demand much attention, and we can become so immersed in the conversation flow that we do not even remember how we have driven through miles and miles. However, if we concentrate on our driving experience, we may find that it is possible to cohere several different intuitive flows. The only way this can be achieved is if the different flows are musically compatible, so to speak. When held together, they should ‘sound well’; they form a holistic experience. Then we can be fully conscious of the sensations in our hands, how they turn the wheel, how this affects the car, how the car’s movement is within the IO context of the road conditions and traffic, how this movement is meaningfully embedded in the flow of our intent to go from A to B. In this case, the ‘intersection’ of all flows is in itself experienced as a symphonic temporal flow. Imagine a room where several conversations are held at the same time. In isolation, each of the conversations may be experienced through a meaningful IO flow, but their total interference sounds like the noise in a busy coffeehouse. In such a case we may find ourselves snapping our attention to one conversation, then switching to another, but being unable to grasp them all at once. If the voices, however, sing together in a choir, then the intersection of all their flows can itself be experienced as a coherent flow.
Third, we can observe that within a single flow, the relations between inputs and outputs may have different degrees of correlation. For example, when we will the movements of our fingers, input (the willing impulses) and output (the perceptions of our hands) are mostly ‘in phase’. When we switch to the gamepad level, the flow is subject to additional constraints. For example, a stuck button or a glitchy stick results in output that may not coincide very well with our intuitive input. Things become even more complicated at the level of gameplay. Now, if the game is challenging, it is the norm that the output constantly surprises us, as it differs wildly from our intuitive input and expectations. This is illustrated in the drawing by the fact that there’s a greater gap between the higher intuitive inputs and the corresponding outputs.
When we see things in this aspect, we can develop a kind of sense of how intimately our inputs are reflected in the output. The further ‘out’ we go with our inputs, the more complexly ‘entangled’ the environment we try to influence is. When we play a game, the output is mostly shaped by the gaming device and the game algorithm. If we are a manager of a company, our inputs meet the interference of many other human and natural flows. If we are an emperor, that entangled sphere is even greater, and thus, it is even more likely that our ruling inputs could be out of phase with the output.
We can recognize that up to the level of our bodily movements, we feel more or less inwardly related to the output. From that point onward, however, it feels that any further output only represents the rippling of our bodily input through the game state. In other words, even though we may be immersed in the game flow and intuitively will ‘jump’, our inner activity reaches only our fingers. From thence, it trickles and reverberates further in the World flow, reflecting in outputs that we can no longer feel related to our intuitive inputs in the exact same way as we can for our fingers. Thus, even though it feels that the in-game character jumps completely in-phase with our intuitive input ‘jump’, the output is not influenced in the same inner manner as it happens for our fingers. Nevertheless, it feels as if our intuitive IO flow is spread out and seeks the reflections of its inputs in the wider output. This is also seen in the emperor example. Our inputs only reach the bounds of our skin and larynx, yet they continue to ripple through the game state, and eventually, we recognize our inputs reflected in the output of World happenings. It is easy to feel the thrill and temptation of such an experience of power – to see our personal intuitive inputs rippling and being reflected in the World-output. We can also see how complicatedly entangled the world state that we aim to influence in this way is. As an emperor, we may be living in the IO flow woven of intuitive patterns like ‘conquering a nation’, ‘raising taxes’, and we may as well see these inputs faithfully reflected in the output, at least before we get stabbed in the back. As we’ll see later, we cannot draw an absolute boundary between outputs that directly reflect our intuitive inputs, such as hand movements, and those that can only manifest through additional rippling through the game state. Our fingers can also ‘rebel’ and refuse to ‘take orders’. So our intuitive inputs are also not reflected in bodily output unconditionally. Even our perceived finger movements are, in a sense, the rippling reverberations of more intimate will-inputs. It’s only that as long as we are healthy, we are used to always experiencing them in phase.
What we have developed so far allows us to make the following observations:
- We can recognize that usually we experience a flow of intuitive IO patterns that form a more or less coherent ‘language’. Various arrangements of successive patterns make greater or lesser intuitive sense when they are imposed over the intuition of our compounded memories of similar past experiences. The flow of IO patterns that ring in resonance with past experiences feels logically consonant. Those that clash with past experiences ring dissonantly; they feel illogical.
- We can recognize that superimposed with this flow are also many other flows. If we live through the IO flow of driving, but the hand-movements flow is absent, we are only imagining that we drive, but not doing it in practice. When the flows are dissimilar, our experiences switch from one to another, similar to how, when we learn to play piano, we can’t help but lose control of one hand when we focus on the other. It is, however, possible to experience flows simultaneously, as long as we are able to cohere them such that their intersection is in itself a coherent flow. Flows exist in contextual relations. For example, the driving IO patterns of ‘turning’ contextualize many other patterns within the operational flow, such as ‘turning the wheel’, ‘pressing the brake pedal’, etc. When these contextual flows are musically coherent with each other, it is possible to experience their total intersection as a unitary, symphonic IO flow.
- We can recognize a kind of gradation of outcomes depending on how deeply in the game state we strive to perceive our inputs reflected. The outputs closer to our bodily space are usually easier to keep in phase with our intuitive inputs. The further out into the game state we try to reach, the more complexly entangled the environment through which our inputs ripple, and the easier for our intuitive inputs to be out of phase with the outputs, or even be completely dissipated.
It is important to realize that there’s a difference between living through a given IO flow and thinking about it. This is easy to grasp if we try to add a couple of two-digit numbers in our mind. While we are performing the addition, our mental flow turns into a pipeline that transforms the quantifiable mental images in specific ways. When we try to reflect on this process, the calculation ceases. Now, our mental flow takes the shape of a different pipeline – one that processes the memory images of our calculating experience. Some may say that they can drive and at the same time philosophize about the driving process. This, however, is only possible when our driving skills are so developed that they can flow with minimum input. If an unexpected traffic situation arises, our reflection about driving quickly ceases, and we are fully immersed in the driving flow.
It’s worth appreciating that everything we have developed so far requires nothing more than sound observation of the first-person IO process. What we have discovered in this way remains simple facts of experience, invariant of how exactly the game loop might be ‘implemented’. With this, we have laid down some groundwork that will allow us to continue in the next parts.
Keynotes:
-----
1 Described like this, intuition sounds synonymous with implicit knowing accumulated through past experiences. In the later parts we’ll see that through this intuition we also live in certain knowing of the momentary future direction of the flow of becoming, but let’s not get ahead of ourselves. For now, intuition understood as integration of past experience is sufficient.
2 Of course, there could be many kinds of game inputs, utilizing all parts of the body, speech, ECG, EEG, and so on, but for the sake of illustration, we’ll use only the hands.