Music can be a rule the player hears
8 min read
By Eduardo Orellana ·
Battle music is the dull version of an adaptive score. The useful version tells you where you are, what you risk, and when a system just changed.
The swell is the least of it
The adaptive score everyone can describe is the dull one. Peaceful strings crossfade into drums when an enemy appears, then fade back when the fight ends. It works, and it says almost nothing. Nintendo has spent decades using music as texture instead: a room, a height, a time of day, each with a few notes that tell you where you are before you read the geometry.
The sharper use is feedback. A puzzle that changes the harmony when a rule becomes true, or a race like the one on Mount Wario where the arrangement tracks the chaos you are actually in, treats the score as a system the player can hear. The artificiality is not a problem. Players already accept that a dungeon has a theme. The failure is a score that only knows two states, safe and not safe, in a game that has more states than that.
What dynamic game music can do beyond combat
A dynamic soundtrack can do far more than swap calm music for battle music. The version everyone knows is the plain one: a peaceful loop crossfades into a tense one when enemies appear, then settles back once the last one falls.
Plenty of games push past that. Red Dead Redemption interweaves stems. Dead Space cuts its orchestral score into reactive fragments. Splinter Cell: Chaos Theory braids layers of Amon Tobin's score into one another as the player is spotted and combat starts.
Danger is only one of the messages music can carry. A score can hand out feedback, turn the atmosphere, make a world feel playful, or tell the player something about the state they are currently in.
Few feedback systems in a game are as flexible as the soundtrack, and few are used as lightly.
How Nintendo uses music as texture
Nintendo treats a piece of music as a texture it can re-dress, holding the tune steady while the arrangement around it changes. Mario and Zelda have been doing this for a long time.
Take the map screen in New Super Mario Bros. U. Every world plays the same melody, but the instrumentation turns over as the player crosses between screens. The tune keeps the map coherent; the instruments give each place its own character.
Skyward Sword runs the same idea through the Skyloft shops, where the tone of the music shifts as the player walks from one storefront to the next. Inside dungeons such as Skyview Temple, a single piece picks up new elements room by room.
Spirit Tracks is full of it too. The train music changes as the train speeds up. In the Spirit Tower, instruments stack up as the player climbs the central staircase, which grows taller as the adventure goes on. By the top floors the climb feels genuinely epic, and the music is doing much of that work.
Small musical touches make play feel alive
Tiny reactive details in a score can make a game feel alive while changing nothing about the rules. The Super Mario Galaxy games are stuffed with them: collectible notes sound out a song as they are gathered, and in one ball-rolling level the tempo rises and falls with the player's speed.
Elsewhere in Mario, bongos come in when he lands on Yoshi. Bowser's endless staircase in Super Mario 64 runs on an auditory illusion. And Luigi hums and whistles over the Luigi's Mansion score depending on how much danger he is in.
New Super Mario Bros. leans on Mickey Mousing, with enemies dancing in time to the beat. No rule changes at all. The world simply reads as toy-like and animated, as though everything on screen can hear the music.
Almost none of this touches the mechanics. What it buys is character and atmosphere. Mario comes across as more playful, Zelda as more grand.
The simple trick behind Mount Wario
Mount Wario in Mario Kart 8 sounds like a live orchestra is following the race, but the mechanism underneath is ordinary crossfading. The score appears to know exactly where the player is: down the mountain, through the cave, between the trees, into the finish.
Here is what actually happens. The track is written as four sections, and the game crossfades between them as the player passes invisible triggers placed along the course.
The result is a cinematic arc that holds whether the player is quick or slow. There is still an opening, a middle and a surge at the line, without pinning anyone to a fixed speed or a fixed timeline.
That is what an adaptive score is good at: making a fixed musical structure feel like it is answering the player.
Adaptive scores go back decades
None of this is new. Monkey Island 2 used LucasArts' iMUSE system to move between musical themes for exploration, jokes and drama.
Woodtick shows it plainly. Walking between rooms turns the music over into each room's local theme, and waking the sleepy pirates drops an accordion into the mix.
Part of the inspiration came from Disneyland rides, where the audio changes naturally as visitors move from scene to scene. A game can borrow the idea and get more control out of it, because the player is not being carried along at a set pace.
Rare worked in the same direction on Banjo-Kazooie, fading music between areas and changing its tone when the player dives underwater.
Turning music into puzzle feedback
Music can tell a player that a puzzle is going the right way. Portal 2 does it by applying effects to the score when the player jumps on blue gel or runs across orange gel, tying the sound to the physical sensation of the movement.
Some test chambers take it further. Puzzle elements sing out as the player switches them on, and steering lasers into their sensors stacks new layers onto the soundtrack.
That is more than a pleasant audio flourish. It is confirmation. The player hears that the path is right, and when a setup collapses and the progress is undone, they hear that too.
So sound carries the positive and the negative signal while a puzzle is being worked out. Games usually hand that job to visual indicators, but audio can deliver the same information with less clutter on the screen.
Using audio to reinforce the player state
A score can also report the condition the player is in right now. Luftrausers re-instruments its song around the parts bolted onto the player's ship, so a build is something you hear as well as something you fly.
Wipeout HD drops a low-pass filter over the background music while the craft is shielded, and the player feels sealed inside something protective.
L.A. Noire fades the soundtrack out when the player strays past the edge of a crime scene, quietly saying there are no more clues to find in that direction.
None of these need a pop-up, a marker or a line of dialogue. The music is the readout.
The artificiality of a score is a strength
A soundtrack never pretended to be real, and that is exactly the license to push it. Go to a tropical island, start a fight, and no war drums boom out of the sky.
Because the music is already an expressive layer rather than a literal simulation, it owes the world no realism. Adaptive audio can be far more inventive than simply getting noisier once the fighting starts.
An action game could give each enemy an instrument in the fight track and pull that instrument out when the enemy dies. A puzzle game could add a phrase for every subsystem solved. A racing game could hang the shape of the music on the geography instead of a timer.
Which of these fits depends on the game, and you find that out by getting the build running and playing it. Interactive audio is one of the things games can do that non-interactive media cannot.
Adaptive music is both feedback and feeling
The strongest adaptive soundtracks do two jobs at once. They make the game feel more alive, and they hand the player information worth having.
That information might be danger, speed, progress, location, customization, puzzle state, the boundary of a clue, or rising emotion. It can arrive loudly, as a new instrument entering the mix, or quietly, as a filter changing the texture of the music.
The argument is not that every score should react constantly. It is that music is design material, not decoration.
It also breaks in a specific way, and the break is worth naming. A reactive score can know more than the player is supposed to. A cue that swells the moment an enemy spawns has announced the ambush before anyone could walk into it. A stealth track that flips to alert before the guard has visibly reacted is reporting the game's internal state rather than the fiction. Metal Gear Solid survives that because the alert music is openly a readout you are meant to play against, and the whole stealth loop is built on watching it decay. A horror game doing the same thing has quietly told you which corridors are safe, and not knowing is the only thing horror has.
A soundtrack that answers context in specific, readable and expressive ways makes a game feel more dynamic without adding one more meter to the screen.
Build it in Flockbay
Do not start by asking for a soundtrack. In the Flockbay app, build one encounter with two states the player can cause, then ask for a loop that changes one layer when the state changes. Play it muted, then with sound. If the muted version is just as readable, the music is not doing a job.
A rhythm game template is the extreme, where the music is the level. The AI rhythm game maker is where to try the milder version, a game that listens.
Keep reading
- Hyrule score stays out of the way
- Juice is how a hit explains itself
- The HUD is part of the design
- Put music at the centre of the play with the AI rhythm game maker
Treat the score as design material in your own game: feedback, atmosphere, and a direct answer to whatever the player just did.
More notes on game design