Author SHA1 Message Date
cdnutterandClaude Opus 5.5 b0dba777f9 ios 1.0.10: shuffle/repeat on Now Playing, playback speed
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 11:21:32 -07:00
cdnutterandClaude Opus 5.5 5b767cacc2 README: iOS has the EQ too
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 10:50:22 -07:00
cdnutterandClaude Opus 5.5 bba92967ea README: iOS section, stem playlists, tighter layout
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 10:50:14 -07:00
cdnutterandClaude Opus 5.5 068f2309b4 iOS: source.json for 1.0.9
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 10:28:27 -07:00
8 changed files with 292 additions and 426 deletions

No files matched your search

+187 -418
View File
@@ -2,117 +2,66 @@
# Stemify # Stemify
**Your whole music library, taken apart and put back together however you like.** Stemify splits every song in your Plex music library into stems (vocals, drums, bass, guitar, piano and other) and gives you players that mix them live. Mute the vocals and sing along, solo the bass to learn a part, or save an instrumental of a song and have it play that way every time.
Ever wanted to hear "Carry On Wayward Son" without the vocals so you can belt it out yourself? Or It runs on iPhone (with CarPlay), Android (with Android Auto) and Linux desktop. A GPU on your server does the separating in the background.
mute the drums on a song to figure out what the bass player is actually doing back there? Stemify
splits every song in your library into its separate parts (vocals, drums, bass, guitar, piano and
"other"), keeps them organised next to your music, and gives you players that let you mix them
live, on your phone, in your car, and on your desktop.
It's a home-grown, slightly over-engineered love letter to karaoke, music nerdery and the joy of - [How it works](#how-it-works)
pressing the "mute vocals" button at exactly the wrong moment. - [Apps](#apps)
- [Setup](#setup)
--- - [iOS](#ios)
- [Android](#android)
## Contents - [Desktop](#desktop)
- [Stem Now](#stem-now)
- [The big picture](#the-big-picture) - [Reference](#reference)
- [What you get](#what-you-get)
- [Setting it up](#setting-it-up)
- [1. The server: stemd and stemserve](#1-the-server-stemd-and-stemserve)
- [2. The Android app](#2-the-android-app)
- [3. The desktop apps (optional)](#3-the-desktop-apps-optional)
- [Using the Android app](#using-the-android-app)
- [Stem Now: skipping the line](#stem-now-skipping-the-line)
- [The Equalizer](#the-equalizer)
- [Android Auto](#android-auto)
- [iOS and CarPlay](#ios-and-carplay)
- [The desktop apps](#the-desktop-apps)
- [Separation models](#separation-models)
- [How the pieces find each other](#how-the-pieces-find-each-other)
- [stemserve API](#stemserve-api)
- [Building and testing](#building-and-testing) - [Building and testing](#building-and-testing)
- [Repo tour](#repo-tour) - [Troubleshooting](#troubleshooting)
- [Troubleshooting and FAQ](#troubleshooting-and-faq) - [Credits and license](#credits)
- [Credits](#credits)
- [License](#license)
--- ## How it works
## The big picture The stems folder mirrors the music folder. If a song lives at `Kansas/Leftoverture/01 Carry On.flac`, its stems live in `Stems/Kansas/Leftoverture/01 Carry On/`.
There are three moving parts, and they all agree on one simple idea: **the stems folder mirrors
the music folder.** If your song lives at `Kansas/Leftoverture/01 Carry On.flac`, its stems live at
`Stems/Kansas/Leftoverture/01 Carry On/`. That's it. That's the whole trick.
``` ```
┌──────────────────────────── your server (unraid, in our case) ───────────────────────────┐ your server
│ │ Music/ ──▶ stemd (GPU) ──▶ Stems/ ──▶ stemserve :8765 ──▶ phone, car, desktop
│ Music/ ──read──▶ stemd (GPU) ──writes──▶ Stems/ ──read──▶ stemserve (:8765) ─────┼──▶ phone, car, desktop ▲ │
│ ▲ ▲ │ │ └──── Stem Now requests ◀───┘
│ │ └──────── "Stem Now" requests ◀──────────────┘ │ Plex Media Server :32400 ───────────────────────────────▶ library, artwork, playlists
│ Plex Media Server (:32400) ──────────────────────────────────────────────────────────────┼──▶ library, artwork, playlists
└───────────────────────────────────────────────────────────────────────────────────────────┘
``` ```
- **stemd** sits on the server and chews through your library on the GPU, one song at a time, - **stemd** works through the library on the GPU, one song at a time, and rescans every 30 minutes for new music.
forever. New album? It notices within half an hour and gets to work. - **stemserve** serves the finished stems over HTTP with range requests, waveforms and optional Opus transcodes.
- **stemserve** hands the finished stems to your devices over HTTP, with seeking, waveforms and - **Plex** handles the library, metadata, artwork and playlists.
optional Opus transcodes so your phone storage doesn't cry. - **The apps** play stems when a song has them and fall back to the original file when it doesn't, so everything plays.
- **Plex** stays in charge of what it's good at: your library, metadata, artwork and playlists.
- **The apps** (Android, Android Auto, and two desktop apps) play everything, and quietly fall back
to the original file for any song that hasn't been separated yet. Nothing is ever unplayable.
--- ## Apps
## What you get | | iOS | Android | Desktop player |
|---|---|---|---|
| Per-stem faders, mute, solo, mix presets | yes | yes | yes |
| Waveform seek bar, live stem meters | yes | yes | |
| Saved mix per song | yes | | |
| Karaoke mode with synced lyrics | yes | | |
| Stem playlists (a mix per song) | yes | | |
| Plex playlists | yes | yes | yes |
| Downloads for offline | yes | yes | |
| 10-band and parametric EQ, AutoEQ import | yes | yes | |
| Car | CarPlay | Android Auto | |
| Voice | Siri | Google Assistant | |
| Stem Now | yes | yes | |
**On your phone (Android)** Mix presets are Full, Karaoke, A Cappella, No Drums, Rhythm, No Guitar and No Bass.
- A Plex music player with per-stem faders, mute and solo, and one-tap mixes: Full, Karaoke,
A Cappella, No Drums, Rhythm, No Guitar, No Bass.
- A Plexamp-style waveform seek bar that doubles as a volume control (drag sideways to seek, up and
down for volume). The waveform is scaled to each song, so you can actually see the quiet verse
and the big chorus.
- Live level meters for every stem, updated every frame and in sync with what you hear.
- A 10-band graphic EQ **plus** Equalizer APO-style parametric filters, with per-device profiles
that switch automatically when you plug in headphones or connect to Bluetooth.
- Paste in an AutoEQ correction for your headphones and you're done.
- Downloads for offline listening, stems and all.
- Gapless playback, a proper queue, playlists (create, reorder, rename), search, and "On This
Day" album birthdays on the home screen.
- "Stem Now": jump any song, album, artist or playlist to the front of the separation queue.
- An iOS-flavoured look in Black, Dark or White, at whatever refresh rate your panel can manage.
**In your car (Android Auto)** ## Setup
- A browse tree built for a rotary knob and no touchscreen, with voice search, a Vocals on/off
button and a Mix button right next to play/pause.
**On your desktop (Linux)** Set up the server first, then the apps. The examples use Unraid paths and `192.168.86.2` for the server; use your own.
- **Stemify (the separator)**: drag a song onto the window, get stems out the other side, preview them in sync,
export them. Material layout meets Windows 7 Aero glass, running at 240 Hz because why not.
- **Stemify Player**: your Plex library and its stems, with full mixing... dressed up as
Microsoft Excel 2016. Yes, really. Your boss will think you're working on the quarterly numbers.
**On the server** ### Server
- **stemd** separates everything automatically with BS-RoFormer SW (6 stems) on an NVIDIA GPU,
politely, at low priority, sharing the card with Plex transcodes.
- **stemserve** is one Python file using only the standard library. ffmpeg is optional.
--- You need Docker, and an NVIDIA GPU for stemd (on Unraid, install the Nvidia-Driver plugin). A CPU build exists for testing, but it's far too slow for a whole library.
## Setting it up Make the folders, owned by `99:100` (Unraid's nobody:users):
The recommended order is server first, then phone, then (if you like) desktop. The examples below
use unraid paths and the addresses from the original setup (`192.168.86.2`). Swap in your own.
### 1. The server: stemd and stemserve
You need Docker, and for stemd an NVIDIA GPU (on unraid, install the **Nvidia-Driver** plugin from
the Apps tab). A CPU-only build exists for testing, but separating a whole library on a CPU is a
good way to celebrate several birthdays while you wait.
**Folders first** (owned by `99:100`, unraid's nobody:users):
```sh ```sh
mkdir -p /mnt/user/appdata/stemserve/cache \ mkdir -p /mnt/user/appdata/stemserve/cache \
@@ -121,8 +70,7 @@ mkdir -p /mnt/user/appdata/stemserve/cache \
chown -R 99:100 /mnt/user/appdata/stemserve /mnt/user/appdata/stemd chown -R 99:100 /mnt/user/appdata/stemserve /mnt/user/appdata/stemd
``` ```
**stemd** builds from the repo root because it borrows the `stemify` package. Copy the repo (or **stemd** builds from the repo root because it uses the `stemify` package. Copy the repo (at least `stemify/`, `server/` and `.dockerignore`) to `/mnt/user/appdata/stemd/src`, then:
at least `stemify/`, `server/` and `.dockerignore`) to `/mnt/user/appdata/stemd/src`, then:
```sh ```sh
docker build -f /mnt/user/appdata/stemd/src/server/stemd.Dockerfile -t stemd /mnt/user/appdata/stemd/src docker build -f /mnt/user/appdata/stemd/src/server/stemd.Dockerfile -t stemd /mnt/user/appdata/stemd/src
@@ -133,21 +81,11 @@ docker run -d --name stemd --restart unless-stopped --stop-timeout 60 \
-v /mnt/user/appdata/stemd/models:/models \ -v /mnt/user/appdata/stemd/models:/models \
-v /mnt/user/appdata/stemd/state:/state \ -v /mnt/user/appdata/stemd/state:/state \
stemd stemd
docker logs -f stemd
``` ```
The first song downloads the model (about 700 MB). After that the log reads like a very calm The first song downloads the model (about 700 MB). After that the log shows what's left, what it's on, and how fast it's going.
sports commentary: how many tracks are left, which one it's on, and how many times faster than
realtime it went.
**stemserve** is tiny. Copy the `server/` folder to `/mnt/user/appdata/stemserve` and either use **stemserve** is one Python file using only the standard library. Copy `server/` to `/mnt/user/appdata/stemserve` and run `docker compose up -d --build` there, or by hand:
the included compose file:
```sh
cd /mnt/user/appdata/stemserve && docker compose up -d --build
```
or run it by hand:
```sh ```sh
docker build -t stemserve /mnt/user/appdata/stemserve docker build -t stemserve /mnt/user/appdata/stemserve
@@ -158,433 +96,264 @@ docker run -d --name stemserve --restart unless-stopped -p 8765:8765 \
stemserve stemserve
``` ```
Check it from any machine on your network: `curl http://192.168.86.2:8765/api/info` should return JSON with a track count.
```sh To update, copy the new files, rebuild, `docker rm -f` the container and run it again. Everything that matters lives in the mounted folders. Update stemd before stemserve.
curl http://192.168.86.2:8765/api/info
```
If you see a happy little JSON blob with a track count, you're in business.
<details> <details>
<summary><b>Server settings (environment variables)</b></summary> <summary>Server environment variables</summary>
**stemd** **stemd**
| Variable | Default | What it does | | Variable | Default | What it does |
|---|---|---| |---|---|---|
| `MUSIC_DIR` | `/music` | Your music library (read-only is fine) | | `MUSIC_DIR` | `/music` | Music library (read-only is fine) |
| `STEMS_DIR` | `/stems` | Where stems go | | `STEMS_DIR` | `/stems` | Where stems go |
| `STATE_DIR` | `/state` | The failed-track list lives here | | `STATE_DIR` | `/state` | Holds the failed-track list |
| `QUEUE_DIR` | `STATE_DIR/queue` | Where "Stem Now" requests arrive | | `QUEUE_DIR` | `STATE_DIR/queue` | Where Stem Now requests arrive |
| `MODELS_DIR` | `/models` | Model weights, downloaded on first use | | `MODELS_DIR` | `/models` | Model weights, downloaded on first use |
| `MODEL` | `roformer_bs_sw` | Any model id from [the table below](#separation-models) | | `MODEL` | `roformer_bs_sw` | Any id from [the model table](#separation-models) |
| `DEVICE` | `cuda` | `cuda`, `cuda:N` or `cpu` | | `DEVICE` | `cuda` | `cuda`, `cuda:N` or `cpu` |
| `RESCAN_MIN` | `30` | Minutes between library scans once it's caught up | | `RESCAN_MIN` | `30` | Minutes between library scans once caught up |
| `FP16` | `1` | Half precision on the GPU (`0` for full fp32) | | `FP16` | `1` | Half precision on the GPU (`0` for fp32) |
| `OVERLAP`, `SEGMENT`, `SHIFTS` | `0.25`, `0`, `0` | Separation quality knobs, same as the desktop app | | `OVERLAP`, `SEGMENT`, `SHIFTS` | `0.25`, `0`, `0` | Separation quality, same as the desktop app |
`docker build --build-arg TORCH_INDEX=cpu ...` makes a small GPU-less image for testing. `docker build --build-arg TORCH_INDEX=cpu ...` makes a small CPU-only image.
**stemserve** **stemserve**
| Variable | Default | What it does | | Variable | Default | What it does |
|---|---|---| |---|---|---|
| `STEMS_DIR` | `/stems` | The stems folder | | `STEMS_DIR` | `/stems` | The stems folder |
| `CACHE_DIR` | `/cache` | Opus transcodes and waveforms (safe to delete any time) | | `CACHE_DIR` | `/cache` | Opus transcodes and waveforms (safe to delete) |
| `QUEUE_DIR` | `/queue` | stemd's "Stem Now" folder, shared with it | | `QUEUE_DIR` | `/queue` | stemd's Stem Now folder, shared with it |
| `PORT` | `8765` | Listen port | | `PORT` | `8765` | Listen port |
| `TOKEN` | empty | If set, every request needs `X-Stem-Token` or `?token=` | | `TOKEN` | empty | If set, requests need `X-Stem-Token` or `?token=` |
| `INDEX_TTL` | `30` | Seconds between rescans of the stems folder | | `INDEX_TTL` | `30` | Seconds between rescans of the stems folder |
</details> </details>
**Updating later:** copy the new files over, rebuild the image, `docker rm -f` the container, and ### Connecting an app
run it again. Your stems, models and settings live in the mounted folders, so nothing is lost.
Update stemd before stemserve: if you separated songs before the project was called Stemify,
stemd renames their old done-markers on its first start so nothing gets separated twice.
### 2. The Android app Every app asks for the same two things:
Built for (and lovingly tested on) a OnePlus 15, but any recent Android phone should be happy. 1. **Plex:** sign in with the 4-character code at [plex.tv/link](https://plex.tv/link) and pick your music library.
2. **Stem server:** in Settings, enter your stemserve address. It should say Online with a song count.
1. Grab `Stemify.apk` from the Releases page, or [build it yourself](#building-and-testing), The apps check stemserve for newly separated songs every minute, so the library fills in as stemd works.
then sideload it:
```sh
adb install -r Stemify.apk
```
2. Open it and go to **Library → Connect** (or Settings → Plex). Enter the 4-character code at
[plex.tv/link](https://plex.tv/link) and pick your music library.
3. Visit **Settings → Stem Server** and point it at your stemserve. It should say "Online" with a
song count. (The default address is `http://192.168.86.2:8765`, which is almost certainly not
yours.)
The app checks stemserve for freshly separated songs every minute, so your library slowly "lights ## iOS
up" as stemd works through it.
### 3. The desktop apps (optional) A SwiftUI app for iOS 17 or newer, with CarPlay and Siri ("play Paranoid in Stemify").
Linux, Python 3.12 and [uv](https://docs.astral.sh/uv/). The default setup uses PyTorch for ROCm ### Install
(AMD GPUs, developed on an RX 9070 XT). NVIDIA and CPU work too if you point the torch index
elsewhere in `pyproject.toml`.
```sh Grab `stemify-<version>.ipa` from [Releases](https://git.iamchrisama.com/cdnutter/stemify/releases) and sideload it with AltStore, SideStore, Sideloadly or Feather. To get updates in AltStore, SideStore or Feather, add this source:
uv sync
uv run stemify # the drag-and-drop separator ```
uv run stemify-player # the Excel-shaped music player https://git.iamchrisama.com/cdnutter/stemify/raw/branch/main/ios/source.json
./scripts/install-desktop.sh # adds both to your app grid ("--uninstall" removes them)
``` ```
--- CarPlay and Siri need the `carplay-audio` and `siri` entitlements, which a free Apple ID can't sign. On a free sideload the app works on the phone but not in CarPlay or Siri. A paid developer account covers Siri; CarPlay audio also needs Apple to approve the entitlement for your team.
## Using the Android app ### Using it
**Tabs:** Library, Playlists, Search, Downloads and Settings. - **Mixer:** on Now Playing, under the waveform. Tap **Save** to keep a mix for that song; it comes back every time the song plays.
- **Karaoke:** the mic button mutes vocals on every song and shows synced lyrics from [LRCLIB](https://lrclib.net). Tap a line to jump to it. Vocals can be On, Soft or Off, and Soft has a slider for how quiet.
- **Playlists:** the Playlists tab switches between Plex and Stem.
- Plex playlists sync with Plex and Plexamp.
- Stem playlists stay on the phone, and each song in them has its own mix, so one playlist can hold an instrumental of one song and an a cappella of the next.
- Copy any Plex playlist to a stem playlist from its menu.
- **Add to Playlist:** hold any song, album, artist or playlist. One sheet covers both kinds: pick Plex or Stem, pick the mix for stem playlists, then tap a playlist or make a new one right there.
- **Sorting:** artists, albums, songs and playlists sort like Plexamp. Songs has a shuffle-everything button.
- **Hold anything** for Add to Front or End of Queue, Download, Add to Playlist and Stem Now.
- **Equalizer:** same graphic EQ, parametric filters and APO/AutoEQ import as [Android](#equalizer).
**Stems are the norm, so the exceptions are what's marked.** Songs without stems yet say ## Android
**NO STEMS**, and albums and artists say **NO STEMS** or something like **7/10 STEMS** until
they're done. Those songs still play, just from the original file.
**Hold anything** (a song, album, artist or playlist) for: Kotlin and Jetpack Compose, built and tested on a OnePlus 15. Grab `Stemify.apk` from Releases (or [build it](#building-and-testing)) and `adb install -r Stemify.apk`.
- **Add to Front of Queue** / **Add to End of Queue** ### Using it
- **Download** (or **Remove Download**)
- **Add to Playlist** (playlists can even go into other playlists)
- **Stem Now**, while any of it lacks stems
**The Now Playing screen** has the waveform seek bar, the mixer (faders, mute, solo, mix presets, - **Tabs:** Library, Playlists, Search, Downloads and Settings.
meters, master volume) and the queue. Your mix can carry over from song to song or reset each - **Badges:** songs without stems yet say NO STEMS, and albums and artists show NO STEMS or a count like 7/10 STEMS. They still play from the original file.
time, your choice. - **Now Playing:** waveform seek bar (drag sideways to seek, up and down for volume), mixer, meters and queue. Your mix can carry over between songs or reset.
- **Stem Quality:** lossless FLAC, or Opus at a bitrate you choose (about an eighth of the size, transcoded and cached on the server).
- **Streaming** needs your home network, since Plex and stemserve are plain HTTP on the LAN. Downloads and already-streamed songs play anywhere.
**Downloads** are proper offline copies: every stem fully fetched (or the original file for songs ### Equalizer
without stems). Sort by download order, artist or release date.
**Stem Quality** decides how stems travel from the server: lossless FLAC, or Opus at a bitrate of Settings → Equalizer has two parts.
your choosing, which takes roughly an eighth of the space and is transcoded and cached on the
server.
**Streaming** needs your home network (Plex and stemserve are plain HTTP on the LAN). Anything - **Graphic EQ:** ten bands from 31 Hz to 16 kHz, with presets like Bass Booster, Late Night and Vocal Booster.
you've downloaded or already streamed plays anywhere. - **Parametric filters**, modeled on [Equalizer APO](https://sourceforge.net/projects/equalizerapo/): Peak, Low/High Shelf, Low/High Pass (6 to 48 dB/oct), Band Pass, Notch and All Pass. Each has frequency, gain and Q, works on both channels or one, and can be toggled on its own. Drag the handle on the curve or tap a value to type it.
--- To correct headphones, copy a `ParametricEQ.txt` from [AutoEQ](https://github.com/jaakkopasanen/AutoEq) and choose **••• → Paste APO Config** on the Filters page. **Copy as APO Config** goes the other way.
## Stem Now: skipping the line Profiles are tied to outputs (speaker, wired, each Bluetooth device, USB DACs) and switch automatically. Each has its own preamp, and anti-clipping adds just enough cut to keep the loudest point of the curve at 0 dBFS. A limiter on the master bus catches the rest.
stemd works through your library on its own, but a big library takes days. If you're desperate to ### Android Auto
karaoke your way through an album tonight, hold it and choose **Stem Now**.
Here's what happens: Built for a 2016 Mazda MX-5 with Mazda Connect: 800×480, no touch, knob and wheel buttons only.
1. The app sends the songs that still lack stems to stemserve. - Tabs for Playlists, Albums, Artists and Downloads (Downloads first when you're away from home).
2. stemserve drops a little request file into stemd's queue folder. - Every song list starts with Shuffle all, and lists over 40 items split into A to Z folders.
3. stemd finishes the song it's on, then does yours next, ahead of everything else. If it was - Now Playing has a Vocals on/off button and a Mix button that cycles presets. The mix shows on the artist line, like "Black Sabbath · Karaoke".
idle, it starts within about 5 seconds. - Voice: "play Paranoid on Stemify" works for playlists, artists, albums and songs.
4. About a minute after each song finishes, the app notices and plays it with stems from then on. - Away from home it notices the server is gone and only lists songs that will play.
Requests are handled oldest first and survive restarts. stemd matches the paths Plex reports to Android Auto hides sideloaded apps until you allow them: in the phone's Android Auto settings, tap Version ten times, then ⋮ → Developer settings → Unknown sources.
files in its own music folder by their artist/album/file tail, so it doesn't matter that Plex and
stemd see the library under different mount points. Songs that failed before (corrupt files, or
anything over 40 minutes) are skipped; delete `state/failed.json` to give them all another shot.
--- To test without a car, start the head unit server from Auto's developer settings, then:
## The Equalizer
Find it in **Settings → Equalizer**. It's two equalizers wearing one trench coat.
**The graphic EQ** has ten octave bands from 31 Hz to 16 kHz, a response curve, and a pile of
presets borrowed in spirit from iOS (Bass Booster, Late Night, Vocal Booster and friends).
**Parametric Filters** are modelled on [Equalizer APO](https://sourceforge.net/projects/equalizerapo/):
| Type | What it's for |
|---|---|
| Peak | Boost or cut around one frequency |
| Low Shelf / High Shelf | Tilt everything below or above a frequency |
| Low Pass / High Pass | Roll off the top or bottom, at 6, 12, 24, 36 or 48 dB per octave |
| Band Pass | Keep only a band |
| Notch | Surgically remove one frequency (hello, 60 Hz hum) |
| All Pass | Shift phase without changing level, for the true connoisseur |
Every filter has frequency, gain and Q, can apply to **both channels, or just left or right**,
and can be switched off on its own to compare. Drag a filter's handle on its curve (sideways for
frequency, up and down for gain), use the sliders, or tap any value to type it in.
**Headphone corrections in two taps:** copy a `ParametricEQ.txt` from
[AutoEQ](https://github.com/jaakkopasanen/AutoEq) for your headphones, then on the Filters page
choose **••• → Paste APO Config**. You can also **Copy as APO Config** to take your settings to a
PC.
**Profiles** link to output devices: the phone speaker, wired headphones, each Bluetooth headset,
USB DACs. Plug something in and its profile switches on automatically, or pick one by hand.
**Preamp and anti-clipping:** each profile has its own manual preamp, and the anti-clipping switch
adds just enough extra cut that a full-scale signal at the curve's loudest point still peaks at
0 dBFS. A limiter on the master bus catches anything else, so cranking the bass won't make things
crackle.
---
## Android Auto
Designed for a 2016 Mazda MX-5 with the Mazda Connect retrofit: an 800×480 screen with touch
disabled, driven entirely by the commander knob and the steering wheel buttons. If it works there,
it'll work in your car.
- **Four tabs:** Playlists, Albums, Artists, Downloads (Downloads comes first when you're away
from home).
- **Shallow and short:** every song list starts with **Shuffle all**, and anything longer than 40
items splits into A to Z folders, so you never have to twiddle the knob through 400 songs at a
red light.
- **Now playing:** next to the transport controls you get **Vocals** on/off (instant karaoke),
**Mix** (cycles through the presets), shuffle and repeat. The current mix shows on the artist
line, e.g. "Black Sabbath · Karaoke".
- **Voice:** hold the talk button and say "play Paranoid on Stemify". Playlists, artists,
albums and songs all work.
- **Offline:** away from home, the app quickly notices the server is unreachable and lists only
songs that will actually play (downloaded or fully cached).
**Setting up the car (once):** Android Auto hides sideloaded apps until you allow them. On the
phone, search Settings for "Android Auto", tap **Version** ten times, then in the ⋮ menu go to
**Developer settings** and tick **Unknown sources**. Stemify then shows up in Auto's app
launcher.
**Testing without a car:** Google's Desktop Head Unit can impersonate the Miata. On the phone,
start the head unit server from Auto's developer settings, then:
```sh ```sh
adb forward tcp:5277 tcp:5277 adb forward tcp:5277 tcp:5277
~/Android/Sdk/extras/google/auto/desktop-head-unit -c ~/Android/Sdk/extras/google/auto/config/rotary.ini ~/Android/Sdk/extras/google/auto/desktop-head-unit -c ~/Android/Sdk/extras/google/auto/config/rotary.ini
``` ```
--- ## Desktop
## iOS and CarPlay Linux, Python 3.12 and [uv](https://docs.astral.sh/uv/). PyTorch defaults to ROCm (AMD); point the torch index in `pyproject.toml` elsewhere for NVIDIA or CPU.
`ios/` is a SwiftUI port of the Android app with the same features, plus CarPlay (browse tabs, Now Playing with Vocals and Mix buttons) and Siri ("play X in Stemify"). iOS 17 or newer. ```sh
uv sync
On top of the Android features: the Save chip in the mixer remembers a mix for that song and puts it back every time it plays, and the mic button turns on karaoke mode (vocals muted on every song, synced lyrics from [LRCLIB](https://lrclib.net) on Now Playing; tap a line to jump to it). uv run stemify # the drag-and-drop separator
uv run stemify-player # the player
Build an unsigned IPA on a Mac with Xcode and xcodegen (`brew install xcodegen`): ./scripts/install-desktop.sh # add both to your app launcher (--uninstall removes them)
```
cd ios
scripts/build-ipa.sh # writes build/stemify-<version>.ipa
``` ```
Sideload the IPA with Sideloadly or AltStore, which sign it with your Apple ID. **Stemify** is the separator. Drop files on the window and each one is separated with your last-used model and device. You get a lane per stem with a waveform, solo, mute, gain and export (everything, one stem, or the current mix, as WAV, FLAC or MP3). Separation runs in its own process, results are cached, and it works on AMD, NVIDIA and CPU.
To get updates in AltStore, SideStore or Feather, add this source: **Stemify Player** is your Plex library and its stems, dressed up as Microsoft Excel 2016. Sheets are your library, the zoom slider is master volume, Cell Styles are mix presets, and Undo/Redo skip songs. It reports plays to Plex, supports media keys and MPRIS, and remembers your queue and mix. More in [`stemify/player/README.md`](stemify/player/README.md).
``` ## Stem Now
https://git.iamchrisama.com/cdnutter/stemify/raw/branch/main/ios/source.json
```
After uploading a new release (tag `ios-v<version>`, asset `stemify-<version>.ipa`), run `ios/scripts/make-source.py` to regenerate `ios/source.json` and commit it. To work in Xcode instead, run `xcodegen generate` and open `Stemify.xcodeproj`. A big library takes stemd days. Hold a song, album, artist or playlist and choose **Stem Now** to move its unseparated songs to the front.
CarPlay and Siri need the `carplay-audio` and `siri` entitlements. A free Apple ID can't sign those, so on a free sideload the app works on the phone but won't show up in CarPlay or Siri. A paid developer account covers Siri; CarPlay audio also needs Apple to approve the entitlement for your team. 1. The app sends the songs to stemserve, which drops a request file in stemd's queue folder.
2. stemd finishes the song it's on and does yours next. If it was idle, it starts within about 5 seconds.
3. About a minute after each song finishes, the app picks up its stems.
## The desktop apps Requests run oldest first and survive restarts. stemd matches Plex's paths to its own files by the artist/album/file tail, so different mount points don't matter. Songs that failed before are skipped; delete `state/failed.json` to retry them.
### Stemify (the separator) ## Reference
Drop files onto the window. Each becomes a queue item, separation starts right away with your ### Separation models
last-used model and device, and when it's done you get a lane per stem with a waveform, solo, mute,
gain and export. Export everything, one stem, or your current mix, as WAV, FLAC or MP3.
Other niceties: | Model id | Stems | Notes |
|---|---|---|
| `htdemucs` | 4 | HT Demucs, fast |
| `htdemucs_ft` | 4 | Fine-tuned, about 4x slower |
| `htdemucs_6s` | 6 | Adds guitar and piano |
| `roformer_bs_vocals` | 2 | BS-RoFormer vocals/instrumental (Viperx 1297) |
| `roformer_mel_kim_ft` | 2 | Mel-RoFormer, cleanest vocals (Kim FT by unwa) |
| `roformer_bs_sw` | 6 | BS-RoFormer SW by jarredou, stemd's default |
- Separation runs in its own worker process, so the UI never stutters, even mid-separation. ### Folder layout
- Works on AMD (ROCm), NVIDIA and CPU, and shows free VRAM.
- Results are cached, so flipping back to an old song is instant (with a size limit you can set).
- A dev frame-time overlay, for anyone who wants proof of the 240 fps claims.
### Stemify Player (the spreadsheet)
The desktop sibling of the phone app, disguised as Microsoft Excel 2016. Some highlights from the
translation guide:
| In Excel | In Stemify Player |
|---|---|
| Sheets (Songs, Artists, Albums, Playlists, Stems, Queue) | Your library |
| "Tell me what you want to do" | Search |
| Zoom slider | Master volume |
| Cell Styles | Mix presets (Karaoke is filed under "Bad", A Cappella under "Good") |
| AutoSum | AutoShuffle |
| Undo / Redo | Previous / next song |
| Format task pane | Now playing, with the stems as a column chart you can drag |
| `#GETTING_DATA` | A playlist loading from Plex |
It reports plays to Plex, supports media keys and desktop media controls (MPRIS), and remembers
your queue, position and mix between launches. The full tour is in
[`stemify/player/README.md`](stemify/player/README.md).
---
## Separation models
| Model id | Name | Stems | Notes |
|---|---|---|---|
| `htdemucs` | HT Demucs | 4 | Fast |
| `htdemucs_ft` | HT Demucs FT | 4 | Fine-tuned, about 4x slower |
| `htdemucs_6s` | HT Demucs 6-stem | 6 | Adds guitar and piano |
| `roformer_bs_vocals` | BS-RoFormer Vocals | 2 | Vocals / instrumental (Viperx 1297) |
| `roformer_mel_kim_ft` | Mel-RoFormer Vocals FT | 2 | Cleanest vocals (Kim FT by unwa) |
| `roformer_bs_sw` | BS-RoFormer SW 6-stem | 6 | stemd's default (by jarredou) |
The 4-stem models give vocals, drums, bass and other. The 6-stem ones add guitar and piano.
---
## How the pieces find each other
The stems folder mirrors the music folder, with one folder per song:
``` ```
Music/Kansas/Leftoverture/01 Carry On Wayward Son.flac Music/Kansas/Leftoverture/01 Carry On Wayward Son.flac
Stems/Kansas/Leftoverture/01 Carry On Wayward Son/ Stems/Kansas/Leftoverture/01 Carry On Wayward Son/
.stemify.json ← the "this one's done" marker .stemify.json done marker
01 Carry On Wayward Son - vocals.flac 01 Carry On Wayward Son - vocals.flac
01 Carry On Wayward Son - drums.flac 01 Carry On Wayward Son - drums.flac
01 Carry On Wayward Son - bass.flac
... ...
``` ```
- Stems are written as 24-bit FLAC into a hidden `.partial` folder first, and the marker goes in - Stems are written as 24-bit FLAC to a hidden `.partial` folder and the marker goes in last, so an interrupted separation is just redone.
last, so a separation interrupted by a reboot is simply redone next time. No half-baked songs. - If a folder has the same song in several formats, the best one wins (FLAC/WAV, then M4A, Opus/Ogg, MP3, WMA).
- When a folder holds the same song in several formats, the best one wins (FLAC/WAV, then M4A, - Plex reports paths as its container sees them, so the apps match songs to stems by path suffix, check durations, and learn the prefix from the first confident match.
Opus/Ogg, MP3, WMA).
- Plex reports file paths as *its* container sees them, so the apps match them to stems by suffix,
checking durations along the way, and learn the path prefix from the first confident match. A
song called "Intro.flac" on one album will never steal another album's intro.
--- ### stemserve API
## stemserve API
| Request | Returns | | Request | Returns |
|---|---| |---|---|
| `GET /api/info` | Track count, whether ffmpeg is available, whether Stem Now is set up | | `GET /api/info` | Track count, ffmpeg availability, whether Stem Now is set up |
| `GET /api/index` | Every finished song (with ETag, so unchanged indexes cost one tiny 304) | | `GET /api/index` | Every finished song (with ETag) |
| `GET /api/peaks?key=K&n=256` | Per-stem loudness envelopes for waveforms, 0 to 1000 | | `GET /api/peaks?key=K&n=256` | Per-stem loudness envelopes for waveforms, 0 to 1000 |
| `POST /api/prepare?key=K&fmt=opus&br=256` | Starts Opus transcodes in the background | | `POST /api/prepare?key=K&fmt=opus&br=256` | Starts Opus transcodes in the background |
| `POST /api/stem` with `{"paths": [...]}` | Stem Now: stemd separates these Plex files next | | `POST /api/stem` with `{"paths": [...]}` | Stem Now for these Plex files |
| `GET /file/K/<file>.flac[?fmt=opus&br=256]` | The stem itself, with HTTP range support for seeking | | `GET /file/K/<file>.flac[?fmt=opus&br=256]` | The stem, with range support |
`K` is the song's folder under the stems root, e.g. `Kansas/Leftoverture/01 Carry On Wayward Son`. `K` is the song's folder under the stems root, like `Kansas/Leftoverture/01 Carry On Wayward Son`. Outside Docker:
Want to run it outside Docker? It's one file:
```sh ```sh
STEMS_DIR=/path/to/Stems CACHE_DIR=~/.cache/stemserve python3 server/stemserve.py STEMS_DIR=/path/to/Stems CACHE_DIR=~/.cache/stemserve python3 server/stemserve.py
``` ```
--- ### Repo layout
```
ios/ iOS and CarPlay app (SwiftUI, xcodegen project)
Stemify/ App, Plex, Playback, Stems, Engine, EQ, CarPlay, UI
scripts/ build-ipa.sh, make-source.py
android/ Android and Android Auto app (Kotlin, Compose, Media3)
server/ stemd.py, stemserve.py, Dockerfiles, compose file
stemify/ desktop separator (PySide6 + QML) and shared separation code
worker/ Demucs and RoFormer backends, run in a separate process
player/ Stemify Player
library_core.py folder layout rules shared with stemd
scripts/ install-desktop.sh
specs.txt original design doc for the desktop separator
```
## Building and testing ## Building and testing
**iOS** needs a Mac with Xcode and xcodegen (`brew install xcodegen`):
```sh
cd ios
scripts/build-ipa.sh # unsigned build/stemify-<version>.ipa
xcodegen generate # or open Stemify.xcodeproj in Xcode
```
The version lives in `ios/project.yml` (`MARKETING_VERSION` and `CURRENT_PROJECT_VERSION`). To release, tag `ios-v<version>`, attach `stemify-<version>.ipa`, then run `GITEA_TOKEN=... ios/scripts/make-source.py` and commit the new `ios/source.json`.
**Android** needs JDK 21 and the Android SDK (`android/local.properties` points at it): **Android** needs JDK 21 and the Android SDK (`android/local.properties` points at it):
```sh ```sh
cd android cd android
JAVA_HOME=/path/to/jdk-21 ./gradlew assembleRelease # app/build/outputs/apk/release/ JAVA_HOME=/path/to/jdk-21 ./gradlew assembleRelease # app/build/outputs/apk/release/
JAVA_HOME=/path/to/jdk-21 ./gradlew testDebugUnitTest # stem matching, EQ and filter maths, limiter, cache, car tree JAVA_HOME=/path/to/jdk-21 ./gradlew testDebugUnitTest # matching, EQ maths, limiter, cache, car tree
``` ```
The cache and index tests stream real stems from a stemserve on `localhost:8765` and skip The cache and index tests use a stemserve on `localhost:8765` and skip themselves without one.
themselves when there isn't one. Debug builds include a hook for screenshots and back-gesture
testing (`app/src/debug`); release builds don't.
**Desktop** apps can be checked without opening a window: **Desktop** can be checked without a window:
```sh ```sh
QT_QPA_PLATFORM=offscreen uv run stemify-player --no-mpris --screenshot /tmp/p.png@5 --quit-after 6 QT_QPA_PLATFORM=offscreen uv run stemify-player --no-mpris --screenshot /tmp/p.png@5 --quit-after 6
``` ```
--- ## Troubleshooting
## Repo tour **A song says NO STEMS.** Hold it and choose Stem Now.
``` **Stem Now says "stemserve needs updating" or "queue folder isn't mounted".** stemserve is older than the app or is missing the `/queue` mount. The queue folder has to be owned by `99:100` before the container first starts, or Docker creates it as root.
android/ the Android and Android Auto app (Kotlin, Jetpack Compose, Media3)
app/src/main/java/com/stemify/mobile/
plex/ Plex library, search, playlists, artwork, play reporting
stems/ stemserve client, path matching, which albums have stems
cache/ sparse block cache for streaming, and downloads
engine/ decoders, the sample-locked mixer, EQ, limiter, meters
eq/ EQ profiles, device switching, APO config import/export
playback/ queue, audio focus, mix presets, the Media3 session
auto/ Android Auto browse tree, voice search, offline mode
ui/ every screen, hand-built iOS-style components
server/
stemd.py the GPU separation daemon
stemserve.py the stem file server (standard library only)
*.Dockerfile, docker-compose.yml
stemify/ the desktop separator (PySide6 + QML) and shared separation code
worker/ separation backends (Demucs, RoFormer) in a separate process
player/ Stemify Player, the Excel-shaped one
library_core.py the folder layout rules shared with stemd
scripts/install-desktop.sh
specs.txt the original design doc for the desktop separator
```
--- **stemd is separating on the CPU.** The container can't see the GPU. Run it with `--runtime=nvidia` and the NVIDIA variables above.
## Troubleshooting and FAQ **stemd says "out of GPU memory".** Something else is using VRAM. stemd retries that song next pass without marking it failed.
**A song says NO STEMS and I'm impatient.** **The stem server shows Offline.** Check the address in Settings, try `curl http://<server>:8765/api/info` from another machine, and if stemserve has a `TOKEN`, set the same one in the app.
Hold it and choose **Stem Now**. It'll be next in line.
**Stem Now says "stemserve needs updating" or "queue folder isn't mounted".** **Stemify isn't in CarPlay or Siri.** The IPA was signed without those entitlements. See [iOS install](#install).
stemserve is older than the app, or it's missing the `/queue` mount. See
[the server setup](#1-the-server-stemd-and-stemserve). The queue folder needs to be owned by
`99:100` *before* the container first starts, or Docker creates it as root and nobody can write
to it.
**stemd says it's separating on the CPU.** **Stemify isn't in Android Auto.** Turn on Unknown sources in Auto's developer settings. See [Android Auto](#android-auto).
The container can't see the GPU. Make sure it's running with `--runtime=nvidia` and the NVIDIA
environment variables shown above.
**stemd keeps saying "out of GPU memory".** **Songs listed in `state/failed.json`.** Usually corrupt files or "songs" over 40 minutes (DJ mixes, radio rips). They retry when the file changes; delete the file to retry everything.
Something else (Plex transcoding, a game server, your ambitions) is hogging VRAM. stemd shrugs and
retries that song on the next pass. Nothing is marked failed.
**The Stem Server page says Offline.**
Check the address in Settings → Stem Server, check `curl http://<server>:8765/api/info` from
another machine, and if you set a `TOKEN` on the server, set the same one in the app.
**The app doesn't show up in Android Auto.**
Sideloaded apps need **Unknown sources** turned on in Auto's developer settings. See
[setting up the car](#android-auto).
**Some songs are marked failed in `state/failed.json`.**
Usually corrupt files, or "songs" over 40 minutes (those are almost always DJ mixes or radio rips).
Failed tracks retry automatically when the file changes; delete the file to retry everything.
**Why is the desktop player an Excel spreadsheet?**
We don't talk about it.
---
## Credits ## Credits
Standing on the shoulders of some very clever people:
- [Demucs](https://github.com/adefossez/demucs) by Alexandre Défossez - [Demucs](https://github.com/adefossez/demucs) by Alexandre Défossez
- BS-RoFormer and Mel-RoFormer models, including the SW 6-stem model by jarredou, Viperx's 1297, - BS-RoFormer and Mel-RoFormer models (SW 6-stem by jarredou, Viperx 1297, Kim FT by unwa) via [python-audio-separator](https://github.com/nomadkaraoke/python-audio-separator)
and Kim's vocal model fine-tuned by unwa, via - [PyTorch](https://pytorch.org/), [PySide6](https://www.qt.io/qt-for-python), [Jetpack Compose](https://developer.android.com/compose), [Media3](https://developer.android.com/media/media3)
[python-audio-separator](https://github.com/nomadkaraoke/python-audio-separator) - [Equalizer APO](https://sourceforge.net/projects/equalizerapo/) and [AutoEQ](https://github.com/jaakkopasanen/AutoEq), whose formats the EQ reads and writes
- [PyTorch](https://pytorch.org/), [PySide6 / Qt](https://www.qt.io/qt-for-python), - [LRCLIB](https://lrclib.net) for synced lyrics
[Jetpack Compose](https://developer.android.com/compose) and - Inter, Selawik and Carlito fonts (licenses included alongside them)
[Media3](https://developer.android.com/media/media3)
- [Equalizer APO](https://sourceforge.net/projects/equalizerapo/) and
[AutoEQ](https://github.com/jaakkopasanen/AutoEq), whose formats the EQ speaks
- The Inter, Selawik and Carlito fonts (licences included alongside them)
- [Plex](https://www.plex.tv/), for keeping the library tidy so we didn't have to
Stemify isn't affiliated with Plex, Google, Microsoft or Mazda. It just likes them. Stemify isn't affiliated with Plex, Apple, Google, Microsoft or Mazda.
---
## License ## License
[GPL-3.0](LICENSE). Take it apart and put it back together however you like, just like the songs. [GPL-3.0](LICENSE)
+4
View File
@@ -189,6 +189,10 @@ final class Settings: @unchecked Sendable {
/// How far down Soft karaoke puts the vocals, in dB. /// How far down Soft karaoke puts the vocals, in dB.
var karaokeSoftDb: Int { get { read(\.karaokeSoftDb, "karaokeSoftDb", -12) } set { write(\.karaokeSoftDb, "karaokeSoftDb", newValue, -12) } } var karaokeSoftDb: Int { get { read(\.karaokeSoftDb, "karaokeSoftDb", -12) } set { write(\.karaokeSoftDb, "karaokeSoftDb", newValue, -12) } }
var keepStemMix: Bool { get { read(\.keepStemMix, "keepStemMix", true) } set { write(\.keepStemMix, "keepStemMix", newValue, true) } } var keepStemMix: Bool { get { read(\.keepStemMix, "keepStemMix", true) } set { write(\.keepStemMix, "keepStemMix", newValue, true) } }
var playbackSpeed: Double {
get { access(keyPath: \.playbackSpeed); lock.lock(); defer { lock.unlock() }; return (store["playbackSpeed"] as? NSNumber)?.doubleValue ?? 1 }
set { write(\.playbackSpeed, "playbackSpeed", newValue, 1.0) }
}
var masterVolume: Float { var masterVolume: Float {
get { access(keyPath: \.masterVolume); lock.lock(); defer { lock.unlock() }; return (store["masterVolume"] as? NSNumber)?.floatValue ?? 0.85 } get { access(keyPath: \.masterVolume); lock.lock(); defer { lock.unlock() }; return (store["masterVolume"] as? NSNumber)?.floatValue ?? 0.85 }
set { write(\.masterVolume, "masterVolume", newValue, 0.85) } set { write(\.masterVolume, "masterVolume", newValue, 0.85) }
+29 -5
View File
@@ -104,6 +104,7 @@ private final class OutputTap: @unchecked Sendable {
private var lastNanos: Int64 = 0 private var lastNanos: Int64 = 0
private var runningFlag = false private var runningFlag = false
private var latencyNanos: Int64 = 0 private var latencyNanos: Int64 = 0
private var speedFactor = 1.0
private let scratch: UnsafeMutablePointer<Float> private let scratch: UnsafeMutablePointer<Float>
private static let scratchFrames = 4096 private static let scratchFrames = 4096
@@ -121,6 +122,12 @@ private final class OutputTap: @unchecked Sendable {
func setLatency(_ seconds: Double) { lock.with { latencyNanos = Int64(seconds * 1e9) } } func setLatency(_ seconds: Double) { lock.with { latencyNanos = Int64(seconds * 1e9) } }
/// Playback speed; the time-pitch unit pulls frames this much faster than real time.
var speed: Double {
get { lock.with { speedFactor } }
set { lock.with { speedFactor = newValue } }
}
func flush() { func flush() {
lock.with { lock.with {
ring.clear() ring.clear()
@@ -135,7 +142,7 @@ private final class OutputTap: @unchecked Sendable {
lock.with { lock.with {
if lastNanos == 0 { return 0 } if lastNanos == 0 { return 0 }
let elapsed = runningFlag ? max(0, now - lastNanos) : 0 let elapsed = runningFlag ? max(0, now - lastNanos) : 0
let est = lastStart + elapsed * Int64(rate) / 1_000_000_000 - latencyNanos * Int64(rate) / 1_000_000_000 let est = lastStart + Int64(Double((elapsed - latencyNanos) * Int64(rate)) * speedFactor) / 1_000_000_000
return min(max(0, min(est, consumed)), written) return min(max(0, min(est, consumed)), written)
} }
} }
@@ -203,9 +210,10 @@ final class StemEngine: @unchecked Sendable {
var rate: Int var rate: Int
var nanos: Int64 var nanos: Int64
var running: Bool var running: Bool
var speed = 1.0
func positionMs(_ now: Int64 = monoNanos()) -> Int64 { func positionMs(_ now: Int64 = monoNanos()) -> Int64 {
if rate <= 0 { return 0 } if rate <= 0 { return 0 }
let f = running ? frame + (now - nanos) * Int64(rate) / 1_000_000_000 : frame let f = running ? frame + Int64(Double((now - nanos) * Int64(rate)) * speed) / 1_000_000_000 : frame
return f * 1000 / Int64(rate) return f * 1000 / Int64(rate)
} }
} }
@@ -223,6 +231,8 @@ final class StemEngine: @unchecked Sendable {
private let av = AVAudioEngine() private let av = AVAudioEngine()
private var node: AVAudioSourceNode? private var node: AVAudioSourceNode?
private var tap: OutputTap? private var tap: OutputTap?
private let pitch: AVAudioUnitTimePitch = { let p = AVAudioUnitTimePitch(); p.bypass = true; return p }()
private var speed = 1.0
private var trackRate = 0 private var trackRate = 0
private var written: Int64 = 0 private var written: Int64 = 0
private var segments: [Segment] = [] private var segments: [Segment] = []
@@ -321,6 +331,17 @@ final class StemEngine: @unchecked Sendable {
} }
} }
/// Playback speed, 0.5 to 2. Pitch stays the same.
func setSpeed(_ v: Double) {
post { [self] in
speed = min(max(v, 0.5), 2)
pitch.rate = Float(speed)
pitch.bypass = speed == 1
tap?.speed = speed
publish()
}
}
func seekTo(_ ms: Int64) { func seekTo(_ ms: Int64) {
post { [self] in post { [self] in
guard let s = session else { return } guard let s = session else { return }
@@ -601,12 +622,15 @@ final class StemEngine: @unchecked Sendable {
#endif #endif
let t = OutputTap(rate: rate, frames: max(4096, rate * Self.bufferMs / 1000)) let t = OutputTap(rate: rate, frames: max(4096, rate * Self.bufferMs / 1000))
t.setLatency(Self.outputLatency()) t.setLatency(Self.outputLatency())
t.speed = speed
guard let fmt = AVAudioFormat(standardFormatWithSampleRate: Double(rate), channels: 2) else { guard let fmt = AVAudioFormat(standardFormatWithSampleRate: Double(rate), channels: 2) else {
throw DecodeError("Unsupported sample rate \(rate)") throw DecodeError("Unsupported sample rate \(rate)")
} }
let n = AVAudioSourceNode(format: fmt) { silence, ts, frames, abl in t.render(silence, ts, frames, abl) } let n = AVAudioSourceNode(format: fmt) { silence, ts, frames, abl in t.render(silence, ts, frames, abl) }
av.attach(n) av.attach(n)
av.connect(n, to: av.mainMixerNode, format: fmt) if pitch.engine == nil { av.attach(pitch) }
av.connect(n, to: pitch, format: fmt)
av.connect(pitch, to: av.mainMixerNode, format: fmt)
av.prepare() av.prepare()
node = n node = n
tap = t tap = t
@@ -655,9 +679,9 @@ final class StemEngine: @unchecked Sendable {
let rate = s.map { $0.decoders.isEmpty ? trackRate : $0.sampleRate } ?? trackRate let rate = s.map { $0.decoders.isEmpty ? trackRate : $0.sampleRate } ?? trackRate
if let seg = segments.first { if let seg = segments.first {
let running = playing && drainUntil < 0 || drainUntil >= 0 && p < drainUntil let running = playing && drainUntil < 0 || drainUntil >= 0 && p < drainUntil
snapshot = Snapshot(token: seg.token, frame: seg.frameStart + max(0, p - seg.writtenStart), rate: rate, nanos: nanos, running: running) snapshot = Snapshot(token: seg.token, frame: seg.frameStart + max(0, p - seg.writtenStart), rate: rate, nanos: nanos, running: running, speed: speed)
} else { } else {
snapshot = Snapshot(token: s?.token ?? -1, frame: s?.framePos ?? 0, rate: rate, nanos: nanos, running: false) snapshot = Snapshot(token: s?.token ?? -1, frame: s?.framePos ?? 0, rate: rate, nanos: nanos, running: false, speed: speed)
} }
} }
+1 -1
View File
@@ -62,7 +62,7 @@ final class NowPlaying: @unchecked Sendable {
MPMediaItemPropertyAlbumTitle: t.album, MPMediaItemPropertyAlbumTitle: t.album,
MPMediaItemPropertyPlaybackDuration: Double(max(pm.durationMs, t.durationMs)) / 1000, MPMediaItemPropertyPlaybackDuration: Double(max(pm.durationMs, t.durationMs)) / 1000,
MPNowPlayingInfoPropertyElapsedPlaybackTime: Double(pm.positionMs()) / 1000, MPNowPlayingInfoPropertyElapsedPlaybackTime: Double(pm.positionMs()) / 1000,
MPNowPlayingInfoPropertyPlaybackRate: pm.isPlaying && !pm.buffering ? 1.0 : 0.0, MPNowPlayingInfoPropertyPlaybackRate: pm.isPlaying && !pm.buffering ? pm.speed : 0.0,
MPNowPlayingInfoPropertyDefaultPlaybackRate: 1.0, MPNowPlayingInfoPropertyDefaultPlaybackRate: 1.0,
MPNowPlayingInfoPropertyMediaType: MPNowPlayingInfoMediaType.audio.rawValue, MPNowPlayingInfoPropertyMediaType: MPNowPlayingInfoMediaType.audio.rawValue,
MPNowPlayingInfoPropertyPlaybackQueueIndex: max(pm.index, 0), MPNowPlayingInfoPropertyPlaybackQueueIndex: max(pm.index, 0),
@@ -123,6 +123,7 @@ final class PlaybackManager: StemEngineListener, @unchecked Sendable {
private(set) var stemNames: [String] = [] private(set) var stemNames: [String] = []
private(set) var mix: [String: StemSetting] = [:] private(set) var mix: [String: StemSetting] = [:]
private(set) var master: Float private(set) var master: Float
private(set) var speed = 1.0
private(set) var waveform: Waveform? private(set) var waveform: Waveform?
private(set) var durationMs: Int64 = 0 private(set) var durationMs: Int64 = 0
private(set) var message: AppMessage? private(set) var message: AppMessage?
@@ -165,6 +166,8 @@ final class PlaybackManager: StemEngineListener, @unchecked Sendable {
eq.onParams = { [weak self] p in self?.engine.eqParams = p } eq.onParams = { [weak self] p in self?.engine.eqParams = p }
engine.eqParams = eq.currentParams() engine.eqParams = eq.currentParams()
engine.masterGain = masterTaper(master) engine.masterGain = masterTaper(master)
speed = settings.playbackSpeed
engine.setSpeed(speed)
restore() restore()
observeSession() observeSession()
Task { @MainActor [weak self] in Task { @MainActor [weak self] in
@@ -329,6 +332,15 @@ final class PlaybackManager: StemEngineListener, @unchecked Sendable {
func setShuffle(_ on: Bool) { if on != shuffle { toggleShuffle() } } func setShuffle(_ on: Bool) { if on != shuffle { toggleShuffle() } }
static let speeds: [Double] = [0.5, 0.75, 0.9, 1, 1.1, 1.25, 1.5, 2]
func setSpeed(_ v: Double) {
speed = min(max(v, 0.5), 2)
engine.setSpeed(speed)
settings.playbackSpeed = speed
changed()
}
// ---- transport ---------------------------------------------------------------------- // ---- transport ----------------------------------------------------------------------
func play() { func play() {
@@ -153,6 +153,7 @@ struct NowPlayingScreen: View {
ProgressVolumeBar(played: c.label, unplayed: c.label3, centerLabel: badge(track)) ProgressVolumeBar(played: c.label, unplayed: c.label3, centerLabel: badge(track))
.padding(.top, panel == .Art ? 34 : 18) .padding(.top, panel == .Art ? 34 : 18)
HStack { HStack {
SideToggle(symbol: "shuffle", on: pm.shuffle, action: pm.toggleShuffle)
Spacer() Spacer()
TransportButton(symbol: "backward.fill", size: 34, action: pm.previous) TransportButton(symbol: "backward.fill", size: 34, action: pm.previous)
Spacer() Spacer()
@@ -169,10 +170,12 @@ struct NowPlayingScreen: View {
Spacer() Spacer()
TransportButton(symbol: "forward.fill", size: 34, action: pm.next) TransportButton(symbol: "forward.fill", size: 34, action: pm.next)
Spacer() Spacer()
SideToggle(symbol: pm.repeatMode == .One ? "repeat.1" : "repeat", on: pm.repeatMode != .Off, action: pm.cycleRepeat)
} }
.frame(height: 84) .frame(height: 84)
HStack { HStack {
PanelToggle(symbol: "slider.vertical.3", on: panel == .Mixer) { show(.Mixer) } PanelToggle(symbol: "slider.vertical.3", on: panel == .Mixer) { show(.Mixer) }
SpeedMenu()
Button { ui.showInSettings(.Eq) } label: { routeLabel(c) }.buttonStyle(PressFade()).frame(maxWidth: .infinity) Button { ui.showInSettings(.Eq) } label: { routeLabel(c) }.buttonStyle(PressFade()).frame(maxWidth: .infinity)
PanelToggle(symbol: "music.mic", on: pm.karaoke) { karaoke() } PanelToggle(symbol: "music.mic", on: pm.karaoke) { karaoke() }
PanelToggle(symbol: "list.bullet", on: panel == .Queue) { show(.Queue) } PanelToggle(symbol: "list.bullet", on: panel == .Queue) { show(.Queue) }
@@ -246,6 +249,51 @@ private struct TransportButton: View {
} }
} }
/// Shuffle and repeat, either side of the transport. A dot underneath when on.
private struct SideToggle: View {
let symbol: String
let on: Bool
let action: () -> Void
@Environment(\.palette) private var p
var body: some View {
Button(action: action) {
VStack(spacing: 4) {
Image(systemName: symbol).font(.system(size: 19, weight: .semibold)).contentTransition(.symbolEffect(.replace))
Circle().frame(width: 4, height: 4).opacity(on ? 1 : 0)
}
.foregroundStyle(on ? p.label : p.label3)
.frame(width: 40, height: 56)
.contentShape(Rectangle())
}
.buttonStyle(PressFade())
.sensoryFeedback(.selection, trigger: symbol + "\(on)")
}
}
/// Playback speed picker; shows the current speed.
private struct SpeedMenu: View {
private var g: AppGraph { .shared }
@Environment(\.palette) private var p
var body: some View {
let pm = g.playback
Menu {
Picker("Speed", selection: Binding(get: { pm.speed }, set: { pm.setSpeed($0) })) {
ForEach(PlaybackManager.speeds, id: \.self) { Text(Self.label($0)).tag($0) }
}
} label: {
Text(Self.label(pm.speed)).font(.system(size: 14, weight: .semibold).monospacedDigit())
.foregroundStyle(pm.speed == 1 ? p.label2 : p.bg)
.frame(minWidth: 40, minHeight: 40)
.padding(.horizontal, 2)
.background(pm.speed == 1 ? .clear : p.label, in: RoundedRectangle(cornerRadius: 10, style: .continuous))
}
.menuOrder(.fixed)
}
static func label(_ v: Double) -> String {
(v == v.rounded() ? String(Int(v)) : String(format: "%g", v)) + "×"
}
}
private struct PanelToggle: View { private struct PanelToggle: View {
let symbol: String let symbol: String
let on: Bool let on: Bool
+2 -2
View File
@@ -6,8 +6,8 @@ options:
settings: settings:
base: base:
SWIFT_VERSION: "5.0" SWIFT_VERSION: "5.0"
MARKETING_VERSION: "1.0.9" MARKETING_VERSION: "1.0.10"
CURRENT_PROJECT_VERSION: "10" CURRENT_PROJECT_VERSION: "11"
targets: targets:
Stemify: Stemify:
type: application type: application
+9
View File
@@ -15,6 +15,15 @@
"tintColor": "#FA2D48", "tintColor": "#FA2D48",
"category": "entertainment", "category": "entertainment",
"versions": [ "versions": [
{
"version": "1.0.9",
"buildVersion": "10",
"date": "2026-10-20T10:28:26-07:00",
"localizedDescription": "- Add to Playlist is now one sheet instead of a string of pop-ups: Plex and Stem tabs, type a new playlist name right in the list, playlist art, and mix chips for stem playlists.\n- Song menus have a single \"Add to Playlist\u2026\" entry for both kinds; the sheet remembers which tab you used last.\n\nUnsigned IPA: sideload with AltStore, SideStore or Feather.",
"downloadURL": "https://git.iamchrisama.com/cdnutter/stemify/releases/download/ios-v1.0.9/stemify-1.0.9.ipa",
"size": 1518270,
"minOSVersion": "17.0"
},
{ {
"version": "1.0.8", "version": "1.0.8",
"buildVersion": "9", "buildVersion": "9",