GPU-accelerated video synthesis SDK for Rust
scheng is a Rust engine and SDK for building programmable video instruments. Rather than a fixed VJ application, it gives you the building blocks: a graph-based execution model, explicit shader contracts, and a modular I/O surface. You wire them into your own executable.
The engine is deliberately minimal — it evaluates frames deterministically. It does not own time, schedule execution, or manage devices. Those responsibilities belong to your instrument.
Build real-time shader instruments — live mixers, processors, and generators — with professional video I/O built in.
cargo run --release -- --width 1920 --height 1080 --msaa 4- GPU-native — Rgba16Float render pipeline on Metal, DX12, and Vulkan via wgpu
- Hot-reload shaders — edit GLSL, save, see — zero restart
- MIDI & OSC — CC messages wire directly to shader uniforms with configurable smoothing
- Professional I/O — Syphon, NDI, Spout, RTMP, RTSP, webcam, video file
- bt.709 colorspace — correct color tagging on all FFmpeg output
- 4K + MSAA — runtime resolution and anti-aliasing control
- Graph-based — composable node topology, deterministic execution
| Inputs | Outputs |
|---|---|
| Syphon (macOS) | Syphon (macOS) |
| NDI | NDI |
| Webcam | RTMP stream |
| Video file (any ffmpeg format) | RTSP stream |
| RTMP / RTSP / SRT | File recording (H.264) |
| MIDI CC | Preview window |
| OSC | Spout (Windows) |
Four ready-to-run reference instruments. Clone one and you're rendering on the GPU in minutes.
| Template | Description |
|---|---|
scheng-gradient |
Minimal hot-reload shader starter |
scheng-mixer |
Two Syphon inputs, MIDI T-bar crossfade |
scheng-processor |
Webcam input, live shader effect, MIDI control |
scheng-video-mixer |
Two video files, MIDI T-bar crossfade |
# Clone a template
git clone https://github.com/yourorg/scheng-gradient
cd scheng-gradient
# Build and run
cargo run --releaseRequirements: Rust 1.75+, ffmpeg in PATH. macOS: vendor/Syphon.framework for Syphon I/O.
| What | Where |
|---|---|
| Website & Overview | scheng.dev |
| Developer Reference | scheng.dev/developer-reference |
| Architecture Diagrams | scheng.dev/architecture |
| SDK Quick Reference | scheng.dev/sdk-reference |
crates/
scheng-graph # Graph topology and compilation
scheng-runtime-wgpu # wgpu render pipeline and executor
scheng-param-store # ParamStore, MIDI/OSC routing, smoothing
scheng-hotreload # File watcher, shader hot-reload
scheng-input-{midi,osc,webcam,video,ndi,syphon,rtmp}
scheng-output-{syphon,ndi,spout,ffmpeg}
examples/
scheng-instrument # Full-featured reference instrument
| Platform | Backend | Status |
|---|---|---|
| macOS (Apple Silicon / Intel) | Metal | ✅ Primary |
| Windows | DX12 | ✅ Supported |
| Linux | Vulkan | ✅ Supported |
MIT — see LICENSE.