VTuberWebcam
A downloadable app for Linux
VTuber WebCam is an app for VTubers. The app was designed for streaming and video recording by 3D VTubers.
Dashboard:
The app must be running in order to open the dashboard.
Hotkeys:
- ESC / Q - exit an app
- P - open the plugins configuration window
- R - reset head position and rotation
Supported cameras for tracking:
- Generic UVC cameras (V4L2 and OpenCV compatible)
- Intel RealSense (RGB+depth tracking)
- PS5 Camera (firmware loader, software stereo based depth calculation)
Features:
- Plugin based and Python-scriptable
- 3D model import from VRM files
- Face tracking powered by MediaPipe
- Morph target (blend shape) based emotes
- Hands tracking using Leap Motion device
- Spring bones physics
- Streaming to virtual V4L2 device
- XShm-based desktop capture
- Gamepad (DualShock4) tracking using it's own gyroscope and accelerometer
- DonationAlerts integration for triggering custom events on 3D scene or avatar
Planned Features:
- Streamlabs integration
- Camera based FBT (full body tracking)
Software Used:
- Panda3D game engine
- RenderPipeline toolkit by tobspr
- MediaPipe tracking library by GoogleAI
- LeapSDK v2
- IK library by TheComet
Status | Prototype |
Category | Tool |
Platforms | Linux |
Rating | Rated 4.5 out of 5 stars (8 total ratings) |
Author | kitsune.ONE team |
Tags | Leap Motion, mediapipe, openseeface, panda3d, streaming, Virtual Reality (VR), vrm, vtuber, vtuberwebcam, webcam |
Asset license | Creative Commons Attribution_NonCommercial_ShareAlike v4.0 International |
Average session | A few seconds |
Languages | English |
Inputs | Keyboard, Mouse, Leap Motion, Accelerometer, Playstation controller |
Links | YouTube, Patreon |
Download
Download
vtuber-webcam-linux-64.zip 367 MB
Version 29 Feb 01, 2023