@DKXOt_vTaDu (Touchdesigner and Mediapipe geometric examples – what is it used pose tracking instead of hand tracking?) Video by DKXOt_vTaDu

My Notes: Touchdesigner and Mediapipe geometric examples – what is it used pose tracking instead of hand tracking?

---

🧱 2024/12/07
•
“Hand Tracking MIDI Controller” #opensource
【手部追蹤 MIDI 控制器】 #開源專案
•
This is a digital MIDI controller that allows users to create music in the air using both hands. It only requires #TouchDesigner, #Webcam, and #MediaPipe (by @blankensmithing) to output 8 sound signals.
•
The “Hand Tracking MIDI Controller” has 5 pages. Users can switch between pages by pinching the side buttons with their thumb and index finger. The page name is displayed at the top, the 8 signal previews are shown at the bottom, and the hand tracking interaction interface is in the center.
•
The 5 pages and their controls:
➊ Toggle x1 (Pinch to click)
➋ Slider x1 (Pinch and drag to adjust)
➌ Slider x2 (Distance between fingertips of both hands, resets to zero when released)
➍ Slider x2 (Distance and angle between both hands, resets to zero when released)
➎ Pad x2 (Touch the center circle with both hands)
•
By default, all signals range from 0 to 1, and can be transmitted to different music software via #OSC (the example uses #VCVRack)
•
這是一個數位的 MIDI 控制器，它讓使用者可以用雙手在空中創造音樂。並且只需要用到 #TouchDesigner、#攝影機、#MediaPipe (by @blankensmithing)，就可以輸出8個聲音訊號
•
「手部追蹤 MIDI 控制器」有5個頁面，使用者可以用食指及拇指捏著兩側按鈕來切換頁面，上方有頁面名稱，下方有8個訊號的預覽，中間是手部追蹤的操作畫面
•
5個頁面的控制項：
➊ Togglex1 (捏著可以點擊)
➋ Sliderx1 (捏著可以拖曳滑桿)
➌ Sliderx2 (雙手指尖距離，放開會歸零)
➍ Sliderx2 (雙手距離及角度，放開會歸零)
➎ Pad x2 (雙手可以觸碰中心的圓)
•
預設的訊號都是介於0到1，可以透過 #OSC 傳輸給不同的音樂軟體（範例使用的是 #VCVRack）
•
🔗 MediaPipe (by Torin Blankensmith)：
https://reurl.cc/XAYzGR
•
🔗 Hand Tracking MIDI Controller：
https://reurl.cc/9DYlvY
•
🧿 @touchdesigner
🧬 @vcvrack
•
#TouchDesigner #MediaPipe
#HandTracking #MIDIController
#InteractionDesign #VCVRack
#互動設計 #手部追蹤

Instagram by: DKXOt_vTaDu (@DKXOt_vTaDu)

Source: https://www.instagram.com/p/DKXOt_vTaDu/?igsh=MWUwb20wajV2ZGh5eg==