Observe and enrich
Transcription, translation, moderation, vision, analytics, and custom worker adapters receive participant and track lifecycle context and publish structured results back into the room.
Coordinate people, AI agents, robots, devices, applications, and backend services through shared identity, presence, media, state, commands, and operational context.
AI joins with identity, presence, permissions, outputs, and lifecycle instead of operating as disconnected webhooks beside the customer experience.
Transcription, translation, moderation, vision, analytics, and custom worker adapters receive participant and track lifecycle context and publish structured results back into the room.
Presence surfaces turn agent state, audio energy, and speech phases into local or publishable personas. Browser AI perception remains an optional plugin layer.
The local TTS foundation supports native browser speech and self-hosted Piper-WASM through a shared provider API, including publishable Web Audio tracks.
A complete server-side conversational voice-agent runtime does not exist yet. Production turn-taking, barge-in, and STT→LLM→TTS orchestration remain roadmap work.
Experts, customers, connected equipment, diagnostics, and supporting services share the same controlled operational context.
Video, screen share, chat, files, role-aware controls, guest admission, and room short links for guided support sessions.
Surface ICE paths, peer state, quality changes, topology, timelines, device capabilities, and redacted support bundles while the session is active.
Use MQTT, serial, BLE, or USB gateways to make local equipment state and commands available to authorized room participants.
Deploy in a customer cloud, at the edge, or on private networks with explicit TURN, SFU, firewall, health, and capacity guidance.
Robots and devices become governed participants that publish state, receive authorized commands, and share media with operators, agents, and services.
Native rclpy and rosbridge paths connect topics, services, state, and camera workflows to TomatoRTC rooms.
Keyboard and gamepad controls map to command topics with deadman behavior, rate limits, acknowledgements, and operator HUDs.
Thin MQTT, serial, BLE, and USB sidecars connect local hardware without embedding WebRTC or room logic in device firmware.
Shared signals, awareness, and object foundations coordinate sensor data, commands, dashboards, simulations, and agent-visible state.
Start with the business outcome, participants, control boundaries, media paths, and deployment constraints.