Applied Research Engineer — Real-time Voice AI (Open Models)
Voicy · Remote - India · Remote · Wellfound
This job is restricted to candidates in: India. Work model: Remote
About the job
Location: High preference for engineers based in Dallas or Austin, Texas. We are also open to remote candidates in India.
About usVoicy builds AI voice assistants that answer calls and messages for businesses: taking orders, booking appointments, and handling customer conversations at scale. We're now building a developer platform for real-time voice AI on open models, so developers can ship voice agents that are fast, affordable, and fully under their control. We're an early-stage team, which means you'll work directly with the founder, turn research into production quickly, and see your work reach real users in weeks rather than years.
The roleThis is an applied research engineer role: you will build production voice AI systems and research the improvements that make them better. You'll read the latest speech and LLM literature, reproduce what matters, prototype it on open models, and harden what works into shipped systems. You should be equally comfortable reimplementing a paper from scratch and debugging a latency spike on a GPU server.
What you'll work on- Real-time voice pipelines: streaming ASR → LLM → TTS and speech-to-speech systems with sub-second turn latency, including interruptions (barge-in), turn-taking, voice activity detection, and endpointing.
- Open models: evaluating, fine-tuning, and distilling open-weight speech and language models (e.g., Whisper-family ASR, Llama/Qwen/Mistral LLMs, open TTS and speech-to-speech models) for noisy phone audio, accents, and new domains.
- GPU inference and infrastructure: serving with vLLM, TensorRT-LLM, Triton, or similar; quantization, batching, KV-cache management, and streaming; driving down latency and cost per minute of conversation.
- Research improvements: turning new ideas in speech, LLMs, and real-time inference into measurable gains in quality, latency, and cost.
- Evaluation: building benchmarks and regression harnesses for WER, latency, voice quality, and task success, so we know a change actually helped.
- Developer experience: APIs, SDKs, and open-source components that make it easy for developers to build on our voice stack.
Texas (Dallas / Austin), preferred:
- MS or PhD in Computer Science, Electrical Engineering, Machine Learning, or a related field.
- Research experience: publications, preprints, industry research lab work, a thesis, or a substantial open-source research project you can walk us through.
India (remote):
- An advanced degree with research experience is preferred, or
- A Bachelor's degree in engineering (B.E./B.Tech) is fine, as long as you have hands-on experience with voice/speech or LLM systems and GPU infrastructure (training or serving models on GPUs).
Everyone should have:
- Strong Python and hands-on experience with PyTorch and the Hugging Face ecosystem.
- Practical experience with speech (ASR/TTS) and/or LLMs, in research or production.
- Comfort working with GPUs: CUDA environments, Linux, Docker, and profiling inference performance.
- The ability to go from paper to prototype independently. We'll give you a problem and context, not a spec.
- Real-time and telephony experience: WebRTC, SIP, WebSockets, or frameworks such as Pipecat and LiveKit.
- Speech-to-speech or full-duplex conversational models.
- Custom CUDA or Triton kernels, or deep inference optimization work.
- Multilingual speech, including Indian languages.
- Open-source maintainership or a strong public GitHub presence.
- Prior startup experience, or evidence that you thrive without much structure.
- Texas: $70,000 – $100,000 per year + equity (0.5% – 2%).
- India (remote): ₹10,00,000 – ₹20,00,000 per year + equity (0.5% – 2%).
- We are unable to offer visa sponsorship for this role.
- Direct work with the founder and real influence over the technical direction.
- A fast path from research idea to production, with no handoff wall.
- Meaningful equity and support for publishing and open-sourcing your work.
Main requirements
Application
Posted last month
Members feature · See plans
Remember: Vagaslume.Tech never charges fees, courses or payments to take part in hiring processes. If you are asked to pay anything related to being hired, do not make the payment.