Senior AI Engineer
Job Description
DV Trading is building a centralized AI function and hiring for the model layer: fine-tuning and distilling open-weight models (Llama, Qwen, Mistral) for firm-specific tasks, operating on-prem inference infrastructure, and building a model gateway routing across open and closed providers.
Responsibilities
- Build and operate a model gateway with cost/latency/quality tracking
- Run distillation pipelines for open-weight models
- Deploy on-prem inference (vLLM/TGI) on Kubernetes
- Build model evaluation frameworks and partner with the agent engineering team
What we are looking for
- 5+ years software engineering
- Strong Python
- Production fine-tuning/distillation experience
- GPU infrastructure management and Kubernetes
Additional Information
DV Trading is an independent proprietary trading firm (part of the DV Group, which includes a cryptocurrency market-making affiliate) providing liquidity across global financial and commodity markets.
Keywords: Python, LLM fine-tuning/distillation, vLLM/TGI, Kubernetes, GPU infrastructure, model gateway design
DV Trading
📍 Chicago, IL (also Hong Kong, London, New York, Singapore)Visit Company WebsiteDV Trading is an independent proprietary trading firm, part of the DV Group, providing liquidity across global financial and commodity markets. It is centralizing a firm-wide AI function for model fine-tuning, distillation, and on-prem inference infrastructure.
Apply To This Job<<>>
Support us by letting the company know you found them on our website.
Magica
Every AI You Need.Just $15/month.
Go To the Offer