AI Gateway Engineer

About the Company We are seeking a skilled AI Gateway Engineer to join our team. The ideal candidate will have hands-on experience with AI or API gateways, a strong background in backend development, and expertise in deploying and optimizing AI/ML models in a production environment. You will be instrumental in building and scaling our AI infrastructure within an enterprise-grade setting. About the Role Key Responsibilities: Design and manage AI/API gateways like Kong, Mosaic, or Portkey. Develop and maintain backend services, primarily using Go, with Python as a valuable secondary skill. Optimize and productize AI/ML models for production use, ensuring performance, scalability, and reliability. Leverage AWS to build and manage our cloud infrastructure. Implement and manage observability tools, including OpenTelemetry (OTel), Grafana, and Prometheus, to monitor system health and performance. Apply prompt engineering techniques to improve the efficiency and effectiveness of AI models. Co...