Software Engineer AI Gateway

Overview

In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.

Responsabilità

Build and maintain API management software for AI/LLMs and its underlying stack

Implement features like proxying, load balancing, and databases support for Kong AI Gateway

Troubleshoot bugs, tune performance, and perform low-level optimizations

Bridge Kong with third-party deployment platforms and tooling

Handle additional tasks as directed by management

Requisiti fondamentali

3+ years of server-side application and component development

Hands-on experience with Golang or Rust

Experience building and debugging highly scalable, distributed, reliable systems

Strong Linux systems troubleshooting and profiling skills

Knowledge of distributed systems and Linux networking; API exposure on L7/L4

Comfortable working with a remotely distributed team

Strong ownership and communication skills; experience documenting products

Familiarity with AI/LLM concepts and applications development

strong communication

ownership

collaboration

Golang or Rust

Linux troubleshooting and profiling

distributed systems