Were looking for a talented Backend Engineer with plenty of hands-on experience to join our dynamic team, building a state-of-the-art platform for benchmarking, evaluating and monitoring LLM-based applications. Youll design and implement scalable backend systems to support advanced evaluation workflows, under high-volume, low-latency performance requirements. This role offers a unique opportunity to work on the cutting edge of LLM/LLMOps systems in a fast-paced startup environment.
What you will do:
Design, develop and deploy distributed backend systems in Python, onto AWS cloud.
Own features end-to-end: from ideation, architecture design, coding, integration, all the way to deployment and testing.
Build, maintain and optimize our APIs (REST/SDK) for seamless platform functionality.
Ensure system reliability through testing and CI/CD pipeline contributions.
Collaborate with Product and Machine Learning Engineers to deliver innovative LLM evaluation tools.
What you will do:
Design, develop and deploy distributed backend systems in Python, onto AWS cloud.
Own features end-to-end: from ideation, architecture design, coding, integration, all the way to deployment and testing.
Build, maintain and optimize our APIs (REST/SDK) for seamless platform functionality.
Ensure system reliability through testing and CI/CD pipeline contributions.
Collaborate with Product and Machine Learning Engineers to deliver innovative LLM evaluation tools.
Requirements:
At least 5 years of backend development experience.
Proficiency in Python (or other high-level programming language, such as Java, Golang) with amazing coding skills.
Experience with relational databases (e.g. PostgreSQL) and complex data migrations and message queue technologies (e.g. SQS, RabbitMQ, Kafka)
Familiarity with AWS ecosystem (e.g. EKS, Queues, Redis, RDS, IAM) or other cloud provider.
Knowledge of REST/SDK API best practices development.
Ability to own features end-to-end (from design to deployment).
Product-driven mindset focused on scalable solutions.
Collaborative, adaptable mindset for a fast-moving startup (prior startup experience is valuable).
Nice to have:
Advantage to Frontend/Fullstack experience, in particular with React and TypeScript.
Familiarity with JS fundamentals, component-based architecture and modern frontend workflows.
Proficiency in DevOps technologies (Docker, Kubernetes, Terraform, Monitoring and Observability Tools).
Experience with LLM-based systems or MLOps.
At least 5 years of backend development experience.
Proficiency in Python (or other high-level programming language, such as Java, Golang) with amazing coding skills.
Experience with relational databases (e.g. PostgreSQL) and complex data migrations and message queue technologies (e.g. SQS, RabbitMQ, Kafka)
Familiarity with AWS ecosystem (e.g. EKS, Queues, Redis, RDS, IAM) or other cloud provider.
Knowledge of REST/SDK API best practices development.
Ability to own features end-to-end (from design to deployment).
Product-driven mindset focused on scalable solutions.
Collaborative, adaptable mindset for a fast-moving startup (prior startup experience is valuable).
Nice to have:
Advantage to Frontend/Fullstack experience, in particular with React and TypeScript.
Familiarity with JS fundamentals, component-based architecture and modern frontend workflows.
Proficiency in DevOps technologies (Docker, Kubernetes, Terraform, Monitoring and Observability Tools).
Experience with LLM-based systems or MLOps.
This position is open to all candidates.
