Julius AI logo

Software Engineer - Infrastructure & Security

Julius AI
Full-time
On-site
San Francisco, California, United States

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team lunches

We are an early stage applied AI lab building coding agents. We’re on a mission to enable one billion humans to become software creators, and we are starting with a focus on data science and analysis use cases.

Today, Julius writes and executes 1 million lines of code every 36 hours, has served over 1 million users and generated over 3 million data visualizations. This code runs on remote containers that we manage. Building our own infrastructure for code execution helps us deliver rich user experience and performance.


In this role, you will help build and scale this cloud infrastructure for code execution. Currently we serve over 500,000 containers remote containers every month and growing!

We're a small technical team with experience from Uber, Microsoft and Facebook. We're making revenue and we're backed by some of best investors like AI Grant, and founders of Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, Dropbox and researchers from OpenAI and Google DeepMind.

What you'll do:

  • Build infrastructure and security systems that bring AI code capabilities to millions of people

  • Obsess over performance and help us reach the scale of hundreds of millions of containers per month

  • Focus on observability and ensure reliability of our infrastructure

Relevant Experience:

  • Containerization: Docker, container orchestration (Kubernetes preferred)

  • Cloud platforms: AWS, Azure, or GCP

  • Infrastructure as Code: Terraform, CloudFormation, or similar tools

  • Networking: TCP/IP, DNS, load balancing

  • Monitoring and logging: Prometheus, Grafana, ELK stack

  • Security best practices for containerized environments

Bonus points: You have built an AI side project before, and like prompting and playing with LLMs