How Anyshift Scales Real-Time Queries Across Millions of Nodes with Koyeb

Anyshift provides AI context for your infrastructure, powered by Annie—an AI infrastructure assistant trained on your environment. From answering complex infrastructure questions to suggesting Terraform code and catching hidden issues, Annie helps teams manage, monitor, and optimize their infrastructure with ease and precision.

Unlike generic AI copilots, Anyshift provides context-aware insights based on your actual infrastructure and codebase—not just LLM guesses. Using Anyshift's MCP server, teams can connect to their infrastructure knowledge with different AI tools and platforms, like Cursor, Claude Code, and Claude Desktop.

As an early-stage startup building AI-powered developer tools, the Anyshift team needs infrastructure that can keep up.

“We needed high-performance infrastructure that wouldn’t slow us down. We needed a platform our developers could move fast on, that supported infrastructure as code and let us deploy globally without hassle,” says Anyshift co-founder and CTO Stephane Jourdan. “Koyeb checked all those boxes”.

Challenge: Build the Business, Not the Infrastructure

Anyshift is an early-stage startup that is focused on shipping fast, talking to users, and finding product-market fit—not spending time spinning up or managing infrastructure.

I’ve spent 25 years managing infrastructure. When you’re building an early-stage startup, your job is to move fast, talk to users, build product, and find product-market fit. Infrastructure isn’t the challenge—I need to invest my time elsewhere.

The Anyshift team needed a solution that could keep up with the demands of a fast-moving, infrastructure-heavy product:

• High-performance infrastructure: Reliable, fast, and production-ready from day one
• Fast deployments: The ability to spin up PoCs, run live demos, prototype and iterate on new features quickly.
• Global deployments: With a distributed team in the U.S. and Europe, and users around the world, low-latency, multi-region deployments were a must-have
• Terraform Support: 90% of Anyshift’s infrastructure is managed with Terraform. They needed a platform that supports the way they work.
• Scalability: From early PoCs to production traffic, infrastructure had to scale instantly without downtime or added complexity.

Technical Stack

Anyshift’s MCP server and backend services are written in Go. The Anyshift team uses Neo4j for their knowledge graph and a managed PostgreSQL instance for their development and staging environments.

From 0 to Proof of Concept in No Time

When you're working with new clients, speed matters. With Koyeb, Anyshift’s team can spin up proof-of-concepts from scratch in a matter of minutes—no infrastructure to prep, no manual setup to slow things down. It's a huge advantage for an early-stage startup juggling fast-moving customer conversations.

The ability to move from zero to live, scalable demos without friction gives Anyshift a critical edge—not just in building fast, but in how fast they can show up ready.

Scaling Real-Time Queries Across Millions of Nodes with Koyeb

One high-stakes demo for a large enterprise made that speed and scalability clear. This client had over 15 AWS accounts, 25,000 instances, and 200 GitHub repositories, resulting in millions of nodes and edges in Anyshift's knowledge graph.

As their users began firing off questions via Claude Desktop, every query was passing through Anyshift's backend running on Koyeb. With Datadog monitoring latency in real-time, the Anyshift team saw the load increase and knew they needed to scale immediately.

With Koyeb, Anyshift scaled up the number of instances and workers instantly, keeping performance fast and the demo on track. “If we’d been on EC2, we would’ve had to shut down instances, restart them, and lost 20 minutes—right in the middle of the demo. With Koyeb, we scaled in seconds. It saved us.”

Infrastructure as Code With Koyeb’s Terraform Provider

The Anyshift team relies on Koyeb’s Terraform provider for nearly 90% of their infrastructure management.

“We need our infrastructure to scale with us, and we also need it to be repeatable and consistent. With Terraform, we can automate everything—whether it’s creating new services or managing dev and staging environments. Our team has full autonomy to deploy and manage resources.”

The ability to manage infrastructure as code allows Anyshift to keep environments in sync, avoid configuration drift, and replicate setups quickly, making it easier to test new features and scale seamlessly.

“With Koyeb, we get the benefits of a managed serverless deployment experience with the flexibility and control of infrastructure as code. It’s perfect for our team’s needs.”

Faster Prototyping and Team Velocity

“We're a distributed team working across time zones, so autonomy is critical,” explains Stephane. “With Koyeb, engineers don’t have to wait on me or another team member to get started. If someone wants to prototype a new service or test an idea, they can just spin it up on Koyeb.”

This independence is key for early-stage startups moving fast. Koyeb enables rapid experimentation without blockers—so ideas can go from concept to deployed in minutes.

“Everyone can move independently. If someone in Europe wants to try out a new feature while the rest of us are asleep, they don’t need to ask permission or wait for infra support. They deploy it, test it, and iterate.”

Effortless Global Deployments

“Our team is distributed across the U.S. and Europe, and our end users are located all around the world,” says Stephane. “We rely on a CDN to serve content, but when it can’t return a response, it needs to route to the nearest core location. So we needed to deploy in multiple regions and to run close to our end users.”

With Koyeb’s platform, Anyshift can deploy across multiple regions effortlessly, ensuring that they deliver reliable, low-latency services to users globally. Using Koyeb’s Terraform provider, the team can easily manage infrastructure across regions, making deployments both fast and repeatable.

“Koyeb makes global deployments easy, handling the complexity behind the scenes so we can focus on delivering value to users everywhere.”

One Platform for High-Performance Serverless GPUs and CPUs

As Anyshift explores new AI capabilities—including self-hosting small open-source models—they need the flexibility to deploy across different types of hardware without added complexity.

“It’s amazing that Koyeb offers the same seamless serverless experience across all the hardware types we need, including high-performance GPUs.”

Access to high-performance GPUs and CPUs on the same platform with the ease of serverless deployment means Anyshift’s team can focus on innovation rather than managing complex hardware. Also, the one-click deployments enable the team to rapidly prototype and test the best open-source models.

Getting Started with the Koyeb Startup Program

“Two startups ago, I built a similar PaaS on bare metal for cloud-native applications. I know very well the interest and value of this kind of platform,” says Stephane. “Now, as I’m building Anyshift, I want to focus on developing the business—not managing infrastructure. So, when I saw Koyeb launched their Startup Program, I was really excited.”

Through the Koyeb Startup Program, Anyshift got access to the infrastructure and support they needed quickly. The direct line to the Koyeb team made it easy to get up and running fast, allowing Anyshift to stay focused on building their product—not managing infrastructure.

“It’s not about the startup credits, it’s about the focus and time I win back by not managing the infrastructure. Koyeb just works. I love the managed experience Koyeb provides. My team and I don’t need to worry about infrastructure; we just ship.”

With their infrastructure handled, Anyshift could keep its focus where it matters—on building the product and growing the business.

Koyeb Features Used by Anyshift

• 🌐 Web Services
• 🕵️ Private Services
• ⚙️ Workers
• 🐘 Managed PostgreSQL Database
• 🌎 Global Deployments in Washington, D.C. and Paris
• 🚀 Serverless GPU
• 📈 Native Scaling
• 🧑‍💻 Koyeb's Terraform Provider
• 💾 Volumes
• 🤫 Secrets

⏱️ 5 Minutes to Deploy Worldwide on Koyeb

Want to deploy your AI applications, APIs, full stack apps, databases, and background workers worldwide in minutes? Sign up and deploy your first service for free.

Ask Annie: Real-Time Infrastructure Insights with Anyshift

Ever wonder, "Why can't I access this RDS?" or other tricky questions about your infrastructure?

Meet Annie, an AI-powered infrastructure assistant built on a deep knowledge graph of your code, repositories, and cloud. Built by the team at Anyshift, Annie helps you debug faster, optimize performance, and answer your toughest infra questions. Simply connect your cloud providers and Git repositories, and get started with Anyshift in minutes.