Back to list

Sambanova Cloud

Sambanova Cloud

A High-Speed Inference Platform for Developers

A High-Speed Inference Platform for Developers

Live Preview

Live Preview

What was the project about?

What was the project about?

  • Design a B2C-focused platform offering ultra-fast and low-cost inference APIs for LLMs, vision, and audio models.

  • The goal was to compete directly with platforms like OpenAI, Groq, and Together.ai by providing 10x faster inference at 1/10th the cost.

  • Design a B2C-focused platform offering ultra-fast and low-cost inference APIs for LLMs, vision, and audio models.

  • The goal was to compete directly with platforms like OpenAI, Groq, and Together.ai by providing 10x faster inference at 1/10th the cost.

Approach

Approach

1

Discovery & Research

  • I collaborated with PM (Debarun) to understand goals and feature requirements.

  • I researched leading competitive products - OpenAI, Groq, Together.ai, to assess their UX standards, API management flows, and billing transparency.

  • We discussed project scope for the MVP with the developers and prioritized speed, clarity, and developer-first UX

2

Ideation

  • I started working with base wireframes. Me and Debarun went back and forth on the features that were needed. Once we were convinced post discussion from senior product folks and CEs, I moved to high-fidelity designs

  • I used the in-house Brick Design System for consistency and fast iteration.

  • For the MVP, we designed interfaces for:

    • API management (create/manage multiple keys)

    • Playground (test model outputs in real time)

    • Billing Dashboard (token usage by model, input/output cost breakdown)

3

Collaboration

  • We later worked closely with frontend and backend engineers to get the MVP implemented

  • Post-launch, we quickly identified and resolved key UI issues based on internal QA and usage analytics.

Playground Interface

Playground Interface

The Playground provides an intuitive testing environment with pre-set prompts and real-time performance metrics, allowing developers to evaluate model behavior before integration

The Playground provides an intuitive testing environment with pre-set prompts and real-time performance metrics, allowing developers to evaluate model behavior before integration

Model Selection Experience

Model Selection Experience

A streamlined model selector gives users access to a diverse range of specialised models, from general text LLMs to vision and multilingual capabilities

A streamlined model selector gives users access to a diverse range of specialised models, from general text LLMs to vision and multilingual capabilities

API Management

API Management

The API management interface combines security best practices with developer convenience, providing ready-to-use code snippets in multiple languages

The API management interface combines security best practices with developer convenience, providing ready-to-use code snippets in multiple languages

Transparent Pricing Structure

Transparent Pricing Structure

The tiered pricing approach makes SambaNova Cloud accessible to individual developers while offering scalable options for growing enterprises.

The tiered pricing approach makes SambaNova Cloud accessible to individual developers while offering scalable options for growing enterprises.

Usage Analytics Dashboard

Usage Analytics Dashboard

Detailed token usage tracking promotes cost transparency and helps developers optimize their applications

Detailed token usage tracking promotes cost transparency and helps developers optimize their applications

Key design decisions

Key design decisions

  • Structured the playground interface to mirror industry norms while clearly surfacing token usage and latency.

  • Added inline documentation and quick links to reduce cognitive load for first-time users.

  • Created a scalable API management experience that later enabled multi-key support without UI overhaul.

  • Built an extensible billing system interface designed to support future enterprise integrations.

  • Structured the playground interface to mirror industry norms while clearly surfacing token usage and latency.

  • Added inline documentation and quick links to reduce cognitive load for first-time users.

  • Created a scalable API management experience that later enabled multi-key support without UI overhaul.

  • Built an extensible billing system interface designed to support future enterprise integrations.

Impact

Impact

50,000+ signups in the first 6 weeks of launch.

50,000+ signups in the first 6 weeks of launch.

Achieved 7–8% conversion rate, nearly double the industry standard (~4.5%).

Achieved 7–8% conversion rate, nearly double the industry standard (~4.5%).

30% of users returned consistently after the first week of use

30% of users returned consistently after the first week of use

Tools

Tools

Figma

Slack

Jira

I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.

Samrat Deep Prasad

Senior Product Manager, Sambanova Systems

Create a free website with Framer, the website builder loved by startups, designers and agencies.