Sambanova Cloud
Sambanova Cloud
Sambanova Cloud
Sambanova Cloud
Sambanova Cloud
Sambanova Cloud
A High-Speed Inference Platform for Developers
A High-Speed Inference Platform for Developers
A High-Speed Inference Platform for Developers
A High-Speed Inference Platform for Developers
A High-Speed Inference Platform for Developers
A High-Speed Inference Platform for Developers
What was the project about?
What was the project about?
Design a B2C-focused platform offering ultra-fast and low-cost inference APIs for LLMs, vision, and audio models.
The goal was to compete directly with platforms like OpenAI, Groq, and Together.ai by providing 10x faster inference at 1/10th the cost.
Design a B2C-focused platform offering ultra-fast and low-cost inference APIs for LLMs, vision, and audio models.
The goal was to compete directly with platforms like OpenAI, Groq, and Together.ai by providing 10x faster inference at 1/10th the cost.
Approach
Approach
1
1
1
1
1
Discovery & Research
I collaborated with PM (Debarun) to understand goals and feature requirements.
I researched leading competitive products - OpenAI, Groq, Together.ai, to assess their UX standards, API management flows, and billing transparency.
We discussed project scope for the MVP with the developers and prioritized speed, clarity, and developer-first UX
2
2
2
2
2
Ideation
I started working with base wireframes. Me and Debarun went back and forth on the features that were needed. Once we were convinced post discussion from senior product folks and CEs, I moved to high-fidelity designs
I used the in-house Brick Design System for consistency and fast iteration.
For the MVP, we designed modular interfaces for:
API management (create/manage multiple keys)
Playground (test model outputs in real time)
Billing Dashboard (token usage by model, input/output cost breakdown)
3
3
3
3
3
Collaboration
We later worked closely with frontend and backend engineers to get the MVP implemented
Post-launch, we quickly identified and resolved key UI issues based on internal QA and usage analytics.
Playground Interface
Playground Interface
The Playground provides an intuitive testing environment with pre-set prompts and real-time performance metrics, allowing developers to evaluate model behavior before integration
The Playground provides an intuitive testing environment with pre-set prompts and real-time performance metrics, allowing developers to evaluate model behavior before integration
Model Selection Experience
Model Selection Experience
A streamlined model selector gives users access to a diverse range of specialised models, from general text LLMs to vision and multilingual capabilities
A streamlined model selector gives users access to a diverse range of specialised models, from general text LLMs to vision and multilingual capabilities
API Management
API Management
The API management interface combines security best practices with developer convenience, providing ready-to-use code snippets in multiple languages
The API management interface combines security best practices with developer convenience, providing ready-to-use code snippets in multiple languages
Transparent Pricing Structure
Transparent Pricing Structure
The tiered pricing approach makes SambaNova Cloud accessible to individual developers while offering scalable options for growing enterprises.
The tiered pricing approach makes SambaNova Cloud accessible to individual developers while offering scalable options for growing enterprises.
Usage Analytics Dashboard
Usage Analytics Dashboard
Detailed token usage tracking promotes cost transparency and helps developers optimize their applications
Detailed token usage tracking promotes cost transparency and helps developers optimize their applications
Key design decisions
Key design decisions
Structured the playground interface to mirror industry norms while clearly surfacing token usage and latency.
Added inline documentation and quick links to reduce cognitive load for first-time users.
Created a scalable API management experience that later enabled multi-key support without UI overhaul.
Built an extensible billing system interface designed to support future enterprise integrations.
Structured the playground interface to mirror industry norms while clearly surfacing token usage and latency.
Added inline documentation and quick links to reduce cognitive load for first-time users.
Created a scalable API management experience that later enabled multi-key support without UI overhaul.
Built an extensible billing system interface designed to support future enterprise integrations.
Impact
Impact
50,000+ signups in the first 6 weeks of launch.
Achieved 7–8% conversion rate, nearly double the industry standard (~4.5%).
30% of users returned consistently after the first week of use.
Garnered positive buzz across social media and developer communities, validating the design and product direction.
50,000+ signups in the first 6 weeks of launch.
Achieved 7–8% conversion rate, nearly double the industry standard (~4.5%).
30% of users returned consistently after the first week of use.
Garnered positive buzz across social media and developer communities, validating the design and product direction.
Tools
Tools
Figma
Slack
Jira
I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.
Samrat Deep Prasad
Senior Product Manager, Sambanova Systems
I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.
Samrat Deep Prasad
Senior Product Manager, Sambanova Systems
I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.
Samrat Deep Prasad
Senior Product Manager, Sambanova Systems
I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.
Samrat Deep Prasad
Senior Product Manager, Sambanova Systems
I had the pleasure of working with Rahul in his role as a Senior Product Designer, and I couldn’t have asked for a better design partner. Rahul is incredibly professional, proactive, and consistently delivers high-quality design work—especially during crunch times when deadlines were tight and stakes were high. He always brought clarity to our collaboration, often going the extra mile to ensure we were aligned and making progress. His ability to combine creativity with execution made a real difference to our product outcomes. Beyond work, Rahul is approachable, thoughtful, and someone I’m lucky to now call a friend. Any team would be fortunate to have him—both as a designer and as a collaborator.
Samrat Deep Prasad
Senior Product Manager, Sambanova Systems