FriendliAI, founded in 2021 and headquartered in the United States, is positioning itself as a leader in the rapidly evolving artificial intelligence sector. The company specializes in offering a highly efficient AI Inference Cloud, branded as The Frontier AI Inference Cloud, which is designed to optimize GPU utilization for executing cutting-edge open-weight and custom models.
The startup's engine is built by researchers recognized for pioneering the continuous batching technique, now an industry standard, allowing their clients—mainly AI engineers—to operate at production scale with minimal cost. FriendliAI claims its services deliver execution speeds up to 3x faster than traditional vLLM approaches, with cost efficiencies ranging from 50% to 90% over closed model APIs.
The company's last funding was an KRW8.00B Seed Round on 15 December 2021 from investors including Capstone Partners, KB Securities, and KB Investment, further validating its innovative approach and potential for growth in the AI sector.