Upstage said Friday that its large language model (LLM) solution "Solar" will utilize FriendliAI's graphics processing units (GPUs) management solution to handle translation data and enhance performance efficiency. Solar is a deep-learning platform capable of understanding and generating content.
Previously, Upstage released a Korean-English translation specialized model in the form of an application programming interface (API), which allows different software applications to communicate with each other.
To efficiently process up to 100,000 translation inquiries per day, Upstage adopted FriendliAI's management solution “Friendli Dedicated Endpoint.”
Upstage explained that it significantly reduced GPU costs through FriendliAI's "auto-scaling" feature, which adjusts the allocation of GPUs based on traffic load.
"We are pleased to have reduced the operational costs of the Solar translation model through our collaboration with FriendliAI, a leading company in generative AI infrastructure," Upstage CEO Kim Seong-hoon said in a press release.
