Accenture Invests in Martian to Bring Dynamic Routing of Large Language Queries and More Effective AI Systems to Clients

Accenture (NYSE: ACN) has invested, through Accenture Ventures, in Martian, a technology company that has built a patent-pending Large Language Model (LLM) router. For any prompt, Martian’s router will find and use the LLM that will give users the best result at the lowest cost. As part of this investment, Accenture plans to integrate Martian’s advanced model router offering into its proprietary “switchboard” services that can customize large-language models (LLMs) for specific data sources and use cases for greater impact of AI systems.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240917605865/en/

Accenture has invested, through Accenture Ventures, in Martian, a technology company that has built a patent-pending Large Language Model (LLM) router. (Graphic: Business Wire)

The rapid expansion of AI systems and large language models has created a complex landscape where each model presents unique tradeoffs in performance, cost, and speed. Martian’s model router addresses these challenges by searching across a vast number of LLMs in order to dynamically route prompts to the model that will yield the highest quality results based on specific performance and technical requirements for each enterprise. The router also improves reliability; prompts are automatically rerouted to other providers when a model or provider becomes unavailable, significantly reducing downtime.

“Many of our clients are looking to reap the benefits of generative AI in a responsible way that takes into account customized requirements, performance and cost,” said Lan Guan, chief AI officer at Accenture. “The capabilities of Accenture’s switchboard services and Martian’s dynamic LLM routing simplify the user experience and will allow enterprises to experiment with generative AI and LLMs in order to find the perfect fit for their business needs.”

Launched in November 2023, Accenture’s switchboard service allows clients to test, evaluate, deploy, and control the most potent combination of LLMs for their needs. Integrating Martian’s dynamic router capabilities, clients will be able to open up access to AI systems with customized models tailored to unique prompts and requirements, ensuring optimal performance and cost-efficiency. New LLMs will be automatically added in and analyzed as they become available, helping ensure that outputs will be accurate and current. Switchboard services can be applied to emerging technologies such as quantum as well.