The Japanese plan Ki models based on evolutionary calculations

The Japanese plan Ki models based on evolutionary calculations

Tokyo, 19.8.2023

Two former Google researchers, David Ha and Llion Jones, founded Sakana AI, a Tokyo-based AI startup with the goal of developing AI models based on evolutionary computations. Sakana’s research is inspired by natural principles such as evolution and collective intelligence.

Sakana AI plans to build a generative AI model, or a nature-inspired neural network, that is more adaptive than today’s models. The startup’s goal is to create new architectures for fundamental AI models instead of just scaling existing ones.

Instead of creating a single large model, Ha says the team could use many smaller models that communicate and work together to solve problems.

The duo chose Tokyo as the company’s headquarters due to its technical infrastructure, well-educated workforce and attractiveness to foreign talent.

Ha, CEO of Sakana, is a former research director at Stability AI and a former Google research scientist. Jones, who is CTO, was the fifth co-author of the landmark 2017 paper Attention Is All You Need, which introduced the Transformer deep learning architecture, which paved the way for chatbots like GPT-4 and others generative AI models.

Hits: 3