Perplexity has introduced Photon, a new in-house retrieval and ranking engine developed in Rust. This innovative engine replaces an earlier open-source solution that the company had previously forked, and it is now responsible for managing retrieval and ranking across all production traffic.
With Photon, Perplexity claims to have achieved a remarkable reduction in latency, cutting the p99 response time from 800 milliseconds to just 65 milliseconds. This enhancement is expected to boost the efficiency of the Perplexity Search API, particularly with the introduction of a new Fast Search mode, providing users with a faster and more seamless search experience.
Compiled automatically by the Tech AI Newsdesk from public AI-news sources and summarised in our own words.
