Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Parallel Search advanced tops Artificial Analysis Search Index

AI summary

Artificial Analysis benchmarked Parallel Search API’s fast and advanced modes across 1,700 search-focused tasks using its Stirrup harness and GPT-5.6 Luna. In the November runs, advanced scored 83 and ranked first among 26 entries on the Search Index, while fast scored 82 and ranked fourth. Both modes scored 89 F1 on DeepSearchQA, with fast averaging about $0.014 per task and advanced about $0.030.

In-depth insight

Artificial Analysis provides independent performance and cost measurements for Parallel Search against competing AI search services, including Keenable Search Pro, Exa and Perplexity.

Parallel Search scores 83 on the Artificial Analysis Search Index, level with Keenable Search (pro) at the top of the board, with a fast mode at 82 for $0.014 per task

We benchmarked two modes of @p0's Parallel Search API, fast and advanced, in our Stirrup agent harness with Parallel Search as its web_search tool to complete 1700 search-focused tasks.

In our August runs, advanced scored 75 and fast scored 73. In these November runs, advanced scores 83 and fast scores 82.

Key benchmarking results for Parallel Search:

➤ Artificial Analysis Search Index: Parallel Search (advanced, objective) scores 83, 1st of 26, and Parallel Search (fast, objective) 82, 4th. That is a ~50-point lift over the same model with no search (33). Advanced is level with Keenable Search (pro) at 83 and 3 points ahead of Exa (auto, dynamic highlights) and Perplexity (medium) at 80. Fast is slightly ahead of both

➤ DeepSearchQA is Parallel's strongest benchmark: both modes score 89 F1, 1st and 2nd of 26, comparable to Keenable Search (pro) at 88. Advanced also ranks 1st on AA-Omniscience (74%), just ahead of Keenable Search (pro) (73%), and 3rd on BrowseComp (87%, level with Keenable Search (pro) and Perplexity (medium))

#Parallel Search API#Artificial Analysis#Keenable Search Pro#Exa#Perplexity#GPT-5.6 Luna#Stirrup#TinyFish

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.