Does searching the web change what AI recommends?

Everywhere else on Modelocracy, models answer from what they already know. Here the same 10 models answered 6 software buying questions again after searching the web, each with its own search: GPT, Claude and Gemini with their lab's search, the rest through Exa. Products that only searching surfaces show up here.

Questions searched
6
Searched answers
487
New in a top 10
16products that reached a question's top 10 only with search

Best CRM software for small businesses

120 usual answers and 104 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
HubSpot100% #1100% #1±0 pts
Pipedrive100% #1100% #1±0 pts
Zoho CRM100% #1100% #1±0 pts
Freshsales100% #194% #4−6 pts
monday.com88% #684% #5−4 pts
Salesforce90% #571% #6−19 pts
Capsule23% #1353% #7+30 pts
Insightly70% #752% #8−18 pts
Less Annoying CRM48% #1051% #9+3 pts
Bigin8% #1945% #10+38 pts
Copper60% #838% #12−22 pts
Keap58% #910% #17−49 pts

Into the top 10 with search: Capsule, Bigin.

Out of the top 10 with search: Copper, Keap.

The usual list and each model's answers

Best project management software

120 usual answers and 106 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
Asana100% #1100% #1±0 pts
ClickUp100% #1100% #1±0 pts
monday.com100% #1100% #1±0 pts
Jira98% #497% #4−1 pts
Wrike93% #792% #5−1 pts
Smartsheet95% #692% #6−3 pts
Notion93% #786% #7−7 pts
Trello91% #983% #8−8 pts
Basecamp97% #576% #9−20 pts
Teamwork.com9% #1453% #10+44 pts
Linear48% #1047% #11−1 pts

Into the top 10 with search: Teamwork.com.

Out of the top 10 with search: Linear.

The usual list and each model's answers

Best help desk software

120 usual answers and 108 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
Freshdesk100% #1100% #1±0 pts
Help Scout100% #1100% #1±0 pts
Zoho Desk96% #4100% #1+4 pts
Intercom98% #399% #4+1 pts
Front59% #985% #5+26 pts
Jira Service Management84% #579% #6−5 pts
Zendesk74% #674% #7±0 pts
Gorgias68% #772% #8+4 pts
HubSpot Service Hub63% #850% #9−13 pts
LiveAgent31% #1140% #10+9 pts
Kayako49% #10not named−49 pts

Into the top 10 with search: LiveAgent.

Out of the top 10 with search: Kayako.

The usual list and each model's answers

Best Python libraries for reading and editing Excel files

80 usual answers and 67 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
openpyxl100% #1100% #1±0 pts
Pandas100% #1100% #1±0 pts
xlrd98% #4100% #1+3 pts
XlsxWriter100% #199% #4−1 pts
xlwings98% #497% #5±0 pts
pyexcel78% #678% #6±0 pts
pyxlsb63% #764% #7+2 pts
xlwt60% #843% #8−17 pts
Calamine26% #1037% #9+11 pts
Python calamine29% #934% #10+6 pts
pylightxl20% #1334% #10+14 pts

Into the top 10 with search: pylightxl.

The usual list and each model's answers

Best SDKs for AI agents that handle Office and PDF files

80 usual answers and 58 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
Unstructured44% #143% #1−1 pts
python-docx40% #233% #2−7 pts
Aspose.Total38% #433% #2−5 pts
Syncfusion13% #2233% #2+20 pts
LlamaParse26% #831% #5+5 pts
Reducto11% #2431% #5+20 pts
Extend3% #5829% #7+27 pts
openpyxl29% #628% #8−1 pts
Google Document AI16% #1828% #8+11 pts
Azure AI Document Intelligence23% #1226% #10+3 pts
AWS Textract18% #1626% #10+8 pts
PyMuPDF35% #522% #13−13 pts
Aspose.Words29% #622% #13−6 pts
Apryse26% #822% #13−4 pts
Apache POI39% #317% #18−22 pts
Microsoft Graph26% #812% #28−14 pts

Into the top 10 with search: Syncfusion, Reducto, Extend, Google Document AI, Azure AI Document Intelligence, AWS Textract.

Out of the top 10 with search: PyMuPDF, Aspose.Words, Apryse, Apache POI, Microsoft Graph.

The usual list and each model's answers

Best Python libraries for PowerPoint files

80 usual answers and 44 searched ones across 4 wordings · Share of answers that named it, and its place

ProductWithout searchWith searchChange
python-pptx100% #1100% #1±0 pts
Aspose.Slides95% #293% #2−2 pts
Spire.Presentation86% #380% #3−7 pts
python-pptx2not named73% #4+73 pts
power-pptxnot named68% #5+68 pts
pywin3225% #745% #6+20 pts
slidecraftnot named39% #7+39 pts
openpptxnot named36% #8+36 pts
LibreOffice30% #534% #9+4 pts
rpptxnot named27% #10+27 pts
unoconv28% #69% #16−18 pts
PptxGenJS44% #47% #20−37 pts
ReportLab23% #95% #25−18 pts
python-pptx-interface20% #105% #25−15 pts
Pillow25% #7not named−25 pts

Into the top 10 with search: python-pptx2, power-pptx, slidecraft, openpptx, rpptx.

Out of the top 10 with search: unoconv, PptxGenJS, ReportLab, python-pptx-interface, Pillow.

The usual list and each model's answers

How the trial works