modeldrift.watchA daily record of AI model behavior. All times UTC.

Observation period — public launch soon. The record below is real and updated daily.

Minor Pick-list change·recommendation·2026-09-11

GPT-5.6 Sol changed its recommendation list, as extracted: 1 added, 2 dropped.

Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-11 09:00:01 UTC (matches the pin)
Prompt
P29 (recommendation)
Change
1 added, 2 dropped
Baseline
1 prior day with data; 1 matched the baseline value (2026-09-10)
Detected
2026-09-11 · run 20260911T090002Z-da0dd3 (2026-09-11 09:00:02 UTC) · scorer v1
Severity
minor — rule: other pick-list changes are minor
Event ID
2026-09-11:P29:openai/gpt-5.6-sol:pick_change:picks
Permalink
https://modeldrift.watch/e/2026-09-11/P29/openai/gpt-5.6-sol/pick_change/picks/
Prompt P29sent verbatim
I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

Why this prompt Company-size arm; leaders should hold, mid-market should swap.

Before baseline

2026-09-10

Scored
answered
Received
2026-09-10 22:35:28 UTC
Run
20260910T221001Z-bb5bd1
Served by
OpenAI · finish stop
Size
2,670 characters · 875 tokens out incl. hidden reasoning · 18.0 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. HubSpot Marketing Hub Enterprise
  4. Braze
  5. Klaviyo
  6. Mailchimp

Highlighted: the names the extractor took as picks, where they appear verbatim (6 of 6).

For a 5,000-person US enterprise, the best choice depends more on your customer model and existing technology stack than employee count.
### Recommended shortlist
| Situation | Best fit |
|---|---|
| Complex B2B demand generation, lead scoring, and long sales cycles | **Adobe Marketo Engage** |
| Salesforce-centric organization with large-scale B2C or multichannel campaigns | **Salesforce Marketing Cloud** |
| Fast deployment, strong usability, lighter operational burden | **HubSpot Marketing Hub Enterprise** |
| Product-led lifecycle messaging across email, mobile, push, and in-app | **Braze** or **Iterable** |
| Ecommerce/retail | **Klaviyo** |
| Primarily newsletters and basic campaigns | **Mailchimp**, though usually not ideal as an enterprise-wide strategic platform |
### My default recommendation
If your company is a typical enterprise B2B organization, I would shortlist:
1. **Adobe Marketo Engage** — best for sophisticated lead management and sales alignment.
2. **HubSpot Enterprise** — best if ease of use, adoption, and time to value matter most.
3. **Salesforce Marketing Cloud/Account Engagement** — best if Salesforce is already your strategic CRM and you can support a more complex implementation.
I would generally select **Marketo** for advanced B2B requirements, **HubSpot** for operational simplicity, or **Salesforce** when platform consolidation outweighs cost and complexity.
### Procurement requirements to include
Do not compare vendors on subscription price alone. Require pricing and contractual clarity around:
- Contact, profile, email-volume, API, and data-storage overages
- Sandbox and business-unit charges
- SSO, SCIM, role-based access, and audit logs
- SOC 2 Type II, ISO 27001, DPA, subprocessors, and breach notification
- CAN-SPAM, CCPA/CPRA, consent management, and suppression-list handling
- Dedicated IPs, deliverability support, and sender reputation migration
- CRM/CDP/data warehouse integrations
- Implementation, migration, training, and premium support
- Uptime and support SLAs with service credits
- AI use of company/customer data and model-training restrictions
- Data export, deletion, transition assistance, and renewal caps
Run a paid proof of concept using one real campaign, one CRM integration, consent migration, reporting, and deliverability testing. Score the full three-year total cost of ownership, including implementation and internal administration.
**Bottom line:** For an enterprise B2B procurement process, start with **Marketo, HubSpot Enterprise, and Salesforce**. If your use case is consumer lifecycle engagement rather than lead generation, replace Marketo with **Braze**.

End of response · 42 lines · 2,670 characters · sha256 6f542773d920fae08b12040ae62383ddba8d97239264f99c759cede8319ab350

After this run

2026-09-11

Scored
answered
Received
2026-09-11 09:31:53 UTC
Run
20260911T090002Z-da0dd3
Served by
OpenAI · finish stop
Size
2,248 characters · 985 tokens out incl. hidden reasoning · 28.3 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Adobe Journey Optimizer

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

Company size alone shouldn’t determine the platform. For a 5,000-person US enterprise, I’d create this shortlist:
| Primary use case | Best-fit platform |
|---|---|
| Complex B2B lead nurturing and account-based marketing | **Adobe Marketo Engage** |
| Salesforce-centric CRM and sophisticated cross-channel journeys | **Salesforce Marketing Cloud** |
| Consumer lifecycle marketing across email, mobile, app, and web | **Braze** or **Iterable** |
| Fast deployment and ease of administration outweigh maximum complexity | **HubSpot Marketing Hub Enterprise** |
| Already standardized on Adobe Experience Cloud | **Adobe Journey Optimizer** |
### Practical recommendation
- **B2B enterprise:** Start with **Marketo, Salesforce Marketing Cloud, and HubSpot Enterprise**.
- **B2C/digital product:** Start with **Braze, Salesforce Marketing Cloud, and Adobe Journey Optimizer**.
- If Salesforce is already your strategic CRM, **Salesforce Marketing Cloud** is usually the safest default—though implementation and operating costs can be substantial.
- If your priority is B2B nurture, scoring, and sales alignment, **Marketo** is generally the stronger default.
- If simplicity and speed matter more than highly customized journeys, choose **HubSpot Enterprise**.
### Procurement scorecard
I would weight the RFP approximately as follows:
- Functional fit and journey orchestration: **25%**
- CRM, CDP, data warehouse, and API integration: **20%**
- Deliverability, consent, and preference management: **15%**
- Security, privacy, SSO/SCIM, RBAC, and auditability: **15%**
- Three-year total cost, including implementation and overages: **15%**
- Usability, administration, and vendor support: **10%**
Require vendors to disclose pricing drivers—contacts, sends, profiles, API calls, environments, dedicated IPs, support, and implementation—and test them with your projected three-year growth. Also require a proof of concept using an actual campaign and data flow, not a canned demonstration.
If “email marketing” actually means supplier communications or internal employee email rather than customer marketing, these may be overbuilt; a supplier portal, Microsoft 365 tooling, or a dedicated communications platform could be more appropriate.

End of response · 32 lines · 2,248 characters · sha256 a21b790497a97504003495372544fb13955abd733709a2cc1e48435f2bb2e2e1

Reading this record

Response text is shown exactly as the API returned it, with Markdown left unrendered. Line numbers and highlights are added by this site; highlights come from the same patterns the scorer uses, so they show what the verdict rests on. Each model is asked once per day (k = 1): a single change can be sampling noise, which is why every event links the full responses rather than a summary. How scoring works.