MODELDRIFT.WATCH

Sep 30 · Day 21

MINOR · GPT · QUESTION 33

GPT changed its list for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 29beforePermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Adobe Experience Cloud/CDP environment
  3. Braze
  4. CRM/CDP/data integration 20%
  5. Three-year TCO 15%

For a 5,000-person enterprise, the right platform depends more on your customer model and existing stack than company size.

Practical shortlist

Best fitRecommended platform
B2B lead generation, scoring, nurture, and CRM alignmentAdobe Marketo Engage
B2B with highly complex segmentation/governance, especially Oracle-centricOracle Eloqua
B2C email plus mobile, app, and real-time lifecycle messagingBraze
B2C enterprise already standardized on SalesforceSalesforce Marketing Cloud
Adobe Experience Cloud/CDP environmentAdobe Journey Optimizer
Microsoft Dynamics environment with moderate complexityDynamics 365 Customer Insights – Journeys
Simpler deployment and lower administrative burdenHubSpot Marketing Hub Enterprise

My default recommendation

  • •Primarily B2B: Start with Marketo Engage, with Eloqua and HubSpot Enterprise as comparison bids.
  • •Primarily B2C/omnichannel: Start with Braze, with Salesforce Marketing Cloud and Adobe Journey Optimizer as comparison bids.
  • •Already deeply invested in Salesforce, Adobe, Microsoft, or Oracle: Give the incumbent ecosystem an integration and TCO advantage—but still run a competitive proof of concept. Ecosystem fit does not automatically mean lower total cost.

What procurement should evaluate

Use a weighted scorecard rather than feature-counting:

  • •Business and journey capability: 25%
  • •CRM/CDP/data integration: 20%
  • •Deliverability and sender support: 15%
  • •Security and governance: 15%
    Require SAML SSO, SCIM, granular RBAC, audit logs, SOC 2 Type II, ISO 27001, DPA/CCPA support, and appropriate data residency.
  • •Three-year TCO: 15%
  • •Implementation, support, and vendor viability: 10%

Require finalists to execute three real journeys using representative data, including consent suppression, preference management, failure handling, and reporting. Test marketer usability as well as architecture.

Contract risks to control

  • •Pricing based on contacts, profiles, messages, API calls, or data storage
  • •Charges for inactive or duplicate profiles
  • •Mandatory implementation partners and premium support
  • •Overage rates and automatic tier upgrades
  • •Dedicated IP and deliverability-service fees
  • •Data export, deletion, and transition assistance at termination
  • •Annual uplift caps and renewal notice periods
  • •SLA credits that are too small to matter
  • •Ambiguous ownership of templates, configurations, and generated data

If I had to make a recommendation without more information: Marketo for a B2B enterprise; Braze for a B2C/digital-product enterprise; Salesforce Marketing Cloud only when Salesforce ecosystem alignment is a major strategic requirement.

SEP 30afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Journeys
  6. CRM
  7. SSO
  8. Sandbox
  9. Implementation
  10. SLA

Company size alone isn’t enough; the right choice depends mainly on whether you’re marketing to businesses or consumers and your existing CRM/data stack.

Practical shortlist

SituationBest-fit platform
B2B demand generation, lead scoring, complex nurtureAdobe Marketo Engage
Salesforce-centric enterprise, broad cross-channel campaignsSalesforce Marketing Cloud Engagement
High-volume B2C lifecycle marketing across email, mobile, and appBraze or Iterable
Ease of use and fast deployment matter more than maximum complexityHubSpot Marketing Hub Enterprise
Microsoft-centric environment seeking integrated customer journeysDynamics 365 Customer Insights – Journeys

My default recommendation

  • •B2B enterprise: Start with Adobe Marketo Engage, particularly if you have mature revenue operations and complex lead-management requirements.
  • •B2C or digital product: Start with Braze.
  • •Heavily invested in Salesforce: Favor Salesforce Marketing Cloud Engagement, but validate implementation complexity and total cost.
  • •Lean marketing operations team: Favor HubSpot Enterprise; it is generally easier to administer, though it may be less suitable for highly customized, high-scale programs.

Procurement requirements to include in the RFP

Evaluate vendors on:

  • 1.CRM, CDP, data warehouse, and identity integrations
  • 2.Deliverability tooling and dedicated-IP options
  • 3.Consent, suppression, retention, and audit capabilities
  • 4.SSO, SCIM, role-based access, SOC 2, and relevant regulatory support
  • 5.Contact and event limits—not just quoted email volume
  • 6.Sandbox, testing, approval workflows, and business-unit separation
  • 7.Implementation, migration, premium support, and partner costs
  • 8.API limits and fees for data export or additional environments
  • 9.SLA, breach notification, data ownership, and exit assistance
  • 10.Three-year total cost, including expected database growth and overages

Run a proof of concept using one real campaign, one key CRM/data integration, and an inbox-placement test. Score business-user effort and ongoing administration—not just feature breadth.

If I had to select a shortlist without further context, I would RFP Marketo, Salesforce Marketing Cloud, and HubSpot for B2B, or Braze, Iterable, and Salesforce Marketing Cloud for B2C.

Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-29 permalink

Scored
answered
Received
2026-09-29 09:25:21 UTC
Run
20260929T090007Z-334891
Served by
OpenAI · HTTP 200 · finish stop
Size
2,792 characters · 947 tokens out incl. hidden reasoning · 15.7 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Adobe Experience Cloud/CDP environment
  3. Braze
  4. CRM/CDP/data integration 20%
  5. Three-year TCO 15%

Highlighted: the names the extractor took as picks, where they appear verbatim (3 of 5).

For a 5,000-person enterprise, the right platform depends more on your customer model and existing stack than company size.
### Practical shortlist
| Best fit | Recommended platform |
|---|---|
| B2B lead generation, scoring, nurture, and CRM alignment | **Adobe Marketo Engage** |
| B2B with highly complex segmentation/governance, especially Oracle-centric | **Oracle Eloqua** |
| B2C email plus mobile, app, and real-time lifecycle messaging | **Braze** |
| B2C enterprise already standardized on Salesforce | **Salesforce Marketing Cloud** |
| Adobe Experience Cloud/CDP environment | **Adobe Journey Optimizer** |
| Microsoft Dynamics environment with moderate complexity | **Dynamics 365 Customer Insights – Journeys** |
| Simpler deployment and lower administrative burden | **HubSpot Marketing Hub Enterprise** |
### My default recommendation
- **Primarily B2B:** Start with **Marketo Engage**, with Eloqua and HubSpot Enterprise as comparison bids.
- **Primarily B2C/omnichannel:** Start with **Braze**, with Salesforce Marketing Cloud and Adobe Journey Optimizer as comparison bids.
- **Already deeply invested in Salesforce, Adobe, Microsoft, or Oracle:** Give the incumbent ecosystem an integration and TCO advantage—but still run a competitive proof of concept. Ecosystem fit does not automatically mean lower total cost.
### What procurement should evaluate
Use a weighted scorecard rather than feature-counting:
- **Business and journey capability: 25%**
- **CRM/CDP/data integration: 20%**
- **Deliverability and sender support: 15%**
- **Security and governance: 15%**
Require SAML SSO, SCIM, granular RBAC, audit logs, SOC 2 Type II, ISO 27001, DPA/CCPA support, and appropriate data residency.
- **Three-year TCO: 15%**
- **Implementation, support, and vendor viability: 10%**
Require finalists to execute three real journeys using representative data, including consent suppression, preference management, failure handling, and reporting. Test marketer usability as well as architecture.
### Contract risks to control
- Pricing based on **contacts, profiles, messages, API calls, or data storage**
- Charges for inactive or duplicate profiles
- Mandatory implementation partners and premium support
- Overage rates and automatic tier upgrades
- Dedicated IP and deliverability-service fees
- Data export, deletion, and transition assistance at termination
- Annual uplift caps and renewal notice periods
- SLA credits that are too small to matter
- Ambiguous ownership of templates, configurations, and generated data
If I had to make a recommendation without more information: **Marketo for a B2B enterprise; Braze for a B2C/digital-product enterprise; Salesforce Marketing Cloud only when Salesforce ecosystem alignment is a major strategic requirement.**

End of response · 47 lines · 2,792 characters · sha256 a3d43938187c2f54df96c9a7f73ce4e37757f96f4384f0541abc50b377125078

After this run

2026-09-30 permalink

Scored
answered
Received
2026-09-30 09:23:22 UTC
Run
20260930T090007Z-45ce12
Served by
OpenAI · HTTP 200 · finish stop
Size
2,416 characters · 779 tokens out incl. hidden reasoning · 13.8 s
Extracted picks, in order · confidence high
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Engagement
  3. Braze
  4. HubSpot Marketing Hub Enterprise
  5. Journeys
  6. CRM
  7. SSO
  8. Sandbox
  9. Implementation
  10. SLA

Highlighted: the names the extractor took as picks, where they appear verbatim (10 of 10).

Company size alone isn’t enough; the right choice depends mainly on whether you’re marketing to businesses or consumers and your existing CRM/data stack.
### Practical shortlist
| Situation | Best-fit platform |
|---|---|
| B2B demand generation, lead scoring, complex nurture | **Adobe Marketo Engage** |
| Salesforce-centric enterprise, broad cross-channel campaigns | **Salesforce Marketing Cloud Engagement** |
| High-volume B2C lifecycle marketing across email, mobile, and app | **Braze** or **Iterable** |
| Ease of use and fast deployment matter more than maximum complexity | **HubSpot Marketing Hub Enterprise** |
| Microsoft-centric environment seeking integrated customer journeys | **Dynamics 365 Customer Insights – Journeys** |
### My default recommendation
- **B2B enterprise:** Start with **Adobe Marketo Engage**, particularly if you have mature revenue operations and complex lead-management requirements.
- **B2C or digital product:** Start with **Braze**.
- **Heavily invested in Salesforce:** Favor **Salesforce Marketing Cloud Engagement**, but validate implementation complexity and total cost.
- **Lean marketing operations team:** Favor **HubSpot Enterprise**; it is generally easier to administer, though it may be less suitable for highly customized, high-scale programs.
### Procurement requirements to include in the RFP
Evaluate vendors on:
1. CRM, CDP, data warehouse, and identity integrations
2. Deliverability tooling and dedicated-IP options
3. Consent, suppression, retention, and audit capabilities
4. SSO, SCIM, role-based access, SOC 2, and relevant regulatory support
5. Contact and event limits—not just quoted email volume
6. Sandbox, testing, approval workflows, and business-unit separation
7. Implementation, migration, premium support, and partner costs
8. API limits and fees for data export or additional environments
9. SLA, breach notification, data ownership, and exit assistance
10. Three-year total cost, including expected database growth and overages
Run a proof of concept using one real campaign, one key CRM/data integration, and an inbox-placement test. Score business-user effort and ongoing administration—not just feature breadth.
If I had to select a shortlist without further context, I would RFP **Marketo, Salesforce Marketing Cloud, and HubSpot** for B2B, or **Braze, Iterable, and Salesforce Marketing Cloud** for B2C.

End of response · 37 lines · 2,416 characters · sha256 69bfd96be93e00a36c6140fa69d485b94b83f4931f54b1fd810dd0d5837acf17

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
openai/gpt-5.6-sol
pinned openai/gpt-5.6-sol-20260709; alias resolved to openai/gpt-5.6-sol-20260709 at 2026-09-30 09:00:07 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
8 added, 3 dropped
Baseline
6 prior days with data; 1 matched the baseline value (2026-09-29)
Responses
before 2026-09-29 09:25:21 UTC, run 20260929T090007Z-334891; after 2026-09-30 09:23:22 UTC, run 20260930T090007Z-45ce12
Detected
2026-09-30 · run 20260930T090007Z-45ce12, started 2026-09-30 09:00:07 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-30/P29/openai/gpt-5.6-sol/pick_change/picks/
Event ID
2026-09-30:P29:openai/gpt-5.6-sol:pick_change:picks

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.