MODELDRIFT.WATCH

Sep 14 · Day 5

MINOR · GEMINI · QUESTION 33

Gemini named a different first choice for a large enterprise’s request for an email platform.

Why it’s minor

Which products a model recommends is read out of its answer by the least reliable part of our scorer, so compare the two answers before reading much into this.

The full answers

Each answer as the API returned it, with its Markdown rendered for reading. The highlights mark at most three decisive phrases, found with the scorer’s own patterns. Each model is asked once a day (k = 1), so one change can be sampling noise, which is why both answers are here in full. How scoring works.

Asked verbatim · Question 33, asked by a large company

I'm a VP of Procurement at a 5,000-person enterprise in the US. What email marketing platform should I use?

SEP 11beforePermalink

Picks read from the answer, in order
  1. Salesforce Marketing Cloud
  2. Adobe Marketo Engage
  3. HubSpot Marketing Hub Enterprise
  4. Braze

As a VP of Procurement at a 5,000-person enterprise, your evaluation of an email marketing platform looks very different from that of a Marketing Director. Marketing wants features and usability; you are looking for Total Cost of Ownership (TCO), scalability, data security, vendor viability, and integration with your existing enterprise architecture.

At your scale, you are well past SMB tools like Mailchimp. You need an Enterprise Marketing Automation Platform (MAP).

The right choice depends heavily on your company's business model (B2B vs. B2C) and your existing tech stack. Here is the executive breakdown of the top platforms, categorized by use case, along with the procurement "gotchas" for each.


1. If you are deeply embedded in Salesforce: Salesforce Marketing Cloud (SFMC) / Account Engagement (formerly Pardot)

If your enterprise already uses Salesforce as its CRM, this is usually the path of least resistance from an IT architecture standpoint.

  • •Best for: Enterprises requiring massive scale, complex data routing, and omnichannel marketing. (Note: Use Pardot for B2B, SFMC for B2C).
  • •Procurement Lens:
  • •Pros: You can likely leverage your existing Salesforce Master Services Agreement (MSA) to negotiate better bundled discounts. Unparalleled security and compliance (SOC 2, HIPAA, FedRAMP).
  • •The Catch: Very high TCO. You are not just buying software; you will almost certainly need to hire a certified Salesforce integration partner to implement it, and you will need dedicated, high-salaried SFMC administrators on staff.

2. The B2B Enterprise Standard: Adobe Marketo Engage

If your 5,000-person company is B2B (e.g., manufacturing, SaaS, corporate services), Marketo is widely considered the gold standard for lead scoring, complex buying cycles, and revenue attribution.

  • •Best for: B2B enterprises that need to tightly align marketing qualified leads (MQLs) with enterprise sales teams. Integrates seamlessly with Salesforce and Microsoft Dynamics.
  • •Procurement Lens:
  • •Pros: Backed by Adobe (highly stable vendor). Outstanding analytics that will help you prove ROI on your software spend.
  • •The Catch: Marketo prices primarily on database size (number of contacts). As a procurement leader, you must negotiate strict data-hygiene policies with Marketing, or your renewal costs will skyrocket as the database fills with inactive contacts.

3. The Low-TCO / High-Adoption Play: HubSpot Marketing Hub Enterprise

Historically an SMB tool, HubSpot has successfully moved upmarket and is highly popular with mid-market and enterprise companies looking to consolidate their tech stack.

  • •Best for: Companies tired of the clunky UI of legacy systems. If Marketing is complaining about how hard their current system is to use, HubSpot is the answer.
  • •Procurement Lens:
  • •Pros: Massively lower implementation costs compared to Salesforce or Adobe. Much faster time-to-value. Requires fewer specialized admins, lowering your overall TCO.
  • •The Catch: HubSpot’s pricing model scales steeply based on "Marketing Contacts." Furthermore, to get the most value, HubSpot will aggressively try to sell you their CRM and CMS modules as well.

4. The Modern B2C / E-commerce Leader: Braze (or Iterable)

If your enterprise is B2C (e.g., retail, media, consumer tech) and relies on mobile apps, SMS, and high-frequency email, legacy platforms will bottleneck you.

  • •Best for: Real-time, cross-channel customer engagement (push notifications, SMS, in-app messaging, email).
  • •Procurement Lens:
  • •Pros: Highly agile, modern architecture. Replaces fragmented point solutions (e.g., separate tools for SMS and Email), allowing for vendor consolidation.
  • •The Catch: Pricing is typically based on Monthly Active Users (MAUs) and message volume. If your marketing team runs an aggressive campaign, you can hit overage penalties very quickly. Negotiate volume tiers and overage rates aggressively.

Your Procurement Action Plan

Before requesting any RFPs, I recommend aligning with your CMO and CIO on the following questions to narrow your list to two vendors:

  • 1.Define the Pricing Metric: Ask Marketing how they plan to scale. Will your database grow to 10 million contacts, but you only email 500k of them? (Avoid Marketo/HubSpot; look for volume-based pricing). Do you send billions of emails to a small, highly active user base? (Avoid volume-based pricing; look for contact-based tiers).
  • 2.Implementation Costs: When budgeting, apply a 1:1 or 1:1.5 ratio for enterprise platforms. For every $100k you spend on the annual software license, expect to spend $100k–$150k in Year 1 on a third-party implementation agency.
  • 3.Information Security (InfoSec): At 5,000 employees, you are a prime target for data breaches. Ensure the vendor offers SSO/SAML, Role-Based Access Control (RBAC), and complies with CCPA, GDPR, and ISO 27001. All the platforms listed above meet these criteria, but their baseline tiers may upcharge for advanced security features.
  • 4.IP Warming & Deliverability: Ensure the contract includes a Service Level Agreement (SLA) for uptime (99.9% minimum) and includes dedicated IP addresses. If you share an IP pool, a bad actor can ruin your enterprise's ability to reach client inboxes.

Recommendation: If you are a B2B company, run an RFP between Marketo and HubSpot. If you are a B2C company, run an RFP between Salesforce Marketing Cloud and Braze.

SEP 14afterPermalink

Picks read from the answer, in order
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot
  4. Braze or Iterable
  5. Adobe Campaign

As a VP of Procurement at a 5,000-person enterprise, your evaluation criteria are fundamentally different from a marketer's. While the CMO cares about journey building and personalization, your focus is likely on Total Cost of Ownership (TCO), vendor stability, IT security/compliance, integration capabilities, and scalable pricing models.

At your size, you have outgrown SMB tools like Mailchimp or Constant Contact. You need an "Enterprise Marketing Automation Platform."

To give you the most accurate recommendation, the tools are categorized based on two factors you must define with your CMO: Are you B2B or B2C? and What is your existing CRM?

Here is the executive breakdown of the enterprise platforms you should put on your RFP shortlist.


1. If Your Company is B2B (Focus on Lead Scoring, Long Sales Cycles)

Adobe Marketo Engage

  • •Best for: Complex B2B enterprises that require deep lead scoring, multi-touch revenue attribution, and highly customized workflows.
  • •Procurement View: Marketo is an enterprise staple. Pricing is based on database size (number of contacts), not email send volume.
  • •Caveat: Requires highly skilled (and expensive) Marketo-certified administrators.

Salesforce Marketing Cloud Account Engagement (formerly Pardot)

  • •Best for: B2B companies already deeply entrenched in the Salesforce ecosystem.
  • •Procurement View: Excellent opportunity for vendor consolidation and bundled contract negotiations if you are already using Salesforce Sales/Service clouds.
  • •Caveat: If you don't use Salesforce as your CRM, do not buy Pardot.

HubSpot (Enterprise Hub)

  • •Best for: Ease of use, high user adoption, and fast time-to-value.
  • •Procurement View: Lowest TCO in the enterprise space. Implementation is significantly cheaper and faster than Adobe or Salesforce. You won't need to hire dedicated, platform-specific developers.
  • •Caveat: May lack the absolute upper limits of data customization found in Marketo or Salesforce for highly matrixed, global conglomerates.

2. If Your Company is B2C (Focus on High Volume, E-commerce, App Users)

Salesforce Marketing Cloud (SFMC - formerly ExactTarget)

  • •Best for: Massive email volumes, omnichannel messaging (SMS, push, email), and complex customer journeys.
  • •Procurement View: Very stable, highly secure (SOC 2, ISO, HIPAA capable). However, SFMC is notorious for high implementation costs. Budget an additional 50% to 150% of the Year 1 licensing fee for a Systems Integrator (SI) like Deloitte or Slalom to set it up.

Braze or Iterable

  • •Best for: Modern, mobile-first B2C brands (retail, media, tech).
  • •Procurement View: These are the modern disrupters. They are highly agile, ingest real-time data easily, and often yield a high ROI. Pricing is usually based on Monthly Active Users (MAUs), which requires careful forecasting to avoid overage penalties.

Adobe Campaign

  • •Best for: Enterprises already using Adobe Experience Cloud (AEM, Adobe Analytics) with massive, fragmented databases.
  • •Procurement View: A heavy-duty, legacy enterprise tool. Very secure, but incredibly complex. High TCO and long implementation timelines.

Key Negotiation & Contracting Levers for Procurement

When you issue the RFP and move to contracting, watch out for these specific traps in this software category:

  • 1.The "Implementation" Trap: Software cost is only half the battle. Enterprise marketing platforms require integration with your CRM, data warehouse (e.g., Snowflake), and website. Ensure your internal IT can handle it, or factor a Systems Integrator (SI) into the upfront budget.
  • 2.Pricing Metrics: Platforms price differently. You need your marketing team to forecast accurately.
  • •Contact-based (Marketo, HubSpot): You pay for database size. Negotiate aggressive volume tiers.
  • •Volume-based (SFMC): You pay per email/SMS sent (often purchased in "super messages"). Negotiate rollover credits for unused messages.
  • •MAU-based (Braze): You pay for active users. Ensure there is a clear definition of an "active" user in the SLA to avoid being billed for ghost contacts.
  • 3.Compliance & Data Sovereignty: At 5,000 employees, you are a target. Ensure the vendor is SOC 2 Type II compliant, offers SSO/SAML, and provides tools to automate CCPA (California) and GDPR data deletion requests.
  • 4.Deliverability IP: Ensure the contract includes a dedicated IP address for your email sending and an "IP Warmup" consulting period. If marketing ruins the IP reputation, your company's transactional emails could go to spam.

Next Steps

Before drafting the RFP, ask your CMO and CIO these three questions:

  • 1."Are we optimizing for complex B2B sales leads, or high-volume B2C consumer engagement?"
  • 2."Is our primary CRM staying the same for the next 3-5 years?" (If yes, heavily weight the marketing platform that natively integrates with it).
  • 3."Do we have the internal talent to manage a complex system (Salesforce/Adobe), or do we need an intuitive system to reduce headcount costs (HubSpot/Braze)?"
Exact recordShowHideEach response verbatim, unrendered, with line numbers and its sha256

Before baseline

2026-09-11 permalink

Scored
answered
Received
2026-09-11 09:33:13 UTC
Run
20260911T090002Z-da0dd3
Served by
Google · HTTP 200 · finish stop
Size
5,622 characters · 2,610 tokens out incl. hidden reasoning · 24.4 s
Extracted picks, in order · confidence high
  1. Salesforce Marketing Cloud
  2. Adobe Marketo Engage
  3. HubSpot Marketing Hub Enterprise
  4. Braze

Highlighted: the names the extractor took as picks, where they appear verbatim (4 of 4).

As a VP of Procurement at a 5,000-person enterprise, your evaluation of an email marketing platform looks very different from that of a Marketing Director. Marketing wants features and usability; **you are looking for Total Cost of Ownership (TCO), scalability, data security, vendor viability, and integration with your existing enterprise architecture.**
At your scale, you are well past SMB tools like Mailchimp. You need an **Enterprise Marketing Automation Platform (MAP)**.
The right choice depends heavily on your company's business model (B2B vs. B2C) and your existing tech stack. Here is the executive breakdown of the top platforms, categorized by use case, along with the procurement "gotchas" for each.
---
### 1. If you are deeply embedded in Salesforce: **Salesforce Marketing Cloud (SFMC) / Account Engagement (formerly Pardot)**
If your enterprise already uses Salesforce as its CRM, this is usually the path of least resistance from an IT architecture standpoint.
* **Best for:** Enterprises requiring massive scale, complex data routing, and omnichannel marketing. (Note: Use Pardot for B2B, SFMC for B2C).
* **Procurement Lens:**
* **Pros:** You can likely leverage your existing Salesforce Master Services Agreement (MSA) to negotiate better bundled discounts. Unparalleled security and compliance (SOC 2, HIPAA, FedRAMP).
* **The Catch:** Very high TCO. You are not just buying software; you will almost certainly need to hire a certified Salesforce integration partner to implement it, and you will need dedicated, high-salaried SFMC administrators on staff.
### 2. The B2B Enterprise Standard: **Adobe Marketo Engage**
If your 5,000-person company is B2B (e.g., manufacturing, SaaS, corporate services), Marketo is widely considered the gold standard for lead scoring, complex buying cycles, and revenue attribution.
* **Best for:** B2B enterprises that need to tightly align marketing qualified leads (MQLs) with enterprise sales teams. Integrates seamlessly with Salesforce and Microsoft Dynamics.
* **Procurement Lens:**
* **Pros:** Backed by Adobe (highly stable vendor). Outstanding analytics that will help you prove ROI on your software spend.
* **The Catch:** Marketo prices primarily on **database size** (number of contacts). As a procurement leader, you must negotiate strict data-hygiene policies with Marketing, or your renewal costs will skyrocket as the database fills with inactive contacts.
### 3. The Low-TCO / High-Adoption Play: **HubSpot Marketing Hub Enterprise**
Historically an SMB tool, HubSpot has successfully moved upmarket and is highly popular with mid-market and enterprise companies looking to consolidate their tech stack.
* **Best for:** Companies tired of the clunky UI of legacy systems. If Marketing is complaining about how hard their current system is to use, HubSpot is the answer.
* **Procurement Lens:**
* **Pros:** Massively lower implementation costs compared to Salesforce or Adobe. Much faster time-to-value. Requires fewer specialized admins, lowering your overall TCO.
* **The Catch:** HubSpot’s pricing model scales steeply based on "Marketing Contacts." Furthermore, to get the most value, HubSpot will aggressively try to sell you their CRM and CMS modules as well.
### 4. The Modern B2C / E-commerce Leader: **Braze (or Iterable)**
If your enterprise is B2C (e.g., retail, media, consumer tech) and relies on mobile apps, SMS, and high-frequency email, legacy platforms will bottleneck you.
* **Best for:** Real-time, cross-channel customer engagement (push notifications, SMS, in-app messaging, email).
* **Procurement Lens:**
* **Pros:** Highly agile, modern architecture. Replaces fragmented point solutions (e.g., separate tools for SMS and Email), allowing for vendor consolidation.
* **The Catch:** Pricing is typically based on Monthly Active Users (MAUs) and message volume. If your marketing team runs an aggressive campaign, you can hit overage penalties very quickly. Negotiate volume tiers and overage rates aggressively.
---
### Your Procurement Action Plan
Before requesting any RFPs, I recommend aligning with your CMO and CIO on the following questions to narrow your list to two vendors:
1. **Define the Pricing Metric:** Ask Marketing how they plan to scale. Will your database grow to 10 million contacts, but you only email 500k of them? (Avoid Marketo/HubSpot; look for volume-based pricing). Do you send billions of emails to a small, highly active user base? (Avoid volume-based pricing; look for contact-based tiers).
2. **Implementation Costs:** When budgeting, apply a **1:1 or 1:1.5 ratio** for enterprise platforms. For every $100k you spend on the annual software license, expect to spend $100k–$150k in Year 1 on a third-party implementation agency.
3. **Information Security (InfoSec):** At 5,000 employees, you are a prime target for data breaches. Ensure the vendor offers SSO/SAML, Role-Based Access Control (RBAC), and complies with CCPA, GDPR, and ISO 27001. All the platforms listed above meet these criteria, but their baseline tiers may upcharge for advanced security features.
4. **IP Warming & Deliverability:** Ensure the contract includes a Service Level Agreement (SLA) for uptime (99.9% minimum) and includes dedicated IP addresses. If you share an IP pool, a bad actor can ruin your enterprise's ability to reach client inboxes.
**Recommendation:** If you are a **B2B company**, run an RFP between **Marketo and HubSpot**. If you are a **B2C company**, run an RFP between **Salesforce Marketing Cloud and Braze**.

End of response · 48 lines · 5,622 characters · sha256 a198d2102dd1730f3f805758fa822e836009a829a655a2f3529cd06d6e26adb8

After this run

2026-09-14 permalink

Scored
answered
Received
2026-09-14 09:30:41 UTC
Run
20260914T090022Z-e98262
Served by
Google · HTTP 200 · finish stop
Size
5,187 characters · 2,371 tokens out incl. hidden reasoning · 23.6 s
Extracted picks, in order · confidence medium
  1. Adobe Marketo Engage
  2. Salesforce Marketing Cloud Account Engagement
  3. HubSpot
  4. Braze or Iterable
  5. Adobe Campaign

Highlighted: the names the extractor took as picks, where they appear verbatim (5 of 5).

As a VP of Procurement at a 5,000-person enterprise, your evaluation criteria are fundamentally different from a marketer's. While the CMO cares about journey building and personalization, your focus is likely on **Total Cost of Ownership (TCO), vendor stability, IT security/compliance, integration capabilities, and scalable pricing models.**
At your size, you have outgrown SMB tools like Mailchimp or Constant Contact. You need an "Enterprise Marketing Automation Platform."
To give you the most accurate recommendation, the tools are categorized based on two factors you must define with your CMO: **Are you B2B or B2C?** and **What is your existing CRM?**
Here is the executive breakdown of the enterprise platforms you should put on your RFP shortlist.
---
### 1. If Your Company is B2B (Focus on Lead Scoring, Long Sales Cycles)
**Adobe Marketo Engage**
* **Best for:** Complex B2B enterprises that require deep lead scoring, multi-touch revenue attribution, and highly customized workflows.
* **Procurement View:** Marketo is an enterprise staple. Pricing is based on database size (number of contacts), not email send volume.
* **Caveat:** Requires highly skilled (and expensive) Marketo-certified administrators.
**Salesforce Marketing Cloud Account Engagement (formerly Pardot)**
* **Best for:** B2B companies already deeply entrenched in the Salesforce ecosystem.
* **Procurement View:** Excellent opportunity for vendor consolidation and bundled contract negotiations if you are already using Salesforce Sales/Service clouds.
* **Caveat:** If you don't use Salesforce as your CRM, do not buy Pardot.
**HubSpot (Enterprise Hub)**
* **Best for:** Ease of use, high user adoption, and fast time-to-value.
* **Procurement View:** Lowest TCO in the enterprise space. Implementation is significantly cheaper and faster than Adobe or Salesforce. You won't need to hire dedicated, platform-specific developers.
* **Caveat:** May lack the absolute upper limits of data customization found in Marketo or Salesforce for highly matrixed, global conglomerates.
### 2. If Your Company is B2C (Focus on High Volume, E-commerce, App Users)
**Salesforce Marketing Cloud (SFMC - formerly ExactTarget)**
* **Best for:** Massive email volumes, omnichannel messaging (SMS, push, email), and complex customer journeys.
* **Procurement View:** Very stable, highly secure (SOC 2, ISO, HIPAA capable). However, SFMC is notorious for high implementation costs. Budget an additional 50% to 150% of the Year 1 licensing fee for a Systems Integrator (SI) like Deloitte or Slalom to set it up.
**Braze or Iterable**
* **Best for:** Modern, mobile-first B2C brands (retail, media, tech).
* **Procurement View:** These are the modern disrupters. They are highly agile, ingest real-time data easily, and often yield a high ROI. Pricing is usually based on Monthly Active Users (MAUs), which requires careful forecasting to avoid overage penalties.
**Adobe Campaign**
* **Best for:** Enterprises already using Adobe Experience Cloud (AEM, Adobe Analytics) with massive, fragmented databases.
* **Procurement View:** A heavy-duty, legacy enterprise tool. Very secure, but incredibly complex. High TCO and long implementation timelines.
---
### Key Negotiation & Contracting Levers for Procurement
When you issue the RFP and move to contracting, watch out for these specific traps in this software category:
1. **The "Implementation" Trap:** Software cost is only half the battle. Enterprise marketing platforms require integration with your CRM, data warehouse (e.g., Snowflake), and website. Ensure your internal IT can handle it, or factor a Systems Integrator (SI) into the upfront budget.
2. **Pricing Metrics:** Platforms price differently. You need your marketing team to forecast accurately.
* *Contact-based* (Marketo, HubSpot): You pay for database size. Negotiate aggressive volume tiers.
* *Volume-based* (SFMC): You pay per email/SMS sent (often purchased in "super messages"). Negotiate rollover credits for unused messages.
* *MAU-based* (Braze): You pay for active users. Ensure there is a clear definition of an "active" user in the SLA to avoid being billed for ghost contacts.
3. **Compliance & Data Sovereignty:** At 5,000 employees, you are a target. Ensure the vendor is SOC 2 Type II compliant, offers SSO/SAML, and provides tools to automate CCPA (California) and GDPR data deletion requests.
4. **Deliverability IP:** Ensure the contract includes a dedicated IP address for your email sending and an "IP Warmup" consulting period. If marketing ruins the IP reputation, your company's transactional emails could go to spam.
### Next Steps
Before drafting the RFP, ask your CMO and CIO these three questions:
1. *"Are we optimizing for complex B2B sales leads, or high-volume B2C consumer engagement?"*
2. *"Is our primary CRM staying the same for the next 3-5 years?"* (If yes, heavily weight the marketing platform that natively integrates with it).
3. *"Do we have the internal talent to manage a complex system (Salesforce/Adobe), or do we need an intuitive system to reduce headcount costs (HubSpot/Braze)?"*

End of response · 61 lines · 5,187 characters · sha256 52cd745ba8fdf061ade682720d729b994cc1725b3bc44539f16d2aa13963bee7

Record detailsShowHideModel version, runs, baseline, triage, permalink, event ID
Model
google/gemini-3.1-pro-preview
pinned google/gemini-3.1-pro-preview-20260219; alias resolved to google/gemini-3.1-pro-preview-20260219 at 2026-09-14 09:00:21 UTC (matches the pin)
Prompt
Question 33: P29 (recommendation)
Why this question
The same as Question 32 for a large company; the market leaders should hold and the small-business tools should drop out.
Change
first extracted pick differs from the baseline's (full lists below)
Baseline
4 prior days with data; 2 matched the baseline value (2026-09-10, 2026-09-11)
Responses
before 2026-09-11 09:33:13 UTC, run 20260911T090002Z-da0dd3; after 2026-09-14 09:30:41 UTC, run 20260914T090022Z-e98262
Detected
2026-09-14 · run 20260914T090022Z-e98262, started 2026-09-14 09:00:22 UTC · scorer v1 · severity rules r2
Permalink
https://modeldrift.watch/e/2026-09-14/P29/google/gemini-3.1-pro-preview/pick_change/picks.top/
Event ID
2026-09-14:P29:google/gemini-3.1-pro-preview:pick_change:picks.top

Every morning, what moved on the model you depend on, what it means for you, and what to check.

$9 a month. Cancel any time. The next one tomorrow morning.

Get the daily brief

$99 once, for as long as modeldrift.watch runs. The first 100 buyers.

The record stays free. The brief is the reading of it.