AI Leadership Growth, Chatbot Innovations, and Broadcom's VMware Success Amid Channel Challenges

[00:00:02] It's Monday, December 16th, 2024, and I'm Dave Sobel. Three things to know today. AI leadership and investment surge. Will it stick or fold back into the C-suite? AI chatbots get smarter again. OpenAI, Anthropic, and Google tweak for productivity. And Broadcom's VMware overhaul delivers big profits, but not everyone's cheering. This is the Business of Tech.

[00:00:27] In a recent analysis by Ultrata, the number of chief AI officers in organizations surged by 70% from 30 in 2023 to 51 in 2024, marking a significant trend in the corporate landscape. While most of these positions were filled by internal hires, some companies sought talent from major tech companies like Google, IBM, and Oracle to enhance their AI leadership.

[00:00:51] The report highlights that as enterprises increasingly pursue extensive AI initiatives, the role of chief AI officer is gaining prominence, signaling a long-term commitment to AI technology rather than treating it as a passing trend. Notably, one-third of these officers work in publicly traded companies, while nearly two-thirds are in private enterprises.

[00:01:13] A new report by Logic Monitor conducted in partnership with the industry research firm EMA reveals that 81% of enterprises plan to increase their investments in artificial intelligence-powered IT ops in the coming year.

[00:01:29] This shift is driven by the need for enhanced performance, resilience, and scalability as organizations increasingly adopt AI tools.

[00:01:37] The survey highlights that 68% of organizations are already using AI for tasks such as anomaly detection and real-time threat detection, while 63% have moved to proactive IT operations, significantly reducing downtime.

[00:01:53] However, challenges remain, with 38% of respondents facing difficulties integrating AI with existing infrastructures and 40% expressing concerns about data privacy.

[00:02:03] A recent report by Vesper Technologies reveals a significant shift in enterprise investment toward artificial intelligence, with over half of surveyed companies reporting a 10% increase in hardware budgets to support AI initiatives.

[00:02:18] The study, which included responses from 502 senior IT decision-makers, shows that despite 66% of funding coming from reallocated budgets, 32% represents new allocations, indicating strong, fresh investment in AI infrastructure.

[00:02:35] Notably, NVIDIA continues to lead the AI hardware market, powering more than double the enterprise AI deployments of its closest competitor.

[00:02:43] The research finds that 83% of organizations have already implemented AI solutions, with an additional 15% actively planning to do so.

[00:02:52] Furthermore, 70% of enterprises are shifting their AI workloads to private infrastructure to gain better control over data and ensure compliance.

[00:03:02] Why do we care?

[00:03:03] I made a prediction about AI officers for this year, and it seems it's happening at the enterprise level.

[00:03:09] Often, enterprise trends find their way to SMBs with a thought to scale those trends, and I think that's worth noting here.

[00:03:16] I'm increasingly noting how the need to address AI is changing many business processes, and that many organizations are lagging in giving direction.

[00:03:25] A colleague observed that it's already impacting hiring.

[00:03:29] Besides the need to verify potential hires physically due to cybersecurity concerns, it's also now required to test an individual's expertise, considering AI tools can relay answers in real time based on conversations.

[00:03:43] The dichotomy here is that those same hires become employees who need guidance on using AI for acceleration.

[00:03:51] You want less AI when testing their knowledge and more AI when empowering their productivity.

[00:03:58] Nobody said this was easy.

[00:04:00] Let's also note that while the chief AI officer role is growing, its longevity is uncertain.

[00:04:06] Critics could argue that the role's responsibilities will eventually fold back into existing C-suite positions, such as CIOs or CTOs, as AI becomes a routine part of IT strategy rather than a specialized focus.

[00:04:22] Today's episode is supported by CoreView.

[00:04:25] Your customers need your Microsoft 365 expertise, and CoreView has the only M365 management platform designed for MSPs.

[00:04:35] Manage hundreds of tenants, automate manual tasks, and monitor compliance, all while intelligently comparing to the baseline.

[00:04:42] With a no-code control approach, CoreView revolutionizes your Microsoft 365 administration.

[00:04:48] This powerful platform enables automatic reporting and remediation, ensuring optimal performance and security.

[00:04:55] The best part?

[00:04:56] You achieve this high level of service without the need for a large workforce, allowing you to focus on growing your business through efficiency.

[00:05:05] Want to know more?

[00:05:06] Visit CoreView.com slash MSP and find out more.

[00:05:12] And while the general product news has slowed to nothing, there are a few still coming in the AI chatbot realm.

[00:05:19] OpenAI has officially launched its real-time video capabilities for ChatGPT nearly seven months after the initial announcement.

[00:05:26] This new feature, known as Advanced Voice Mode with Vision, allows users to interact with the chatbot by pointing their phones at objects and receiving near-real-time responses.

[00:05:36] ChatGPT has also introduced a new Projects feature aimed at organizing user interactions with the AI chatbot.

[00:05:44] The feature allows users to create themed bundles of conversations and relevant files, drastically reducing the clutter often associated with managing multiple chats.

[00:05:54] Anthropic has launched its Clawed 3.5 Haiku model, now accessible to all users through its Clawed chatbot on web and mobile.

[00:06:01] This model, which is smaller and faster, has been noted for outperforming larger models in key benchmarks while remaining competitively priced.

[00:06:10] According to artificial analysis, Clawed 3.5 Haiku has a latency of 0.8 seconds for the first token and an output speed of 65.1 tokens per second.

[00:06:21] With a context window of 200,000 tokens, it surpasses OpenAI's models, allowing for better handling of extensive inputs.

[00:06:28] While the service is free, users face a daily message limit but can subscribe to the Clawed Pro plan for $20 a month to unlock increased usage and priority access.

[00:06:38] The model excels in tasks like processing large datasets and analyzing financial documents, making it a strong contender in the AI landscape as it competes with offerings from OpenAI and Google.

[00:06:49] And speaking of Google, Cloud has launched AgentSpace, a new service aimed at helping enterprises create and deploy artificial intelligence agents.

[00:06:58] Initially available through an early access program, AgentSpace features a multimodal search agent that can answer complex questions, offer proactive suggestions, and take actions based on company data.

[00:07:10] Early adopter Deloitte is already using the platform to streamline knowledge management.

[00:07:15] Why do we care?

[00:07:16] These announcements are incremental, not groundbreaking.

[00:07:20] Real-time vision, while very impressive, replicates existing capabilities in competing tools.

[00:07:26] Similarly, project organization features can be seen as catch-up functionality rather than innovation.

[00:07:33] That said, productivity generally happens in incremental steps.

[00:07:37] MSPs should evaluate these tools for clients in data-heavy industries like legal and finance, where context window size and multimodal capabilities have direct ROI potential.

[00:07:48] And the rapid-fire updates from OpenAI, Anthropic, and Google underscore the need for ongoing evaluation.

[00:07:55] Providers should focus on aligning tool capabilities with client-specific needs rather than buying into every new feature announcement.

[00:08:04] And I had to revisit VMware and Broadcom with two stories from the register.

[00:08:09] Broadcom has successfully integrated VMware ahead of schedule, transforming the virtualization company into a highly profitable entity.

[00:08:17] During a recent earnings call, Broadcom CEO, Hawk Tan, reported that VMware's quarterly costs have dropped significantly from $2.4 billion to $1.2 billion,

[00:08:28] with profit margins soaring from below 30% to 70%.

[00:08:32] In the last quarter alone, VMware secured $2.7 billion in subscription deals, covering 21 million processor cores.

[00:08:42] Full-year revenue for Broadcom's software division reached $21.5 billion, a substantial increase from $7.6 billion in the previous fiscal year.

[00:08:53] Tan expressed confidence in achieving planned growth targets for VMware sooner than initially anticipated,

[00:08:59] while Broadcom's overall quarterly revenue saw a 51% year-on-year increase to $14 billion.

[00:09:06] Investors reacted positively, pushing Broadcom's share price up by 15% in after-hours trading post the report.

[00:09:14] And of course, couple that with the fact that Ingram Micro has announced it will cease business relationships with Broadcom and VMware in many regions starting January 2025.

[00:09:24] The decision follows unsuccessful negotiations to deliver optimal technology outcomes for customers and adequate returns for shareholders.

[00:09:33] Ingram Micro, which supports over 161,000 customers and works with more than 1,500 vendors,

[00:09:40] asserts that this change will not materially impact its business.

[00:09:43] However, VMware users have raised concerns regarding Ingram's ability to manage increased responsibilities following Broadcom's acquisition of VMware,

[00:09:53] citing slow responses and a lack of expertise.

[00:09:56] This shift adds to the ongoing turmoil within Broadcom's channel strategy,

[00:10:01] which has faced challenges, including the cancellation of its partner program and direct dealings with a limited number of VMware customers.

[00:10:09] And Ingram Micro has announced plans to restructure its operations, resulting in a reduction of approximately 850 employees by the end of the first quarter of 2025.

[00:10:19] The company aims to enhance efficiency and improve customer service as part of its strategy for sustainable growth.

[00:10:25] Ingram Micro has committed to supporting all affected associates during this transition.

[00:10:31] Why do we care?

[00:10:32] If you're waiting for Broadcom to feel the impact of their choices in a negative way, I wouldn't hold your breath.

[00:10:38] This seems like very much a loss for the channel strategy advocates.

[00:10:42] Now, I'm not pointing to a larger trend here, just observing that any discourse that says,

[00:10:47] oh, this will come back to bite them, isn't playing out in the financials.

[00:10:54] Are you ready to take your cloud business to the next level?

[00:10:58] TDCynics is changing the game for MSPs with their Stream 1 platform, where all clouds meet.

[00:11:04] With Stream 1, you get access to Microsoft, AWS, Google, and more, all in one place.

[00:11:11] Stream 1 Commerce API enables headless commerce, and there is seamless integration with your PSA tools, making billing easier than ever.

[00:11:20] Plus, white-label storefronts allow you to extend a fully customizable marketplace to your customers.

[00:11:26] And Stream 1 is more than a marketplace.

[00:11:29] It simplifies the complexity of cloud ecosystems and empowers you to grow at scale.

[00:11:34] To learn more, visit tdcynex.com slash Stream 1 Ion and see how Stream 1 can transform your business.

[00:11:46] Thanks for listening. Today is National Chocolate Covered Anything Day.

[00:11:50] That sounds delicious.

[00:11:52] Have a question you want answered? I take those listener questions, send them in for the last live show of the year,

[00:11:57] ideally as a voice memo or video to question at mspradio.com.

[00:12:01] We'll be answering those live questions this week, Wednesday, 3 p.m. Eastern on YouTube and LinkedIn.

[00:12:06] And if you've got a comment or a thought on a story, put it in the comments if you're on YouTube,

[00:12:10] or reach out on LinkedIn if you're listening to the podcast.

[00:12:12] If you like the show, give it a review and make sure you've subscribed or followed on your favorite platform.

[00:12:17] Talk to you again tomorrow.

[00:12:20] The Business of Tech is written and produced by me, Dave Sobel, under ethics guidelines, posted at businessof.tech.

[00:12:28] If you like the content, please make sure to hit that like button, follow or subscribe.

[00:12:33] It's free and easy and the best way to support the show and help us grow.

[00:12:38] You can also check out our Patreon, where you can join the Business of Tech community at patreon.com slash mspradio

[00:12:46] or buy our Why Do We Care merch at businessof.tech.

[00:12:51] Finally, if you're interested in advertising on this show, visit mspradio.com slash engage.

[00:12:58] Once again, thanks for listening to me.

[00:13:00] I'll talk to you again on our next episode of the Business of Tech.

[00:13:07] Part of the MSP Radio Network.