re:invent: Amazon's AI Innovations, Cybersecurity Risks, Intel's Challenges, and IT's Rising Status

[00:00:02] It's Thursday, December 5th, 2024, and I'm Dave Sobel. Three things to know today. Amazon unveils AI-centric updates at reInvent, the nova models, hardware breakthroughs, and legacy system modernization. Balancing risks and relief, encryption and AI oversight take center stage in the security landscape, and from Intel's future to microservices decline and IT's strategic rise. This is the Business of Tech.

[00:00:30] Amazon held their re-event conference this week, unveiling a series of updates that highlight the company's focus on generative AI, hardware innovation, and modernization tools. AWS CEO Matt Garman emphasized the transformative potential of generative AI across industries, supported by AWS's growing ecosystem of services. Key announcements were to Amazon Bedrock, designed to streamline model training while reducing the size and cost of AI models by up to five.

[00:00:59] Bedrock now supports AWS's new Nova family of foundation models, which includes Nova Micro for text-only tasks, Nova Lite for multimodal processing, and Nova Premier for complex reasoning. Looking ahead, AWS hinted at future developments like speech-to-speech and Any-to-Any models. Generative AI also took center stage with updates to Q-Business, AWS's AI Assistant, which now integrates with over 40

[00:01:29] enterprise tools such as Zoom and Asana. This integration enables seamless data queries and insights through Amazon QuickSight, with a library of over 50 automated actions leveraging generative AI to streamline workflows. These features are in preview with a full rollout expected in 2025.

[00:01:47] On the hardware front, AWS showcased its advancements to support AI workloads. The Graviton processor, which offers 40% better price performance and 60% lower energy usage than traditional x86 processors, now accounts for over half of AWS's added CPU capacity since 2019.

[00:02:08] AWS also announced new instances featuring NVIDIA's upcoming Blackwell chips, promising 2.5 times faster performance, alongside the launch of Tranium 2, their second-generation AI chip, which boasts 30-40% better pricing performance than current GPU systems.

[00:02:27] To ensure the reliability of AI outputs, AWS introduced automated reasoning, a safeguard against AI hallucinations that cross-references customer-supplied data to validate responses.

[00:02:40] The company also unveiled model distillation, a feature that transfers the capabilities of larger AI models to smaller, more efficient ones, enabling multi-agent collaboration on complex projects.

[00:02:53] AWS didn't stop there, with significant updates in data processing and storage.

[00:02:59] The new Aurora DSQL engine provides distributed storage with low latency and performs SQL transactions four times faster than Google Spanner.

[00:03:10] Meanwhile, AWS launched data transfer terminal locations in Los Angeles and New York, designed for high-speed uploads of large datasets, such as those used in video production and industrial data collection.

[00:03:23] These facilities provide secure, rapid transfers through Amazon S3, an elastic file system, with plans to expand to additional regions.

[00:03:33] Finally, AWS introduced tools aimed at helping businesses modernize legacy systems.

[00:03:38] A new AI tool simplifies the migration of Microsoft .NET applications to Linux, potentially reducing migration time from months to days while saving up to 40% in licensing costs.

[00:03:51] AWS also announced updates for mainframe and VMware migrations, with features for automating tasks like unit testing and documentation updates.

[00:04:00] These efforts are part of a broader strategy leveraging the Q developer tool, positioning AWS to compete with solutions like Microsoft's GitHub Copilot.

[00:04:10] Why do we care?

[00:04:12] While the announcements are impressive in scope, evaluating their practicality and broader implications reveals a mix of opportunities and potential challenges.

[00:04:21] AWS's tools for migration and modernization offer clear opportunities for consultative work, particularly around legacy application transformation and database optimization.

[00:04:32] Modernizing legacy systems is complex, often requiring a high degree of customization.

[00:04:38] While AWS's announced tools are promising, enterprises with unique configurations may still encounter friction.

[00:04:45] And while AWS's bedrock updates and Nova models are compelling, competitors like OpenAI and via Azure, Google Cloud, and IBM's Watson are equally aggressive.

[00:04:57] Graviton's energy efficiency and cost advantages could enable managed services providers to optimize infrastructure offerings and remain price competitive.

[00:05:05] And integration with over 40 enterprise tools like Zoom and Asana emphasizes their ambition to position the Q assistant as a linchpin for enterprise workflows.

[00:05:15] The good news is all of these unanswered questions are the opportunity to work with customers.

[00:05:22] Did you know that there's a SIM that's made for IT admins and is free for internal use for MSPs?

[00:05:29] BlueMira's cloud platform makes SIM simple and affordable.

[00:05:33] With automated threat detection, 24 by 7 expert support, managed detections and guided response,

[00:05:40] you can protect your customers from ransomware and meet compliance requirements on an SMB budget.

[00:05:45] Don't add syslog to your MDR and let them call it a SIM.

[00:05:51] You deserve better.

[00:05:52] Get started with your free NFR account at BlueMira.com slash radio.

[00:05:58] That's B-L-U-M-I-R-A dot com slash radio.

[00:06:06] A warning and a relief.

[00:06:08] U.S. officials are advising Americans to use encrypted messaging apps amid a significant cyber attack on major telecommunications

[00:06:15] companies like AT&T and Verizon.

[00:06:17] The hacking campaign, known as Salt Typhoon and mentioned before on this show,

[00:06:22] is one of the largest intelligence breaches in U.S. history with no clear timeline for resolution.

[00:06:28] Officials indicate that China was behind the attacks aiming to spy on customers.

[00:06:33] They recommend using encryption for text and voice communications to protect against interception.

[00:06:39] The FBI has noted that hackers accessed call records, live phone calls of specific targets,

[00:06:45] and systems used by law enforcement for tracking communications.

[00:06:49] Privacy advocates urged the use of end-to-end encryption in apps like Signal and WhatsApp to safeguard sensitive information.

[00:06:57] And coverage in The Conversation gives some insight into AI around misinformation.

[00:07:03] In a landmark year for global elections, 2024 saw approximately 3.7 billion eligible voters across 72 countries participate,

[00:07:12] marking it as a supercycle year for democracy.

[00:07:16] While many feared that artificial intelligence would lead to rampant misinformation,

[00:07:21] a recent Pew survey revealed that nearly eight times as many Americans expected AI to be used for negative purposes

[00:07:27] rather than positive ones in the elections.

[00:07:30] And despite these concerns, AI proved beneficial in various ways,

[00:07:34] such as language translation, where governments and politicians leveraged AI to communicate with diverse communities.

[00:07:40] Additionally, some candidates utilized AI chatbots to engage voters directly,

[00:07:45] and AI was employed in political fundraising and strategy development.

[00:07:49] However, the year was not without issues.

[00:07:52] AI-generated misinformation still emerged, albeit without the catastrophic impact that many anticipated.

[00:07:59] Why do we care?

[00:08:01] Both stories are about risk management.

[00:08:04] IT service providers should anticipate heightened demand for solutions tailored to hardened telco systems,

[00:08:09] especially as dependency on mobile communication grows.

[00:08:12] An obvious point of assistance is ensuring all communications are encrypted.

[00:08:17] While fears of AI-driven misinformation dominated pre-election discourse, the reality was more balanced.

[00:08:24] AI contributed positively to translation, voter engagement, and fundraising efforts,

[00:08:29] countering some of the doom-laden narratives.

[00:08:31] However, the subtle spread of AI misinformation highlights ongoing risks of unregulated AI outputs.

[00:08:39] So focus on risk management.

[00:08:44] Time for some big ideas.

[00:08:46] First, ZDNet offers eight ways Intel can still pull itself out of freefall after its CEO's forced exit.

[00:08:54] Pat Gelsinger has been forced out as CEO after less than four years.

[00:08:58] His departure underscores a broader issue at Intel,

[00:09:01] a cultural stagnation that's hindered innovation and made risk-taking difficult.

[00:09:06] The company must now confront its heavy reliance on its x86 architecture while adapting to the rise of ARM-based processors,

[00:09:14] which has become prevalent in smartphones and cloud computing.

[00:09:18] Additionally, Intel's ambitious venture into contract chip manufacturing faces challenges,

[00:09:23] as it must compete with established players like TSMC.

[00:09:27] With billions in funding from the CHIPS Act, Intel has a chance to reclaim its position,

[00:09:33] but it requires decisive leadership and a commitment to cultural and strategic transformation

[00:09:37] to navigate these turbulent times.

[00:09:41] Venture beat with why microservices might be finished as monoliths return with a vengeance.

[00:09:46] In a notable shift within the industry, many companies are moving away from microservices

[00:09:51] and returning to monolithic architectures, as highlighted in the article.

[00:09:55] While microservices offered advantages such as better scalability and flexibility,

[00:10:00] the reality has proven challenging with complex interactions and data integrity issues arising during migration.

[00:10:07] The article emphasizes that many organizations struggle with defining domain boundaries,

[00:10:12] leading to circular dependencies and vague team ownership.

[00:10:15] Data migration remains a critical hurdle,

[00:10:19] often causing disruptions in business operations due to the potential for data loss and inconsistencies.

[00:10:24] Ultimately, the challenges of fully realizing the benefits of microservices

[00:10:29] have prompted a reconsideration of monolithic structures,

[00:10:32] as firms seek stability amid increasing system complexity.

[00:10:37] An IT pro with this long-titled article,

[00:10:41] the IT department is finally getting the recognition it deserves,

[00:10:44] and it's all down to the rise of AI.

[00:10:46] Workers are gaining C-suite praise, bigger budgets, and pay rises.

[00:10:51] Yes, that's the full title.

[00:10:52] The rise of artificial intelligence is elevating the status of IT departments,

[00:10:57] according to new research from the software firm 1E.

[00:11:00] Nearly 60% of IT leaders in the U.S. report that AI has improved their departments' standing within their companies.

[00:11:08] Additionally, 90% of IT professionals working at companies that have adopted AI

[00:11:12] have experienced career growth, leading to raises, promotions, and increased budgets.

[00:11:17] Over 25% have received a raise or promotion tied directly to their work with AI.

[00:11:24] The study highlights that nearly a quarter of respondents now see their AI contributions recognized

[00:11:29] for directly impacting revenue and cost savings.

[00:11:32] Furthermore, 4 in 10 IT professionals now directly advise their company's executive teams on AI strategies.

[00:11:39] With an average salary of around $174,000 for those with AI skills,

[00:11:45] this trend signifies a transformative shift in the role and recognition of IT departments.

[00:11:51] Why do we care?

[00:11:53] So here are your questions to consider.

[00:11:56] If Intel falls further, what impact might this have on your supply chain technology choices or partnerships?

[00:12:03] Are you aligned with vendors and technologies that are agile and future-proof?

[00:12:08] Are customers' current system architectures aligned with the organization's capabilities and business goals?

[00:12:14] Are they struggling with microservices complexity?

[00:12:17] And if so, could a hybrid or monolithic approach offer a better solution?

[00:12:22] And as IT becomes a more prominent advisor to executives,

[00:12:26] how is your organization structuring its offerings to enable strategic contributions?

[00:12:32] Are you leveraging this moment to secure larger budgets and cross-departmental influence?

[00:12:39] Today's episode is supported by CoreView.

[00:12:42] Your customers need your Microsoft 365 expertise,

[00:12:46] and CoreView has the only M365 management platform designed for MSPs.

[00:12:51] Manage hundreds of tenants, automate manual tasks, and monitor compliance,

[00:12:56] all while intelligently comparing to the baseline.

[00:12:59] With a no-code control approach,

[00:13:01] CoreView revolutionizes your Microsoft 365 administration.

[00:13:05] This powerful platform enables automatic reporting and remediation,

[00:13:09] ensuring optimal performance and security.

[00:13:12] The best part?

[00:13:13] You achieve this high level of service without the need for a large workforce,

[00:13:17] allowing you to focus on growing your business through efficiency.

[00:13:21] Want to know more?

[00:13:23] Visit coreview.com slash MSP

[00:13:26] and find out more.

[00:13:30] Thanks for listening.

[00:13:31] Today is International Ninja Day.

[00:13:34] I mean, I could mention National Blue Jeans Day,

[00:13:37] but it's International Ninja Day.

[00:13:40] I mean, ninjas.

[00:13:42] Tomorrow on the podcast, we talk to 1Password's Jason Eberhardt,

[00:13:46] and Saturday you get the live show where I tell you how I use AI in the show

[00:13:50] and ask a few questions of you, the audience,

[00:13:53] and I conduct an experiment with my producer

[00:13:55] to see if she can tell the difference between AI me and real me.

[00:14:00] Trust me, you don't want to miss that AI taste test.

[00:14:04] Got a comment or a thought on a story?

[00:14:06] Put it in the comments if you're on YouTube

[00:14:07] or reach out on LinkedIn if you're listening to the podcast.

[00:14:10] Got a question?

[00:14:11] Send it in at question at mspradio.com.

[00:14:14] Have a great weekend,

[00:14:15] and I will talk to you again with more news on Monday.

[00:14:19] The Business of Tech is written and produced by me, Dave Sobel,

[00:14:23] under ethics guidelines, posted at businessof.tech.

[00:14:27] If you like the content, please make sure to hit that like button,

[00:14:31] follow or subscribe.

[00:14:32] It's free and easy and the best way to support the show and help us grow.

[00:14:37] You can also check out our Patreon,

[00:14:40] where you can join the Business of Tech community

[00:14:42] at patreon.com slash mspradio

[00:14:45] or buy our Why Do We Care merch.

[00:14:48] at businessof.tech.

[00:14:50] Finally, if you're interested in advertising on this show,

[00:14:53] visit mspradio.com slash engage.

[00:14:57] Once again, thanks for listening to me.

[00:14:59] I will talk to you again on our next episode

[00:15:02] of the Business of Tech.

[00:15:06] Part of the MSP Radio Network.