Generative AI 101: Tokens, Pre-training, Fine-tuning, Reasoning — With Dylan Patel
Dylan Patel is the founder and CEO of SemiAnalysis. He joins Big Technology Podcast to explain how generative AI work, explaining the inner workings of tokens, pre-training, fine-tuning, open source, and reasoning. We also cover DeepSeek’s efficiency breakthrough, the race to build colossal AI data centers, and what GPT-5’s hybrid training approach could unlock. Hit play for a masterclass you’ll want to send to every friend puzzled (or excited) about the future of AI.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
--------
42:09
Is OpenAI’s o3 Model AGI?, Is AI The New Social Media?, Zuck’s Revealing Testimony
Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) Is OpenAI's o3 model AGI? 2) Maybe it's AGI when you squint 3) Why people are floating the idea that OpenAi is close to AGI 4) Is OpenAI going to declare that GPT-5 is AGI 5) What's in it for companies saying they've achieved AGI first? 6) AI's new memory capabilities add something big to the experience 7) Is AI the new social media? 8) Facebook has moved away from friend sharing 9) Could Google be broken up? 10) Is Google's stake in the open web actually a good thing?
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
--------
52:49
Why China's AI Strategy Just Might Work — With Grace Shao
Grace Shao is a Hong Kong-based writer and analyst, and author of AI Proem on Substack newsletter. She joins Big Technology Podcast to discuss China's rise in artificial intelligence, and whether (and how) it can be a global player. Tune in to hear how China's AI startups are rapidly productizing cutting-edge tech, why it keeps developing open-source models, and why it's surging in robotics. We also cover AI agents like Manus, chip shortages, and the entrepreneurial resurgence transforming Chinese tech culture. Hit play for an essential conversation on China’s AI ambitions and their global implications.
You can read more from Grace here: https://open.substack.com/pub/aiproem
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
--------
1:05:15
A Week of Trade War Chaos & What's Next For Tech
Ranjan Roy from Margins is back for our weekly discussion of the latest tech news. We cover 1) Ranjan's experience during the financial crisis 2) The uncertainty around operating a business today 3) Why bond traders are important 4) Could the U.S. position in global trade decline? 5) Was it the tariffs or the rollout that's causing chaos? 6) Why Apple manufactures in China 7) Exposure of Amazon, Apple, Microsoft, Google, And Meta to tariffs 8) How this might end
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
--------
55:20
Google Cloud CEO Thomas Kurian on AI Competition, Agents, And Tariffs
Thomas Kurian is the CEO of Google Cloud Platform. He joins Big Technology Podcast to discuss how AI is changing the competitive balance in cloud services and why he believes Google has a chance to win. We also discuss the various use cases Google customers are finding for GenAI in the technology's early days, and whether the agent buzz is real. Finally, towards the end of the conversation we touch on tariffs and their impact on the cloud services business. Tune in for a wide ranging conversation with Google's top guy on cloud computing.
The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Alex Kantrowitz, a Silicon Valley journalist who's interviewed the world's top tech CEOs — from Mark Zuckerberg to Larry Ellison — is the host.
España