Transcript of Databricks CEO: AGI Is Already Here, Why Companies Are Behind, and the Superintelligence Debate

01:02:05 58 min read 0 views Published about 4 hours ago

Copy link
Episode summary

Ali Ghodsi, CEO of Databricks, joins the All-In interview to discuss the company's origins in UC Berkeley's AMPLab, its early bets on cloud, AI and open source, and how enterprises are adopting AI. He argues that AGI already exists in practice and that companies lag because AI cannot access meeting context, governance, security and cost controls.

The conversation includes a live demo of Databricks' Genie tool, which uses an internal company graph to answer questions about teams and customers. They also cover why Databricks has stayed private, cyber risk, recursive self-improvement and the debate over superintelligence.

In this episode Ali Ghodsi

This transcript of the Databricks CEO interview on AGI was made with the technology behind HappyScribe's AI note taker.

Ali Ghodsi00:00:00

So it was kind of out of despair that we started Databricks, because no one else is listening to it. At that time there was zero interest in AI. Now I think we have all the intelligence we need to completely transform the planet.

Speaker 200:00:10

It's not possible to have 1,000 agents doing stuff realistically, am I correct?

Ali Ghodsi00:00:15

They're just using AI in very rudimentary ways. They're just using it as a glorified Google Search.

Speaker 200:00:21

We're actually getting into management moneyball, aren't we?

Ali Ghodsi00:00:24

So if the token cost is going up exponentially, is your revenue at your company going up exponentially? But I actually think GDP will move very slowly, and it's going to take decades.

Speaker 200:00:32

Are they a little drunk on their own success?

Ali Ghodsi00:00:36

Just because 98% of the code is being written by AI, we don't have RSI. If it automates the last 2%, who cares?

Speaker 200:00:44

When are you going public?

Speaker 300:00:45

I'm going all in.

Advertisement00:00:47
Speaker 200:01:19

We're so lucky because all of these amazing leaders in the world, CEOs, politicians, scientists, they watch the show. They're part of the community. And Ali Gatze is one of those individuals. He, of course, is the CEO of Databricks, a private company that has been doing incredible. I don't know why it's not public yet. I think a lot of people are asking that question. We'll talk about it today. In 2015, they were doing $1.5 million in revenue. It's August, or the rumor I heard, August 2026, Ali, $7 billion run rate, growing 80% year over year.

And obviously, you got a lot of competition, the snowflakes of the world, et cetera. But this is a tremendous business. And we're going to talk a lot about how you're using AI to run this incredible business. We're going to talk about recursive self-improvement. But welcome to the program. And then maybe you could tell the audience a little bit about what you do at Databricks and how it became so successful.

Ali Ghodsi00:02:17

Yeah, happy to do that. Thanks for having me on. Excited for this. Yeah, so we started the business in 2013. But if you rewind a little bit before that, we were all at UC Berkeley. There were about 20 of us. And we were actually part of a lab called AmpLab, which was, I think, the largest AI research lab in the world at that time. And we were trying to figure out how can we combine data processing with AI. And we came up with really interesting things, but the industry was just not ready for it. So we were trying to get the industry to adopt this technology, and they weren't.

So it was kind of out of despair that we started Databricks because we thought, you know, if we don't start a company around this, no one else is listening to it. At that time, there was zero interest in AI. Actually, it was called machine learning at the time, and AI was just robotics. So that's kind of like the beginning of the story.

Speaker 200:03:05

And for people who don't use the product day in and day out, who aren't in the industry, what's the goal of the Databricks product suite? What do you do? I know you released some new products today, so happy to talk about those as well. But conceptually, you got there so early. Obviously, machine learning. Google was built on that, Facebook, and their ad network. A lot of interesting services, Uber and their routing algorithms. Maybe you could talk a little bit about where Databricks started and what it's become and how it's generating billions of dollars in revenue.

Ali Ghodsi00:03:33

Yeah, so the first use case, actually, it was the first use case ever was at UC Berkeley when we wanted to help Netflix recommend better movies so that people would watch more movies. So it was like a recommendation algorithm AI use case that started the whole thing. And then we thought, you know, more organizations probably. Probably every organization will need a data science team that can do this kind of AI stuff. And it was kind of bold at the time. There was a lot of people that said, no, no, no. AI is just for ad tech. The ad companies need it. But we thought, no, no, this is going to be a bigger market.

And actually, we had a lot of debates internally. We weren't sure it was going to explode. So we got into it. And then we realized, when we started the company, we realized why they're not doing it, why it's so hard. Because basically, all the organizations out there in the world are bogged down. They have legacy software that they've had for 30, 40, 50 years. Some of them, companies have been around for 100 years. Things are moving slow. They have a lot of processes. There's a lot of compliance, a lot of regulatory, a lot of security. By the way, all these things have gotten worse with generative AI in the recent years.

So basically, what was missing from our research at UC Berkeley was that we didn't think about the security, the governance. So what we did the first bunch of years is that we figured out, how do we take this technology that lets you process all your data in an enterprise? So organizations have a lot of data. The most important data they have, actually, people don't talk about it. The most important data any company has is the data on the core product that they have. Like for you here, it's this podcast, the data on that. Someone else might be selling insurance. Someone else might have a drug.

It's the data that comes out of that. That data doesn't sit in CRM. It doesn't sit in human resource management.

Speaker 200:05:11

In fact, it probably wasn't even tracked. I remember in the early days of the internet, they'd be like, hey, would you like this log file? And I'd say, OK, yeah, keep everything. And they'd say, OK, well, you got an $8,000 storage bill a month. And I'd be like, OK, delete it. And they're like, well, we could roll it up and keep some of it. I'm like, well, who's ever using the open rate on our emails? Who cares about that? We send the emails, that's it. But then that changed. And was storage and compute and cloud computing a major accelerant to this big data movement and then eventually machine learning?

Those were kind of the waypoints in this movement?

Ali Ghodsi00:05:48

Yeah. Before we started in 2013, basically, people were running their own data centers. And when they're running their own data centers, you have to buy machines. And the machines came with storage and compute combined. So if you ran out of storage, you had to buy more machines. And the IT departments of every organization were busy with this. What the cloud enabled was to just completely decentralize this and separate compute and storage so that you could just imagine you have infinite storage. You just dump everything there. And if it's gone cold, so the data is old, it knows how to archive it so that it becomes almost free to store it.

And then you could get the illusion of as much compute as you wanted. And then, of course, you could start running machine learning on it. And then eventually, GPUs showed up. So it kind of transformed everything. We bet everything, the whole farm, on just being a cloud company. We bet everything on AI, the use cases of AI. And we bet on open and open source. And at the time, actually, all three of these bets were controversial. I had a standing bet with one of the most important analyst firms out there where they said, it's a strategic blunder. You're going to go under because you're betting on the cloud.

And it turned out, actually, the only reason we succeeded was because of these bets, because they were contrarian, because other people did not agree with them. So we got a head start for many, many years. And then eventually, when we happened to be right, then we were so far along and we'd gone too big that there's too much momentum to stop it.

Speaker 200:07:11

It's so funny you mentioned this Netflix algorithm. Netflix started, obviously, in the Bay Area as DVDs that were mailed to you in an envelope. And then you had this queue. And it was critically important for people who don't know the Netflix price. This was in the 2008, 2009 time period. They put a million-dollar prize out to any computer science team that could make the algorithm, I think, 10% better at predicting what movie you would give four or five stars to. So they just took all their data, they released it, and then they got probably $50 million worth of work from computer scientists around the world.

It was the first time an X Prize, and I think X Prize and this were around the same time. And they were all inspired by those old prizes to who could circumnavigate the globe, who could solo fly over Amelia Earhart, who could solo fly over the Atlantic or the Pacific. It was like a very interesting moment at time. And that hit Amp, right? And Amp, the group was algorithms, machine learning. I don't know what the P stands for.

Ali Ghodsi00:08:22

It was for people, actually, because we thought that the AI is not good enough yet. So it needs a little bit of human nudging. So it's actually just kind of human feedback was already there. We were like, we do need the human feedback because there's this last mile that's just too hard for AI to figure out itself. So we had people there as well.

Speaker 200:08:41

Putting the people in there makes sense because Berkeley is a little hippie-dippie. Friedberg's all my money, obviously. They were like, we need some people in the middle of this. You know, we had Ben Horowitz on, sat in the other week. And he was like the best explanation I've ever heard for why we are going to be able to control the rollout of superintelligence and this jump between artificial intelligence or artificial general intelligence and superintelligence that gets recursive and runs off with it and P dooms us all and we're all going to die sentiment by some people came from you.

So please explain your thesis here. And then I'd like you to go even one step further and talk specifically about maybe the culture in the Bay Area, perhaps even the East Bay, and this group of people.

Ali Ghodsi00:09:36

I mean, happy to get into it. You know, I think there's sort of two different things happening at the same time. On the one hand, I actually think we already have artificial general intelligence. I've been saying it since last year. And I base that on the kind of consensus we had in that Amp Lab where it was, I think, the largest AI lab at the time in 2009, 2010. And that definition of AI that most of us had, AGI, we already achieved that last year. And I wasn't actually sure about this. So I actually went and checked with some of the people that were in the lab, like, hey, is it just me? Am I hallucinating?

And they said, no, no, no. That definition for sure. But we've moved the goalpost. So I actually think we have all the intelligence we need. And actually, if you stop the intelligence, if you happen to stop all progress right now, I think we have all the intelligence we need to completely transform the planet.

Speaker 200:10:22

And do all intelligence work by humans, right? I mean, it solves this latest cohort of math problems. And we're just starting to build harnesses and build out the infrastructure. I guess your statement would be correct. And I kind of am in line with you. We've hit artificial general intelligence. It just hasn't been distributed, equally distributed yet.

Ali Ghodsi00:10:42

Yeah. So the labs and a lot of researchers, they're kind of obsessed with superintelligence. So when I say superintelligence, I mean it the way it was defined by Boltzram in 2014 in his book called Superintelligence. And there, he's talking about something completely different. He's talking about something that can do a millennia worth of thought. So like 1,000 years of human thought, it can do it like in a minute, all of mankind in a minute. It thinks in 11 dimensions. It's so much faster. Just a single agent is just many orders of magnitude.

Imagine 1,000 times faster than any of us. And that's just a different thing. It can write a novel PhD thesis instantaneously and so on. So I think the labs are on the quest of that. And in that quest, by the way.

Speaker 200:11:28

And so just to summarize that there, the ability to write an entire unique PhD thesis instantly, which do we even have the amount of compute in your mind to do something like that today? If everybody got together and said, hey, today we're going to give all our compute, or for the next hour, just as a thought experiment to this incredible mega prompt, do you think it would actually happen? Is it a computer issue or is it a model issue?

Ali Ghodsi00:11:54

Well, actually, the AIs are kind of slow. What we have to do is we have to parallelize them and have many of them. And we have to have them to collaborate with each other. So it's actually not the way kind of that he wrote it down. He had also intelligence in the book of how it can be communities of intelligence. But I'm just saying the labs and many of the other companies are focused on this. And that's why they're so obsessed with the math, the clay problems, the seven millennial problems and so on. But I argue that the biggest challenge that's facing us is how do we actually just make this AI applicable inside organizations?

That's what Databricks is focused on. We just want to help all these organizations. And when I go talk to organizations out there, enterprises, I see that they're just using AI in very rudimentary ways. They're just using it as a glorified Google search. They're using chatbots all day. And instead of typing a Google search and getting 10 blue links and then looking at the 10 blue links, the AI just does that for them. The second thing that they're doing is they're doing coding. And with the coding, actually, they're not seeing enough speed ups. They're seeing maybe like 20%, 30%. I ask them this question every day. I'm in meetings every day with customers. And I ask them these questions.

That's kind of what reality looks like. I always ask them, how many of you have thousands of agents running around automating all work and doing core work for you and so on? It's just not happened yet.

Speaker 200:13:05

Now, they might be running a half dozen agents, a dozen agents. Somebody who's at the forefront might actually be coordinating against that many. But the human still needs to be on the loop, just like Amp. There's a person who still needs to be in there because it will return slop. It will return weirdness. It can go drift off course. It's not possible to have 1,000 agents doing stuff realistically. Am I correct?

Ali Ghodsi00:13:33

Yeah. Well, somewhat further along, I mean, I'm actually using this all throughout Databricks. And I'm happy to show you. But the reality is that they're not. And you have to ask the question, why is that? If it can solve Navier-Stokes very difficult math problems, how come enterprises and organizations out there are so far behind?

Speaker 200:13:50

Why is that?

Ali Ghodsi00:13:51

Well, there's many reasons. But the main reason is, or maybe one way to look at it, if we could gather all the information that you have inside a large organization with 200,000 employees, record all the meetings, which, by the way, that itself, one of the big bank CEOs told me the other day, no way. We're never recording the meetings, like not in a million years. But assume you have that.

Speaker 200:14:10

Because of liability.

Ali Ghodsi00:14:11

Liability. I mean, by the way, which I was already kind of shocked. Because if you can't do that, how can the AI ever help you? The AI is simply not in the meeting. If it's not in the meeting, it's useless. It doesn't matter if you have Terry Tao or you have the greatest mathematician in the world. If they're in the cold and they don't know what decisions or what you're doing in your meeting with hundreds of thousands of employees, there's no way it can help you. So if you capture all that context and you could feed it to the AI, they would nail the problems. They could help us right now already. So that's really the context problem. Now, you might say, OK, well, let's figure that out and do that.

And we're doing that at Databricks. But that's not enough. Even if you do that, you have a second problem, which is you could unleash something like Open Claw and just have it access all your data everywhere. Well, then you get into this problem that you're going to get hacked. Cyber is a real thing. And all the big organizations that have successful businesses, they're really terrified right now of getting attacked. This is like a big concern, the top concern.

Speaker 200:15:05

It certainly creates a lot of surface area when you embrace this. I mean, if a CEO or in a small company, you want to connect everything, it's a certain amount of surface area. But for a 200,000-person organization, 10,000, my Lord, the surface area has now gone 1,000X.

Ali Ghodsi00:15:21

Yes, exactly. So that's like the second problem you bump into, which is like, OK, we can access all the data. Well, wait. We don't want to maybe access all of it to the agents because now we have an insider threat and we might get hacked. So what do we do about that? Well, let's say we solve that too. So now we've solved the cyber problem, which, by the way, we have actually ways to do that at Databricks. Happy to show you. Then you still have another problem, which is, OK, now the token cost is going up exponentially. So if the token cost is going up exponentially, is your revenue at your company going up exponentially? And I don't know any company who started using AI. And as of their use of AI, their revenue started accelerating exponentially, matching their cost curve.

So then eventually, first of all, CEOs are like, go get the AI. Get more AI. Get it in there. We need to move faster.

Speaker 200:16:02

Tokens are dipsing. Yeah.

Ali Ghodsi00:16:03

Exactly. But then at some point, the CFO shows up and says, hey, our opex is going up significantly here. And even the COGS. What are we doing about it? And we have an earnings call soon. And then they freak out. So then how do we fix that? So you need to also do this efficiently, which we also have ways to do that at Databricks. Now, you've done all of these three. Then there's a strategic last question that still remains, which is like, OK, fine. We figured it out. We access all the data. We secured it. And we figured out the cost situation. How do we avoid getting locked in? And how do we own our own IP? Because otherwise, there's no business to be made in the future.

Speaker 200:16:38

Data sovereignty is what you're kind of referring to, intelligence sovereignty. And if you use Anthropic, OpenAI, or any of these platforms, there is this risk that it will leak, that it will get incorporated into their next version. And as we've seen, a company called Anthropic seems to be releasing every two weeks a half dozen products that just now they're competing against Microsoft, one of their, I think Microsoft is like one of their giant partners. And they just came out with basically an Excel killer.

They're killing Photoshop. I mean, they're just going after everybody wholesale for free.

Ali Ghodsi00:17:17

Yeah. So by the way, these companies are amazing. They're doing amazing work. And without them, we wouldn't even have this intelligence, probably. So I'm thankful. This is awesome. I'm just pointing out why when you look around you, all these successful organizations, all the Global 2000, all the Fortune 500s, NASDAQ, and so on, how come it's just glorified chatbots and a little bit of coding? This is the reason. So you need to really tackle all four of those. And only then can you start getting something out of it.

Speaker 200:17:47

And one of those issues as well, I believe, is the autonomy in an organization to come up with a groundbreaking idea. You may have captured a large portion of your market. You may be getting incremental benefits. So if I tell you like, hey, we can put another 500 horsepower into your Ford Taurus, it's like, OK, my Ford Explorer now has 500 extra horsepower. It's going to rip the chassis off. This thing is not capable of going 500 miles an hour.

So then it's, well, who decides we're launching three more product lines? Well, at Anthropic, somebody is deciding. Why don't we just go after every single business in the world? And they started doing dashboards. That's a little close to your business, is it not? A little dashboards over here?

Ali Ghodsi00:18:37

Yeah. So dashboards, we don't have a product where we charge for dashboards. Dashboards are usually backed by data. And you typically want that data to be governed. So you don't want just numbers. And then those numbers are incorrect. This is a big problem in organizations. So that gets back to the second thing I said, the governance security aspect. So like, yeah, maybe we can get access to all the data and get all the context. But we've got to make it secure. So yeah, it's great. So you can actually connect all of these agents from outside to Databricks. But then we are the governed data repository. And then when you access that data and the governance, we charge consumption rates on that.

So actually, that's one of the reasons you see acceleration of our business. Because all these companies, whenever they have agents and they're using it, then I think we're just in the beginning. As I said, I still think it's mostly Google search and coding. But the agents, when they start using that, they just send us more queries.

Speaker 200:19:26

How does the behavior change when people actually embrace agentic technology and they start working with agents, let's say, every hour, every other hour of the day, like you and I do?

Ali Ghodsi00:19:39

I think that the organization, the org charts are built this way. It's like a tree structure. There's a CEO at the top. And all decision-making goes kind of up and down in these org charts. And you have all these old processes. And getting agreement across this org chart is very, very hard inside of an enterprise or inside of any organization that's sizable. It's somewhat easy up until Donnbyrd's number, which is 150. You can know everyone. So small startups, it's a different story. But above 150, this becomes a coordination problem.

But if you look at how actually any organization actually sells a product or a service to its customers, it's actually not this kind of hierarchical thing. It actually cuts across that org chart. Like here at Databricks, we have customers. They give us feedback. The feedback goes to product management organization. Product management hands it to engineering organization. Engineering builds products. That goes to marketing that markets it. And then marketing gives it to sales. That sells it to customers again. So you kind of want to go across. So you want to cut out that latency so that you can be really, really fast.

But that requires that you have an AI that actually understands your whole business, your IP. It needs to understand your org chart. It needs to know who's who.

Speaker 200:20:49

What percentage of companies actually understand what you just described? Would you say 10% of organizations understand this? 5%?

Ali Ghodsi00:20:56

At scale, I don't know how many. I don't know the answer to that. At scale, I know that Databricks is doing it. I'm doing it.

Speaker 200:21:02

Yeah.

Ali Ghodsi00:21:03

I haven't seen anyone else, to be honest, do it at this kind of I think probably Block and Square with Jack Dorsey, since he's pushing. He's calling it the company world model. He calls it the same thing I kind of described. I think different way of viewing it. He's calling it the company world model. So I think that they're probably pretty far ahead. In general, I think digital natives are probably further ahead. Digital natives being companies that have only existed 10, 15 years. If you've been around 20, 30, 40, 50 years, which means you're an amazing company.

Maybe you're a Fortune 500, the best companies in the United States. You have maybe 100,000 employees. They're loyal. They love your product. And you know what? You're the best in the world on that. You have so much software. You have so much regulation. And you have so many processes around security and so on that it's very hard for you to adopt this. But that is the very problem Databricks wants to solve for them. So we want them to adopt the technologies so that the AI, so that they can do what I do at Databricks, basically.

Speaker 200:22:04

Yeah. Let's see it. You said you would be willing to show us how you run Databricks with agents and with AI. And I've been looking forward to this all day because I literally am taking the entire, while you queue it up, my entire life on podcasting and on early stage investing. And I'm looking at each of the components of those things as services, as agents, and defining the goal, working backwards to what are the signs of success that you're heading towards the goal, not that you've achieved the goal.

Achieving the goal is kind of binary, yes or no. You made the sell. You didn't. But what are the precursor signals? And then trying to have each of these bots hand off things back and forth. You have to be a real systems thinker. It's like kind of playing five chess games at once while riding a horse. I mean, it's really like intellectually, I find it super stimulating. I can tell you do too. So here, you can share your screen.

Ali Ghodsi00:23:01

So let's jump in. So OK. So the key thing here is that we have a product called Genie. But the key thing that Genie has, because there's so many chatbots out there. And there's so many assistants. And there's so many cowork products out there and agents in the background. The key thing is that it has an ontology. The ontology is a graph that it constantly is constructing for your company. That graph understands all of the people, who reports to who, what are they working on, what are the emails that are coming in, what meetings have happened, and what's the transcripts of all those meetings and all the decisions that are being made there, what's on Slack, what's being communicated.

So it has access to all of these things. And then also all of the docs that you're creating, all the Excel sheets, all the PowerPoint presentations. So it has access to all of those. That's what we call Genie here. So you can see here. So I wake up. It has an inbox. In the morning, when I come in, it basically has done a bunch of background work for me. It's running 24/7. As you can see, it has access to my calendar. In fact, I could just ask it.

Speaker 200:24:05

Which I tell Jason I'm all in today. Here it goes.

Ali Ghodsi00:24:07

Yeah. So see what it's going to say. But let's look at some of the stuff that I've done. So actually, the other day, one of the interesting things is I was looking at our HR department came back. And they were saying, hey, we've done a survey on all of Databricks. So we had over 10,000 people, employees, that responded to this survey. And I looked at the results. And she was going through it. And I said, hey, make me a dashboard of the results. Nothing magical here yet. So it told me like, look, here's how you're doing. You're doing great on some things.

Speaker 200:24:36

Executive leadership, 88%. You're doing OK.

Ali Ghodsi00:24:38

Yeah.

Speaker 200:24:39

Work-life blend, 60%. You're working people pretty hard over there. But maybe everybody says that, right?

Ali Ghodsi00:24:46

Yeah. No, but we want to know. But this has been so we wanted to improve these two. And this action one really bothers me because action, by the way, it means that when we ask them for feedback, they give us feedback, improve this and that. And they feel like you're not listening to us.

Speaker 200:25:02

So two out of three feel you are. One out of three feels you're not. You're doing OK. It's not terrible, by the way. This could be like 30%.

Ali Ghodsi00:25:10

60% is not great. And especially not great if you actually take into account that every year it's slow. And every year, I promised the company we're going to fix this. And every year, it doesn't happen. So we're going through the results. And we're discussing it with these staff. And while they're discussing it, they're speculating. My CFO says, hey, I think it's because of work-life blend. Work-life blend is bad. And that's causing action to go down. So it's causing. Work-life blend is causing low action. And I was like, that doesn't make any sense.

But I just entered here immediately as we were discussing. And it immediately pulled up. OK, this is the correlation between these two. And this is how it's looking. And I was like, OK, wow. Maybe he's right. But then it says, no. Actually, it's not causal. It's not causing it. And here's the exact proof point. We probably have to anonymize these folks. But here's a manager that has work-life blend 44. That's pretty bad. Action is 77%.

Speaker 200:26:05

They're working hard. And he's recognized it and taking action on their concerns.

Ali Ghodsi00:26:09

Exactly.

Speaker 200:26:10

That's your guy right there. He's pushing people hard. And he's listening to them. I like that.

Ali Ghodsi00:26:14

Exactly. So now I'm learning stuff about the organization. This is amazing. It would have taken me like a week to get the data team to do this analysis for me. But that's just me getting information. That's useful. So we're cutting these latencies up and down the org chart a little bit. But then I'm like, OK, why is it low? And look through all of the comments. And it gives me some reasons. I didn't like the reasons. So then I actually clarified the question. And I said, hey, can you slice it by department for me? And then actually it figured it out. It said, look, product management has low action because they don't like decision-making is too many stakeholders.

Engineering, they don't like the tools and systems. There's too much. Sales operations, it's career growth, and so on and so forth.

Speaker 200:26:53

That makes sense because salespeople always think they should get a promotion because they're salespeople. And they should get their commissions raised. And product people think you should just listen to them instead of six people trying to design a piece of art. This all starts to track now with the data and the AI. I love it.

Ali Ghodsi00:27:13

Yeah. So how did it do this? It has access to its ontology. So it's not going and searching live only. It actually found that it already had in its graph these people. Already five people had already contributed to this. And there's 19 pieces of information here that you can see that it's actually leveraging that it already had. It didn't search for them live. These are in the ontology. So we can look at, for instance, this particular one. If we click on it, it has a definition. It's a metric. And there's a graph. And this graph, you can see it here. So there's a favorability.

And it comes from this is the author. You can click on the author. And because it understands the org charts, they understand who this person is. This person actually has 29 snippets. They have lots of different assets that it's learned from them. So this constantly is learning the intelligence or ontology of your organization. So that's a typical thing. Here's another one that is maybe interesting. I wanted to know actually there's new results here in the last 59 minutes. I haven't actually looked at all of those.

But I wanted to understand the org chart and what's going on with the org chart and span of control. And I asked it. And already, out of the box, I was shocked by this. It immediately told me like, hey, there is an org inside Databricks, which is very deep. This person reports to this person reports to this person reports to this person. But they have three people reporting to them, five people reporting to them, four people reporting to them, five people reporting to them. So that's not a flat organization. So then you can look at, OK, what can we do about that? Again, since it understands all the people, it can immediately out of the box understand that.

Engineering, cost. Cost is something that we look at at all. And so that's another thing we wanted to see if we could understand.

Speaker 200:28:57

And what's great about this too is instead of you as the leader saying, hey, listen, if we're going to have an opinion, let's go with mine, you've now created a forum where people can be data first, test theories. And you don't have to be dogmatic about who came up with the theory. You just have to be intellectually curious and open to possibilities. And eventually, if this is where we are today, can you imagine like in a year or two, it's going to just be giving you these instead of through a culture report, it's going to be like a temperature gauge in your company.

It's just like you're going to be looking at the nest in your company. And it's like, oh, wow. Looks a little hot today. What's going on? It's like, oh, yeah. We made people come in this weekend. Maybe we should buy some pizzas or give people a Comté during Thanksgiving.

Ali Ghodsi00:29:45

Yeah. Yeah, this is my favorite. So this one actually came out of Genie. So this is our 2,000 engineers. And this is how many pull requests or how much code they've actually shipped into production. If you look at the middle here, it's maybe per week, roughly. But it has this L shape. And you look at this L shape, the top people are actually committing way more.

Speaker 200:30:04

Yes.

Ali Ghodsi00:30:05

10 times.

Speaker 200:30:06

So what's going on?

Ali Ghodsi00:30:07

Yeah. So what the hell is going on? So we looked into this. And it turns out they're running automated factories. The rest are not. So we pushed them. And actually, by the way, interesting thing I asked it, hey, can you add cost to this, add the cost to this line? And one of the interesting things we found is that it's not even the case that cost necessarily is higher for those people. So look here at the top. The top folks, some of them are actually not spending as much as some of the other folks. So which, by the way, goes back to there is a way to spend tokens in a smart way. You can use open source. You can route simpler questions to simpler models.

And we actually have a product for this. And you can cut your costs down significantly. So this is the kind of stuff. By the way, recording the meetings is really important. So one of the things I heard that there was a customer meeting. And I wanted to understand how that meeting went. And I just asked it, hey, was there a meeting with this customer recently? How did it go? And it literally started by saying the meeting went poorly.

Speaker 200:31:04

Ooh.

Ali Ghodsi00:31:05

And it's listing exactly what, who said what, what are the features they need. So these are just some of the things that you can do with the AI. And in the background, when I wake up, it has all these deep dives for me. So instead of waking up, calling people, doing meetings, it's doing the work for me. It's pinging them. It's sending whatever material is needed for the company. So it just compresses the time it takes to do things.

Speaker 200:31:30

Well, you know a lot of being in management and being a founder is detective work. I call it like being Colombo. If you remember that TV show, I think it might show our age. But you're kind of like, oh, you know it's one more thing there. Can you tell me about the meeting, the client meeting? How did that go? And who talked most on the phone? And what percentage of time did they talk? And what did the customer actually think? And then you, as the founder, are getting spun. You're getting spun. And it's not that an employee necessarily wants to spin you. A team member is not looking to spin you necessarily.

That can happen. But that's not the majority. Most people are good people. But they're humans, right? They're the people in the app. And here, you take the people out of that discussion. And you say, here's first principles, transparently, what happened? Now we have ground truth. And we can start the discussion without you being the CEO having to be Mr. Detective. And it is so I mean, I don't know about how frustrating it was for you two years ago to spend two hours being a detective.

You get three meetings into this. And it's like if people had just told you what happened or if you had that report on culture, the problem would have been solved. You wouldn't have had three weeks of hand-wringing. Yeah?

Ali Ghodsi00:32:43

Yeah. I mean, or the customer feedback, right, that I can immediately find out all the customers. I have some of them where I'm just having it look at features that are requested from all of our customers automatically from all the transcripts of all the customer meetings that we have. And it's just gathering those. And they're immediately going to engineering. And then we have factories in engineering that can build features automatically. So it's a game changer. It's just that game of whispers that we played when we were kids, right? It's like when you have people have to meet. They have to tell. So one of our main goals is reduce the number of human blockers.

So we measure that throughout the organization. And we just see.

Speaker 200:33:17

Blockers. Explain a blocker in this context, please. This is something I could learn from.

Ali Ghodsi00:33:21

Yeah. I mean, the AI is very fast, right? It's just iterating in the background. And it's doing its work. And it's preparing material and so on. But at some point, it's like, OK, well, now we need to go to legal and make sure that we are allowed to do this thing. Or now we need to go to finance to get approval for this budget. Or now we need to make sure that marketing is OK with this. Or actually, just within the same organization, we need to talk to a sibling organization, get a meeting with them, and see what they think. And we have to get an agreement. And if we can't reach an agreement, we'll schedule another meeting where we'll look at this again. And then if that meeting does not, maybe we escalate it to the managers and then so on.

So these are the blockers that slow down organizations.

Speaker 200:33:57

So it's a blocker finder, which is great if you're the CEO because here's the next thing. One, you have to play detective. The other one is the blame game. Why isn't this done is what we always ask. And when you're a leader, whatever, your group, another group, hey, we were supposed to do this by today. We were supposed to hit this target. Who's responsible? And then you get three Spider-Mans pointing at each other if you know the meme. Here it's like, well, this actual piece of data has not been resolved. And your team has run nothing. I had a similar thing. I came up with a bot.

And I was going to share it with the whole company. And thank God I didn't. But I came up with a bot just called Major Decisions. And I just said, go into Slack. Join every room as me. Just join every channel as me, which some people are like, wait a second. How did you even know we had a room? I was like, join every room. Read every Notion page, even if I was invited to it or not. Get every email. And find for me for the month and every couple of days, give me a report on the most important decisions, who participated in them, and what was the resolution, what's not resolved.

Then I said, give me the people who participate the most in these kind of discussions. And then I realized, oh, wow. These are the people who are actually making decisions in the organization. These are the people who are quickest. And my next report is going to be is who's quickest to contribute to those discussions. Now, in a venture firm, that's going to be a discussion like should we invest or not? Should we take our pro rata or not? Should we sell our shares if we got a secondary offer? On the podcast, it's like, should we book this guest or not? Should we use this clip or that one? And then it picked up employment discussions.

And it was like, should we fire this person or not? Or do we do PIPs? And I'm like, we don't do PIPs. And I just think PIPs are ridiculous. The performance isn't here. That's like the person didn't show up.

Ali Ghodsi00:35:47

Let's torture them for two quarters.

Speaker 200:35:49

Yeah. You mispracticed. And you showed up late for the game. That's table stakes. You can't be on the team if you can't do those things. So now we're going to torture you and try to make you come into work on time or do a workout you don't want to do. So maybe you could speak to what this is going to do for you as a founder and a CEO in terms of figuring out who are your all-stars on the team. Who are the ones who are actually contributing? Because now we're getting to essentially business moneyball, like that movie Moneyball. It's fantastic, Brad Pitt.

It's such a good movie. It's such a good book. We're actually getting into management moneyball, aren't we?

Ali Ghodsi00:36:25

Yeah, absolutely. By the way, one of my favorite questions is just look at different orgs because we have certain culture principles: truth seeking, first principle, and so on. And I say, hey, which of these leaders follow these principles? Look in their whole orgs. Look at all the meetings. And it can derive from those. And by the way, you could even ask, hey, this leader, what is the actual culture they're implementing? And it'll come up with different they'll tell you, no, actually, the culture there is this, not the company culture, which is essential.

Speaker 200:36:49

So they're deviating from the core principles. That drift is cancerous for you as a founder. Or it could be something you need to change. And it could be an early warning sign.

Ali Ghodsi00:37:00

We need to be consistent, whatever it is, right? Maybe they're right and the rest of the organization, including me, are wrong. But then we need to at least it tells me that there's this divergence. And we can sort of so those kind of things were like nearly impossible to do. Like many of this other stuff you could have done. But a question like that, like get the culture of this subgroup in a 12,000-person organization. Figure out how the Japan organization at Databricks I don't even speak Japanese. And we have hundreds of people over there working. Like what's the culture like? How do they make decisions? How is it different from the EMEA or the LATAM region that we have?

So those are kind of game changers. For us, it's really I share all this information with the employees. They have access to all of this themselves. And then I tell them, look, this is what we want. Like that L curve, we wanted to shift it to the right. So everybody, let's change that. Let's move towards the North Star that we have together. And that helps us just be more competitive. And then once we get more competitive, we can build more products. And we take market share. And we can accelerate our growth further. I'd like to not be 70%, 80% growth year over year. I'd like to be 100%, way over 100%.

So then we can put that's how I see it. So in this era right now, this is a competitive advantage. Whoever can do this best, at some point, maybe it's all everyone is using. It's fully diffused. And everybody is doing this. But right now, this is big alpha. If you can do this really, really well, better than any other organization.

Speaker 200:38:24

Speaking of big alpha, a lot of people have been very patiently been on your cap table. And we have a big debate between founders and capital right now. Stay private longer. What's the point of going public if we have secondary markets that are quite efficient? Stripe has been private closer to 20 years, I think, than 10. And they seem to have given the indication they're going to stay private longer. SpaceX took a little while.

Uber took a little while. I felt that one. But luckily, Masayoshi Son was flashy cashy. When do you go in public? And how do you make that decision? I know you got a lot of pressure on you to do it. But you also have a lot of pressure relief valves in the vibrant secondary market.

Ali Ghodsi00:39:10

Yeah. Look, my goal is to make Databricks as successful as possible in the next decade or two. That's how I'm thinking about it. What's the right strategy to get there? I mentioned this alpha of what we're doing here, the products we're building. By the way, we're getting into new markets. We got into security market. We got into the marketing market. I'm focused on those. Then the question is, the path to get there is the best way and the fastest way for us to be public or to be private? And I actually think.

Speaker 200:39:35

Take me through that. What's on each side of the ledger for you?

Ali Ghodsi00:39:37

Yeah. I actually think that you get access to capital. You get much, much better marketing. It's like everybody knows about you. Like every quarter, you have this big marketing event. And you can tell your story again and again and again. Those are huge advantages. We have to organize our own tenders every year. Every year, we do finance has to go through this big process. I think we raised $20, $30 billion. And then we have to arrange that. It's a heavy lift. There is a marketplace that just does that.

Speaker 200:40:02

So it's probably pretty emotional and distracting, I would think, right? Like people have to decide. Then you might lose people that, hey, they take $10 million off the table. Now they're like, eh, maybe I don't want to come to practice anymore.

Ali Ghodsi00:40:12

I think the liquidity I think the liquidity is a good thing because people know that they're going to get it every year. And it kind of comes. And it's like predictable. And that's like the one time they have. And actually, in the past, it's turned out since we started doing these a few years ago, it turns out that the money that we set aside for tenders, they never use up all of it. So most employees are bullish. Yeah. So most employees are like, no, this is.

Speaker 200:40:31

That's good for you. You get signal from that, right? Who's selling, who's not? It's a little bit of signal. It could be personal reasons. But acquiring companies is a great reason to have equity. Yeah?

Ali Ghodsi00:40:42

We can I mean, we haven't had a problem doing billion-dollar acquisitions because they know because of the liquidity that we will provide. And then I think most people do the calculation. It's like, OK, if the business is $7 billion plus and it's growing 70%, 80%, they do the math. It's like, OK, I could most people say, I want liquidity. But then when you tell them, like, OK, well, how much do you want to sell? We're growing 70% plus.

Speaker 200:41:03

It's a different story.

Ali Ghodsi00:41:04

Can you do compounded growth of 1.7 to the power of 3 or 4? And then they start scratching their heads. It's like, OK, maybe I'll sell like 5%.

Speaker 200:41:12

Yeah. Sitting on your hands is a very important skill to learn as an investor and an employee with this kind of stock. I mean, listen, you do have to protect downside when you get in that space. Who do you see as your competition right now? Everybody says something like Snowflake. But I'm watching a market where, as I said earlier, Anthropic is launching feature after feature. Cloudflare is looking at features next to them. Replit is looking at features next to them. Everybody seems to be looking in their peripheral vision.

And because you can build software fast and because you have a lot of developers, if those developers keep going up that ramp that you showed, you only had 10% of people at that peak, which means as that 90% climb up there, your developer resources are going to go through the roof. So you have a decision to make. Do we just have less developers at the low end of the tail and be more profitable? Or do we invest all that developer time as they move up the ramp? So how do you think about both of those issues?

What to do with massive resources that this efficiency is creating? And then who is the competitor? And do you need to just keep making peripheral product moves?

Ali Ghodsi00:42:25

Yeah. We will make peripheral product moves. But maybe I should just start by saying, OK, so those were the upsides of going public. The downsides are is the reason why to answer your specific question, like why do we compete? Who do we compete with? Why do we build these products? I don't want the market to force me that, OK, now it's down. And now sentiment is terrible this week. And now your stock is down. And when the stock is down, the employees literally are getting a pay cut. And I say, well, you promised me I was going to make a million dollars.

Actually, you said it's going to be $2 million in a couple of years. But I'm looking at it right now.

Speaker 200:43:01

It's underwater.

Ali Ghodsi00:43:02

It's actually $200K. So you lied to me. I'm leaving. OK? And then three months later, it's like, oh, no, no, no. Actually, the revenue is accelerating. We were totally wrong. It's up to the right now. It's like, oh, OK, wow. It's great. So there's like back and forth.

Speaker 200:43:15

A little bit of a roller coaster can be difficult.

Ali Ghodsi00:43:17

Roller coaster. That's what I want to avoid so that we can focus on that long-term building the company towards the vision that we have in the long run without being distracted. We will go public. We are going to be public. But right now, I think during this transition period of AI, there's just too much up and down. And I think it's distracting to companies. It's distracting to CEOs. It's demoralizing to CEOs. They call me. They're depressed because stock is down. They don't even understand why. And then the stock is up. So that's what we're trying to avoid.

Speaker 200:43:44

I think it's an issue people are starting to have with their sleep scores. You get a whoop. And I love it. But I got my wife a whoop. And then we're like comparing sleep scores. And now it's kind of like looking at your Uber stock every day. You get a little bit of volume relationship. It could be challenging.

Ali Ghodsi00:44:00

Yeah, no. Exactly.

Speaker 200:44:01

It's interesting. Hey, we didn't circle around to what Ben Horowitz said. He said that your formulation of superintelligence is some combination of the model, the power, and the time it takes to train and be accurate. Can you walk us through it? Do you have it off the top of your head there? Ready to go?

Ali Ghodsi00:44:18

Yeah. I have to do it. I mean, it's pretty simple. So I think the main problem is the context problem. We're solving that with GENIE and the ontology. The labs are focused on superintelligence. That's what Bo Ström talked about. Bo Ström in his book also said, how do we get there? He actually, in 2014, I believe, defined RSI, recursive self-improvement, which means that the AI starts improving itself. And then it gets better and better and better and better and better. And then we get this takeoff, maybe a fast takeoff. And at that point, we reach this singularity.

And we're no longer in control. And at that point, let's hope that the AIs are well-aligned. Because if they're not, we're all going to be made into pets. And this is where the 10% risk.

Speaker 200:44:58

Paperclips.

Ali Ghodsi00:44:59

Yeah, paperclip maximizers and the 10% risk to humanity. And all of that comes from there. But I think a lot of this is actually coming from most of the folks that are building this AI. They've seen that the AI has become really good at coding. And almost in every company, as I said earlier, the coding is being done by coding agents. So then they're seeing and I think this is actually causing a big existential crisis in Silicon Valley. And it's actually, for most of us who start who grew up coding our whole lives, it's a big deal. It's like I spent 10, 12 hours, seven days a week from third grade until my 30s just coding all the time, right?

And I was really good at it. And I knew all these languages and so on. And then suddenly, it's like the AI is doing that.

Speaker 200:45:43

Well, I mean, the AI is how much better than you. That's the other part. It's like.

Ali Ghodsi00:45:47

Yeah. So now it's writing itself. And the next version, it wrote itself. Wait a minute. Isn't that the recursive self-improvement? But wait a minute. Then this is going to speed up. And then we're going to get into this loop. The book called it Superintelligence and the Paperclip Maximizer. So it might go off. And all these bad things happen. Actually, interesting, Bo Ström has kind of changed his view now. If you actually follow him now, he's actually not anymore. He's saying that we should do this. There are risks. Of course, there are risks with cyber. But I actually think you need to actually think this through further. Just because 98% of the code is being written by AI, we don't have RSI.

If it automates the last 2%, who cares? Does it matter if it's 98% or 100%? Why does it matter? Actually, it doesn't matter. So we really need four conditions to be true. The four conditions is that we need the next model that's trained to be trained in a much shorter amount of time. And still, the big pre-training runs that the labs do, they don't do actually that many of them per year. And it's still following what's called the scaling laws, which means you need exponentially more hardware to get that improvement. So exponential more, like 10x more compute to get a little linear improvement.

So they're scrambling to get all the GPUs and put together the biggest data center that they can possibly put together with the networking and do all the engineering. And then they're having humans do all of this because they really don't want to screw up the next run. If the next run gets screwed up, then the whole thing falls apart. But we would like that next training run to be faster. That's condition number one. And actually, it can't just be a little bit faster. It's like it can't be like you're halving the distance every time. You'll never get there. So in some sense, it has to be super linear. Secondly, we also want it to use less resources, right?

Because you could say, OK, it's getting faster and faster. But that's because we're 10xing the hardware all the time. Well, you can't do that trick because we run out of hardware. And we run out of atoms. So that's like the second requirement. Third requirement is that the accuracy is also improving at least linearly. Or we're getting better accuracy across the board in a generalized manner. It can't just be it's getting just better at this one dimension that we did reinforcement learning on or just math. It needs to be across the board on all of its tasks. Even if you do all of those three, it's not enough. Let's say you do that five, six, seven times. That's awesome. You get really awesome models. That's not that kind of superintelligence.

The fourth condition is that you can actually put this in a loop. And all the previous three conditions need to be continuously happening so that we end up in a world where the next model takes three months, then one month, then two weeks, one week. And it's getting smarter and smarter and smarter. And it's costing us 100 bucks or maybe cost us 100 million, then 50 million, 25 million, 10 million, 5, 2, 1. And then it goes down and down. That's the kind of scenario we have.

Speaker 200:48:23

That's the flywheel.

Ali Ghodsi00:48:24

That's the flywheel. That flywheel doesn't exist right now. The models are taking longer to train. And there's more data cleaning. And there's more manual whack-a-mole happening where you have vendors like Mercore that has to actually go get the data from very skilled labor. And then you have to do reinforcement learning in these gyms. And you have to kind of whack-a-mole in each domain. So it's very domain-specific. And then, of course, the pre-training requires more resources. And so that doesn't look like we're getting into this loop. By the way, even if you satisfy all the four conditions I'm saying, that doesn't guaranteed mean that you'll have a conscious being that's just taking over everything and just.

Speaker 200:49:01

It's the precondition for that happening. And there's no guarantee that it actually.

Ali Ghodsi00:49:06

It's a precondition. But even if you had that, which we don't have, you would have to to threaten me right now, you would have to have a killer robot come into this room right now and wrestle me down or something. And those don't exist yet.

Speaker 200:49:19

Right now, you can have a bunch of hackers take a really capable model. And you can find out that the refrigerators in grocery stores in France have the password admin admin and that you can remotely script kitty into them and turn it into defrost mode and make a bunch of butter go bad and milk, which is a tragedy for the French. I understand. But it is not superintelligence, I can assure you. I mean, did you see that hack? And now people were losing their minds over it. I'm like, guys, you know how when you buy a new router now, it has the serial number and then a random password?

Ali Ghodsi00:49:55

Yeah, admin admin. Yeah.

Speaker 200:49:57

Yeah. If they had done that on the refrigerators, they would have been able they wouldn't have been able to hack one of them unless they got into the place, took screenshots of 20 different refrigerators, physically compromised some supermarket in the Eighth and Drosmond, which would have lost, I don't know, 10 pounds of butter. It wouldn't have been a big deal.

Ali Ghodsi00:50:15

So look, cyber, I do think is a real thing. And I think it's a real risk. We actually have a whole product in the cyberspace called Linkwatch built on all this data that has automated agents that actually detect these kind of intrusions that are happening. And they monitor your agents that you have. This is a real problem. And I do think bad things will happen here. But then we will adjust. But bad things happened when the internet came out as well.

Speaker 200:50:38

Shouldn't we be able to solve for this? Because you tell me if I'm right or wrong here. One theory I heard, which resonated with me for a certain type of hacking, not for the script kitty hacking, but real hacking, is you have a lot of compute. You need a lot of compute to execute certain hacks, like the Hugging Face one, 1,000 agents, whatever. The bad guys don't have that much compute. The good guys have a massive amount of more compute. And so if you just did your basic job as a white hat and defended properly and looked for these exploits, let's say you have 1,000 times the resources, you should be able to get to these problems long before the hackers.

Does that make good sense to you?

Ali Ghodsi00:51:22

Yeah.

Speaker 200:51:24

It's a good argument, right?

Ali Ghodsi00:51:25

Yeah. But the issue is that you have to weigh that against the following asymmetric scenario that we have, which is if I'm an attacker, I can launch thousands of thousands of thousands of agents. And all of them can fail except for one. And if one of them gets through, I am completely successful. The asymmetry is that if I'm a defender, I was able to protect my boundaries all the time except one got through.

Speaker 200:51:50

This is a suicide bomber. Not to be too graphic, but you only need to get one 9/11 to make your point. And you could try 1,000 times and not get through.

Ali Ghodsi00:51:58

Yeah. So I need to be 100% safe all the time. They need to just get one thing through.

Speaker 200:52:03

Get lucky one.

Ali Ghodsi00:52:03

So it's like very asymmetric, that risk. But however, the way I would look at it, the reason I think that we're actually going to overcome this and it's going to be totally fine is that these are actually latent bugs that exist in the source code. By the way, we're not creating more of them now because almost all of us are now scanning it. We all have products. I mean, we actually sell a product where we can scan the vulnerabilities of new code. So new code that's being produced is not going to have these vulnerabilities. By the way, that might sound silly. But think about it this way. In the next 12 months, we're going to write more code than ever in the history of mankind, actually in less than the next 12 months.

So all that code is going to be secure. So then, and by the way.

Speaker 200:52:38

Because right now, the AI is sophisticated enough to not make human errors and to look for it. And it's more dogged?

Ali Ghodsi00:52:44

Yeah. You just can't scan those things. So then what remains is all the legacy code, which, by the way, we can rewrite all of it, which is what we have to go through.

Speaker 200:52:50

And people are doing that, right?

Ali Ghodsi00:52:51

Yeah. We're doing that from the early days.

Speaker 200:52:53

80/90.

Ali Ghodsi00:52:53

Yeah. There's other ways to actually also protect, do shadow patching before even actually without touching the existing legacy code. So what's happening is that you can think of it as like it's like a fruit garden. And there are these bugs that attackers are leveraging. They're picking the low-hanging fruits. And before, humans could pick a certain low-hanging fruit. Now agents can reach higher and pick higher hanging fruit. But we're going to clean those up. And then they can maybe reach a little bit higher. But there's only a finite number of vulnerabilities in the code. Once we've secured that code base, there is no more.

So it's not like there's an infinite thing and this is going to go on forever. No, it then stops. Then we're at the steady state. And then vulnerabilities might actually be fewer than what we had in the past.

Speaker 200:53:34

I think that eventually then back to AMP when you went at Berkeley, it's the people in the loop that are the vulnerability. And it's just going to be somebody getting compromised, as we saw the last week or so. The humans do have vulnerabilities. I'll leave it at that. Hey, I want to end on this one thing. You spent a lot of time in Berkeley, Hippie Dippie, EA community, Accelerus, Decelerus. What's the nature of this group of the EA faction and how they look at the world and how confounding they are to the rest of American society?

Who are these people? What do they believe? Are they a little drunk on their own success? Or do they actually have really important insights? And we need to really focus on what they're saying and take them at their word. It's a big controversy. Dario, who joined the roadshow, is saying cancer and Alzheimer's, I believe, will be gone in under 10 years. Now, that's very beautiful to say.

Ali Ghodsi00:54:35

I think otherwise that, right?

Speaker 200:54:36

Yeah. Except if your mom or dad are dying from cancer and you think, oh, I got a window here that I could save them. Or my grandmother's got Alzheimer's. Now you're talking about giving people false hope. And you maybe shouldn't make claims like that. But I don't doubt Dario believes it. I actually think he does. But unpack these people because you've been around them for two decades, three decades.

Ali Ghodsi00:54:55

Well, I think that most people on both sides, actually on all sides, they're the heroes in their own book. We all wake up thinking I'm the good guy and I'm doing the right thing. So I think it comes from a good place. I think they are seriously nervous about this kind of superintelligence taking over. If you read Bo Ström's books, actually, if you read those books and you sort of internalize what he wrote before any of this, then you actually get kind of freaked out. And I was certainly freaked out when I read it. So I think that they're starting with those assumptions.

And then they're looking at, OK, well, then if it's getting smarter this fast and look at the cyber attacks that are happening, dot dot dot, we're going to get this kind of superintelligence that's described in the book. But there's a few dot dot dots there that are not clear. But then they would say, well, look, shouldn't we be cautious? So I think we need to take we should look at safety. Cyber, I think, is a big deal that we should look at. But the reality is that I think we know how to handle this. We will be able to manage through this.

I think the biggest risk right now is cyber. And I think it's manageable. This RSI, I don't see any evidence of it. If there's data that others have that I don't have, yeah, I don't know what I don't know. But based on what I'm talking to here in San Francisco where all the labs are and all the people I meet, I don't see those four criteria that I mentioned even being fulfilled. So I don't see any risk to be worried about that happening. And then the second thing I said, even if we would get there, I don't see even the means in the society.

It's just digital. We can just shut down the computers right now. I do think cyber is real. If a hospital went down and set a refrigerator, that is concerning.

Speaker 200:56:39

Kids using it and developing parasocial relationships with character AI or it giving you bad information if you're suicidal or something. There are concerns to have about how the technology gets deployed. And we just went through this with you mentioned Dunbar's number four. We went through this with social and the profound impact that had on society. We're going through it now with truth and news and manipulation of news via algorithms. So there are things to be concerned about being turned into paper clips, maybe not.

Ali Ghodsi00:57:09

But I think that the health care stuff is absolutely real. At Databricks, we actually we were involved with Regeneron, where they found the actual genome response for chronic liver disease using Databricks, their researchers there, and actually came up with drugs for that.

Speaker 200:57:24

That's a case scenario in under a decade if you were to take the claim we had Dario make. Any chance that we cure cancer in the next 10 years? That's a pretty bold statement.

Ali Ghodsi00:57:34

It's very hard for me to say. I don't know exactly what's needed. I mean, I think progress will be faster. But for a lot of these things, it also has to go through human trials.

Speaker 200:57:43

Human trials.

Ali Ghodsi00:57:44

Well, the human trials, we can't just test stuff on humans willy-nilly. And just because you tested it on animals, it's not enough either. So I don't know. Maybe in 10 years, maybe not in 10 years. Maybe it takes 30 years. Maybe it takes 50 years. I don't know. Maybe it takes six months. Maybe it's already solved more or less. But it is helping already. So the use case I gave you with chronic liver disease, that's super important. By the way, that was the previous generation of AI that we used at Databricks. We trained the new one now with Merck. And it's called TEDDIE, Transformer Enabled Drug Discovery. Transformer Enabled Drug Discovery is a model, Transformer model.

But instead of the next token being English, it's the Gene Regulatory Network, GRN. So it actually can say, OK, this genome is actually causing this disease. This genome is just reacting to it. So don't target it for a drug. So this will accelerate drug discovery. It's a game changer. Drug discovery aside, I give you another example. Crisis Textline, it uses Databricks and uses large language models and these agents. And they actually detect if kids want to do self-harm. And it helps prevent that.

Virtue Foundation uses Databricks. Zipline, this was a use case that was reported before used Databricks to deliver food. They had these drones.

Speaker 200:58:57

Blood drones.

Ali Ghodsi00:58:58

The drones that would deliver everything about those drones and so on, like their path.

Speaker 200:59:04

Oh, really? Big data?

Ali Ghodsi00:59:05

Yeah. All of that was running. So we see these.

Speaker 200:59:07

Great company.

Ali Ghodsi00:59:08

Yeah. We see these use cases all the time with AI. And it is going to make the world a better place. There are risks. We will deal with those as well. People are nervous because things are changing. And I think the AI companies, there's a lot of researchers who maybe they understand the research very well. But they haven't looked at how does the economy look? What's going to happen? How is this thing going to evolve?

Speaker 200:59:27

And they've watched a lot of sci-fi, let's be honest. They are being informed by a certain narrative. And the idea that there's a 10% chance that 7 billion people die because of AI seems so farcical and out there that when you pick a number, it makes you seem credible to an average Joe who's like, well, these are smart people who make a lot of money. And if they think it, maybe they're right.

Ali Ghodsi00:59:50

Yeah. If they're saying it themselves, that's how people think. But for me, that risk is close to zero. I think the cyber risk is real. And really bad things can happen with that. That's why we're focused on it. And then I think actually to solve this context gap that I mentioned in enterprises, the thing we're focused on to actually get value everywhere, I actually think it's going to take 10 years. I think this is something that's going to take 10, 15 years. The labs think this will happen in the next six months, 12 months, in two years.

But I actually think GDP will move very slowly. And it's going to take a decade for us to actually get through it. Why? I mean, as I said, I mean, just go back to the anecdote at the beginning, the CEO of the bank that said, we can't even record the meetings. If you can't record the meetings, the AI doesn't even know what's happening in the meeting. How could it possibly do the kind of things that we discussed when I showed Eugenie and the ontology?

Speaker 201:00:40

It's going to be a paced rollout, to be sure. And there are some of us who are running ahead around the corners doing really cool stuff, which is exactly what we both experienced with the internet. When the internet first came out, the people who were using it to its fullest extent were like, OK, this is going to change everything. And then 99% of people were on dial-up and had never seen a high-speed connection. So their brains couldn't conceive of YouTube or unlimited free photography story. It doesn't make any sense.

Ali Ghodsi01:01:07

Yeah. There was a kid called Robert Morris who took down 10% of the internet with a worm. It's called the Morris Worm. He almost got a jail sentence for it. And then he went on. And he became a famous MIT professor in computer science. And he's like a very famous guy. But that took down a whole 10% of the internet back in the day.

Speaker 201:01:26

Which is completely possible. At some point, so today, somebody feels like they may have cracked signal to a certain extent. OK, sure. Let's see what happens. All right, everybody. Another great all-in interview. Ali, thank you so much for your time. And we'll see you next time on the all-in interview.

Ali Ghodsi01:01:43

Thank you so much.

Speaker 201:01:44

Great job, Ali. You were awesome.

Episode description

(0:00) Ali Ghodsi joins the show: Databricks' early bets on cloud, AI, and open source

(8:50) Is AGI Already Here? Why Enterprise AI Is Falling Behind

(22:04) Live Demo: How Databricks Uses Agentic AI For Efficiency

(38:25) Databricks IPO: The Case for Staying Private

(44:02) RSI, Cyber Risk & the Doom Debate

 

Thanks to our partner for making this possible:

 

Airwallex is a leading global payments and financial platform for modern businesses,

offering trusted solutions to manage everything from business accounts, payments,

treasury, and spend management to embedded finance. Learn more at https://airwallex.com/allin

 

Follow Ali:

https://x.com/@alighodsi

 

Follow the besties: 

https://x.com/chamath

https://x.com/Jason

https://x.com/DavidSacks

https://x.com/friedberg

 

Follow on X:

https://x.com/theallinpod

 

Follow on Instagram:

https://www.instagram.com/theallinpod

 

Follow on TikTok:

https://www.tiktok.com/@allin

 

Follow on LinkedIn: 

https://www.linkedin.com/company/allinpod

 

Intro Music Credit:

https://rb.gy/tppkzl

https://x.com/yung_spielburg

 

Intro Video Credit:

https://x.com/TheZachEffect

 

#allin #tech #news