Full Transcript

·YouTLDR

Ex-Google Insider Reveals The Future Of AI in 2026...

28:41EnglishBy Inside the Silicon Mind with Firas SozanTranscribed Jul 15, 2026
Analyze another video with Pro30-day money-back guarantee
0:00

You said PhD in your pocket. What did

0:02

you mean by that? [music]

0:03

>> You'll have a system in your pocket that

0:05

you won't pay a subscription for. You'll

0:07

have the smartest system ever built that

0:10

represents hundreds, thousands of years

0:12

of human experience and knowledge in

0:14

your pocket. It's never going to go

0:15

offline. It's never going to get stupid.

0:17

It's going to have a better memory of

0:18

exactly what you like or don't like.

0:19

Every person's going to own their own

0:21

intelligence. And as long as you charge

0:22

your phone, you'll have that PhD in your

0:24

pocket. for the AI models coming out of

0:26

Chat GPT, OpenAI, Anthropic, what does

0:28

that mean for them financially?

0:30

>> I think what we're going to see is a

0:31

much more diverse explosion of models

0:34

and applications that people own and run

0:37

themselves. [music] And right now, it's

0:38

really just hackers that are doing this,

0:40

but in the near future, we're going to

0:41

see everyone's going to have the [music]

0:42

ability to have something downloaded

0:44

that they own and run. You can see

0:46

Anthropic actually making like this

0:48

[music] desperate attempt to cover

0:50

everything. They do design, chat,

0:52

coding, now they're doing private equity

0:54

stuff. They're doing marketing. They're

0:55

doing legal. Can they win that all?

0:57

There's actually just so much surface

0:59

area. I find it difficult to believe.

1:00

>> Apple and Amazon seem to have just gone

1:03

into a different path. You don't really

1:05

see or at least hear of a lot of action

1:07

there. What What's your thoughts on

1:09

that?

1:09

>> We're super excited about what they're

1:11

doing and they have been a slow mover

1:13

and said, you know, we're not going to

1:14

build our own model. It's not really

1:15

what we do. But they see this wave

1:17

coming too of why shouldn't we have a

1:20

PhD in your pocket [music] for every

1:21

Apple user? Why shouldn't one live on

1:24

your laptop and live on your iPhone and

1:26

live on your Mac Mini which is already

1:28

happening right? They have really

1:30

committed to ondevice AI that their

1:32

customers will own which really fits

1:34

into their mantra of privacy and

1:36

ownership and fully vertical

1:38

infrastructure and [music] I think the

1:40

story by the end of the year will be

1:41

Apple has emerged as one of the clear AI

1:44

winners because of that. Jack, we are

1:47

approaching a world where most people no

1:49

longer need open AI level models for the

1:52

things they actually do. Would you say

1:54

that's true?

1:55

>> Yeah, absolutely. It didn't seem like we

1:57

would get there till the end of 2026,

1:59

but we are essentially already there.

2:01

>> What does that mean? Because I think for

2:04

a lot of our viewers and our listeners,

2:06

u majority being founders, investors,

2:09

engineers, but for the nontechnical

2:12

folks, what does that mean for them?

2:13

Yeah, I think if you look at Anthropic's

2:16

last few releases, Opus 46, Opus 47,

2:19

they're incredible models. They're

2:21

they're really really powerful and they

2:23

keep emphasizing these are really

2:25

effective at the most difficult

2:27

challenges. They're really great at the

2:29

most difficult challenges. They're

2:30

pushing the frontier on there's this

2:32

extremely difficult thing and we can

2:34

actually do something that was never

2:35

been done before. But what's been

2:36

catching up behind them is the open

2:38

source models that are really good at

2:41

yes less difficult problems, but that's

2:43

becoming a bigger and bigger problem

2:45

space of what they can solve. So kind of

2:47

big open- source models are already

2:50

really good at the things that most

2:53

people use chatbots for today.

2:54

Definitely holding a conversation, doing

2:56

research. They're really good at coding

2:58

now almost frontier level with Opus and

3:01

from Claude and OpenAI. Most of the

3:04

valuable work that you do using language

3:06

models on a day-to-day basis can be done

3:08

by open models already today. And then

3:11

the thing that's amazing to us, these

3:13

newest releases of smaller language

3:14

models, specifically some of the Quen

3:16

models that have come out recently are

3:18

as good as the frontier big models.

3:21

Think from from OpenAI and and Claude

3:24

and the big open source models. Now you

3:26

have tiny models that can fit on your

3:28

laptop, potentially even on your phone

3:30

that can do that kind of frontier level

3:31

work. We already have that already. They

3:33

might not be good at the most difficult

3:35

challenges, but the reality is most of

3:36

the work you do on a day-to-day basis

3:38

isn't the most difficult work.

3:40

>> For someone who's not technical, who's

3:42

not in the industry like you and I am,

3:44

and perhaps is a teacher, what would be

3:47

a example of an open source model and

3:51

one that they could have on their phone

3:52

or their laptop and what can they do

3:54

with it?

3:54

>> Yeah, absolutely. My my sister's a fifth

3:57

grade teacher, so I I've talked to her

3:59

about this a little bit. If you use chat

4:00

GBPT to let's say you are a teacher,

4:03

you're create lesson plans, you ask it

4:05

for questions, help revise or give

4:07

feedback to to students or their

4:08

parents, any of that work can be done

4:10

for much cheaper using an open source

4:12

model. And there's really two ways to

4:14

use [music] it. You know, number one,

4:15

these all have kind of competing chat

4:17

bots to OpenAI or cloud. [music] And

4:20

what's getting better and better is you

4:22

can download essentially a really big

4:25

file onto your computer that contains

4:27

the actual model that you can then run

4:29

and chat with yourself. And then instead

4:31

of paying a a monthly subscription, you

4:33

really you own your own intelligence.

4:34

It's never going to go offline. It's

4:36

never going to get stupider. It's going

4:37

to have a better memory of exactly what

4:38

you like or don't like. And it's going

4:40

to live on your laptop as long as that

4:42

laptop has power. That's incredible. You

4:44

know, you think about technology and how

4:46

it's evolved from the internet. It was

4:49

very expensive. It was dialup and then

4:51

broadband came along and now it's

4:52

getting cheaper and cheaper and almost

4:54

internet is becoming an essential asset.

4:57

You need to have cloud you know storage

4:59

was expensive with onrem then cloud

5:01

comes along and then you look at mobiles

5:03

they're getting cheaper and cheaper and

5:04

cheaper. I don't even upgrade my phone

5:06

anymore. I think I have an old iPhone.

5:07

The question is, is that what you are

5:09

basically stating here that AI is going

5:12

to play in a very similar field where

5:13

maybe free models completely open source

5:16

models will I think you mentioned this

5:17

to me in our calls. You said it the

5:19

small models can do 95% of economically

5:23

valuable AI work.

5:24

>> Yeah, I think that's right. I think

5:26

we're already there and the model is

5:28

probably the most important part of this

5:30

entire ecosystem. what's actually what

5:32

powers the intelligence at the other end

5:34

of the line when you're you're doing a

5:35

chat or you're doing some sort of work.

5:37

The small models are really smart and

5:38

they're only going to get better from

5:40

here. And the question is, okay, so as

5:42

the frontier models push out, they

5:44

continue to do things that no one else

5:45

can do. They do frontier AI research.

5:48

They do research in physical sciences or

5:50

or biology that's never been done.

5:52

That's going to be extremely valuable

5:54

for this Frontier Labs. But the open

5:56

source models are going to do what most

5:58

people care about. Think software

5:59

engineers, think teachers, doctors,

6:02

people who are, you know, working with

6:04

computers every day, doing research,

6:06

doing sales, that kind of work. The

6:08

models are already smart enough, ones

6:09

that can fit on your laptop. And uh I

6:11

think, you know, there there's basically

6:13

two directions then where the Frontier

6:14

Labs are going to continue to to push

6:16

the envelope. They're [music] going to

6:17

do that work that no one's ever done

6:19

before. What you've probably seen in the

6:21

headlines is they're really starting to

6:22

build out apps to use their models. So

6:25

they've said, "Okay, we actually

6:27

realized that this model revolution is

6:29

coming. People can own their own

6:30

intelligence. They won't need to come

6:32

through us." So what have they done?

6:33

They've built these frankly incredible

6:35

number of products that you can interact

6:37

with them. Think Claude code and claude

6:40

design and claude co-work and and claude

6:42

chat and then you have codeex and and

6:44

chatbt and those things. And the

6:46

question will be, you know, do you want

6:47

to pay a monthly subscription to use one

6:49

of those products or do you want to own

6:51

your own intelligence on your laptop or

6:53

wherever it is? Is it like AI is going

6:56

to become like electricity? We don't

6:58

really care where it comes from. It just

7:00

generates and we use it in some ways

7:02

yes, in some ways no. I think the

7:03

threshold that we've been going after is

7:06

uh like can it do a given task? And once

7:08

you reach the point of okay, it can do

7:10

this task, then you start to care about

7:12

other things. How well does it know me?

7:15

How well can I rely on it as it

7:16

completes a number of tasks in

7:19

succession? You know, what's its

7:20

personality? How quick is it? How much

7:22

does it cost? Once you pass that

7:23

accuracy threshold, those other

7:25

questions come into play a lot more.

7:27

What we really focus on specifically is

7:28

is a couple of those. We want your AI to

7:31

be really fast. We want it to be really

7:32

accurate even as it encounters a lot of

7:34

data over a really long period of time.

7:36

That's really what, you know, my company

7:38

Subconscious does specifically on top of

7:40

open models. And um, you know, I've

7:42

talked to some companies who really

7:44

think that personality is going to be

7:45

the differentiator that think that, you

7:47

know, its ability to understand certain

7:49

types of data. think a model for doctors

7:52

versus uh biioarma versus software

7:55

engineers. Um but they will there will

7:57

probably be some distinctions between

7:59

those. One of the I guess realizations

8:01

I've seen in the market now is AI has in

8:04

many ways removed this uh protective

8:07

layer for a lot of industries like

8:09

management consultancies even doctors

8:12

lawyers where they're charging extremely

8:13

high fees or maybe inadequate in their

8:15

services. AI is becoming that adequate

8:18

solution. We're taking things even

8:19

further, talking about AI becoming

8:21

effectively free with open source. What

8:23

does that mean for the professions that

8:25

have notoriously always been very

8:27

expensive? Thinking lawyers, doctors,

8:29

architects, what happens there?

8:32

>> Yeah, it's it's a difficult question to

8:33

to figure out [music] cuz in any time

8:36

frame that's reasonable over the next

8:38

couple years, as smart as the models

8:39

will be, there's not enough trust built

8:41

up to put all of your faith into these

8:43

models. Do I really want to trust a

8:45

model versus talking to an actual

8:47

doctor? If I'm building a house for the

8:49

first time, do I really want an AI

8:51

system to do that instead of actually

8:53

hiring an architect who's done that tons

8:55

of times? Uh, if I have a very

8:57

important, you know, I'm on trial or I'm

9:00

raising money for my company, do I

9:02

really want to not talk to an actual

9:03

lawyer at any point? Probably not. But

9:05

they are smart enough to do a lot of

9:08

that work. We'll probably see that

9:09

shift, but not in the immediate short

9:11

term. I think what I'm noticing at least

9:13

and I agree with you. I don't think it's

9:15

something where you're completely not

9:17

going to use a lawyer or a doctor or an

9:19

architect, but I I feel there's maybe

9:22

some elements of some industries and

9:24

sectors where sort of the cost the unit

9:26

cost of that service is so high pre AI.

9:30

Now with AI, they can really focus on

9:32

the higher level work where purpose is

9:34

worth paying for a lawyer. If that makes

9:36

sense.

9:37

>> I think so. And I I think like it it

9:39

makes it much easier on their end to do

9:41

a lot more meaningful work potentially

9:43

billing less hours and then on our end

9:45

you know we can go into those

9:46

conversations with a lawyer you know

9:48

with an architect with a doctor and use

9:50

their time better also. So I think it'll

9:52

come from both sides but we'll still

9:54

need human expertise at least in any

9:56

time scale that probably matters for our

9:58

lives.

9:58

>> I think you know the mobile and the

10:00

internet was a very transformational

10:02

piece of technology that has transcended

10:04

everywhere. I think for a lot of people

10:06

they don't quite realize what cloud does

10:07

and unless you know what cloud does

10:09

because you use it but you know if

10:10

you're in the industry but for mobile

10:12

and for internet you don't have to be in

10:14

tech to to have used it. I think with AI

10:16

I just think about how fast it's

10:18

changing on a weekly or on a bi-weekly

10:21

basis. The technology is exponential.

10:24

Yeah. Yeah. The question I have for you,

10:25

Jack, is when you look back at the last

10:27

6 months, just in the last 6 months,

10:29

maybe the last 3 months, has there been

10:30

a moment for you where you thought,

10:32

okay, I did not expect AI to be where it

10:34

is now at this rate?

10:36

>> Yeah. Yeah. Absolutely. There was a

10:38

moment when really the Quen 3.5 open-

10:42

source models came out and and Quen is a

10:45

series of open source models from

10:46

Alibaba, uh, Chinese company where I

10:48

would say a step-wise change in what

10:50

open models can actually do. And then a

10:53

couple weeks later they upgraded and

10:54

said one of these we're actually going

10:55

to upgrade to version 3.6 and that's

10:58

this version that is a 27 billion

11:00

parameter model. To put into your mind

11:02

27 billion that's a pretty big model but

11:05

it can fit on your laptop if you use the

11:06

right techniques. Something that runs in

11:08

the cloud that you use behind chatpt or

11:10

claude is trillions of parameters. So so

11:13

100 times you know bigger some somewhere

11:15

in that range. And we have a model that

11:17

is 100 times smaller and is as good as

11:19

those that live in the cloud. And I'd

11:21

been talking to my my co-founder about

11:23

this and we said that'll probably happen

11:24

sometime maybe December of this year.

11:26

That's roughly what the trend line looks

11:28

like. It happened in March and I think

11:31

we're going to keep seeing acceleration

11:32

that's as quick in that direction. It's

11:34

it's pretty impossible to not believe

11:36

that these things are going to get small

11:38

enough to to really live on your

11:40

computers to live on your laptops

11:42

potentially even your phones um in the

11:44

very near future. So we were just

11:46

surprised about how quickly intelligence

11:48

got compressed.

11:49

>> That's impressive. Jack, you used the

11:51

phrase on our previous call. You said

11:53

PhD in your pocket. What did you mean by

11:55

that?

11:56

>> Yeah. You think what is really the

11:57

benefit of [music] these models getting

11:59

so small and so fast and it really comes

12:01

down to you'll have a system in your

12:03

pocket that you won't pay a subscription

12:05

for that as long as you charge your

12:06

phone, you'll have the smartest system

12:09

ever built that represents hundreds,

12:11

thousands of years of of human

12:13

experience and knowledge in your pocket

12:15

to do whatever you need. Whether you

12:16

need to ask it questions, you know, help

12:19

plan or coordinate events, do research,

12:22

maybe you wanted to do coding, whatever

12:24

you want it to do, you'll have that

12:25

capability. You know, today it's already

12:27

in your pocket. You can download the

12:28

Chat GBT app and use it. But what I'm

12:30

talking about is something that will

12:31

really you'll own that someone else

12:33

can't turn off. That's not going to get

12:36

stupider because ChatGpt is it has too

12:38

many people using it and they're going

12:40

to kick you off for the day. You'll have

12:41

something that's that's really yours and

12:43

lives in your pocket and understands

12:44

you. [music] And as long as you charge

12:46

your phone, you'll have that, you know,

12:48

PhD in your pocket.

12:49

>> From a, I guess, evaluation perspective

12:52

for the value of these companies, even

12:54

the ones that are providing the GPUs

12:56

like Nvidia, maybe less [music] them,

12:58

but for the AI models coming out of Chat

13:00

GPT, OpenAI, Anthropic, what does that

13:02

mean for them financially?

13:04

>> I honestly think their valuations are

13:05

justified. I think that the narrative

13:07

though isn't quite right where there

13:09

won't be these two dominant forces that

13:12

that battle for Anthropic wins the

13:14

enterprise and chat GBT wins all of the

13:16

consumer usage. I think what we're going

13:18

to see is a much more diverse explosion

13:21

of of models and applications that

13:23

people own and and run themselves. And

13:26

right now it's really just hackers that

13:27

are doing this. People who are are

13:29

tinkering enough and have the the strong

13:31

enough computers to to get that frontier

13:33

intelligence on their own devices. But

13:35

in the near future, we're going to see

13:36

everyone's going to have the ability to

13:38

have something downloaded that they own

13:41

um and run. I think it's going to have a

13:42

lot of implications for what consumer AI

13:45

looks like, what an individual asking

13:48

questions, planning their life, asking

13:50

for advice, doing work, both school work

13:52

and and kind of business employed work

13:54

means. But for businesses, I think

13:56

there'll always be a need for some sort

13:57

of cloud offering. There are certain

13:59

things that you want to run for really

14:01

long periods of time are going to need

14:02

that kind of frontier power, but they

14:04

might need smaller compute footprints

14:06

than we think. But at the end of the

14:07

day, my my overall take is we're just

14:09

scratching the surface of how useful

14:11

these systems can be. They're only

14:13

getting smarter. You know, the trend

14:14

lines aren't showing any signs of

14:16

stopping. Personally, it's just made my

14:19

work life really productive. And there's

14:21

a couple things, you know, here and

14:22

there that I use in my personal life

14:23

that I think is is really fun that that

14:26

AI has brought to the world. There was a

14:27

thing that I kept asking about two years

14:29

ago. Who's going to own the application

14:31

layer? Who's going to be the big players

14:33

in AI? We've got some incumbents here.

14:35

We've got some companies here that are

14:36

doing exceptional work like Anthropic,

14:39

like OpenAI. But in your opinion, who do

14:40

you think, if any, is the jury still out

14:43

on who the winners are in AI? You know,

14:45

I think it's it's pretty clear that

14:47

Anthropic, OpenAI, probably Google also,

14:50

they'll have models that do things that

14:52

no one else can do, and they have the

14:53

comput.

14:55

they have the research scientists in

14:57

order to to train the models. They're

14:58

going to push the bounds of what we

15:00

thought was possible with AI. When it

15:02

comes to, like I said, 95% of consumer

15:04

AI use cases, there's going to be this

15:07

explosion of what what models uh can do.

15:10

And there's just a number of open source

15:11

models are out there. So, the the cat's

15:13

out of the bag and what's powering any

15:16

given app is is totally up for grabs.

15:19

Um, I think what the surface looks like,

15:21

like how does someone actually interact

15:22

with that is also pretty up for grabs.

15:25

Uh, you can see Anthropic actually

15:27

making like this desperate attempt to

15:29

cover everything. I mean, they do

15:31

literally like design, chat, coding now.

15:33

They're doing private equity stuff.

15:35

They're doing like marketing. They're

15:36

doing legal. Can they win that all?

15:39

Maybe. But there's actually just so much

15:41

surface area. I find it difficult to

15:42

believe. And then when you come down to

15:44

individuals who are using chat bots,

15:46

there's some value to having built up a

15:49

lot of context within a given app that

15:52

the first one you use for a long period

15:54

of time, you're probably going to use

15:55

for a long time. But I think we're we're

15:57

really just starting to see these things

15:58

like really penetrate into people's

16:00

lives. And it feels like the playing

16:02

field is still open.

16:03

>> Somewhat of a sticky piece of software,

16:05

but let's say you're using it personally

16:06

and it's on your phone and as you said,

16:08

you you can use it personally for a

16:10

number of different use cases. you're

16:12

teaching it constantly who you are, what

16:14

you like, what you had for dieting or

16:16

for exercising or your health or

16:19

hobbies. And it's interesting to think

16:22

how sticky these technologies are

16:23

because I know you can migrate it over

16:25

to a different model, but you kind of

16:27

become attached to it because it knows

16:28

you. And it's interesting also that you

16:30

say anthropic open AI in Google because

16:32

I I recently had uh Andrew Dy who is a

16:35

founder of a new company called Allorean

16:37

that just raised 50 million and Andrew

16:39

was in the research lab at Google Brain.

16:42

He worked with the founders of OpenAI

16:44

Anthropic and the entire topic that we

16:47

really touched on during the podcast was

16:49

all about the culture of that particular

16:51

team and how they became I think at the

16:54

end I said it was the Google mafia

16:55

similar to the Vay Palmer. It's really

16:57

fascinating to see this new shift

17:00

happening. But if you were to pick a

17:01

player and then think about this as far

17:04

as like let's use the cloud era with AWS

17:06

and GCP and and Microsoft Azure. Where

17:09

do you think Anthropic is OpenAI and

17:12

Google if you were to sort of look at

17:15

them in comparison to the cloud as we

17:17

are right now? You know, we're we're

17:18

recording this in May 26, so this will

17:20

probably go out towards the end of this

17:22

month, but as of this moment right now,

17:23

who do you say is the biggest players?

17:25

The biggest out of the three? I'll I'll

17:27

go from first of all our preferences as

17:29

a team. We use a lot of the anthropic

17:31

models ourselves. Like as our models

17:33

have gotten better, um we're trying to

17:35

use more of our own. But but we really

17:37

like anthropic and for a number of

17:38

reasons. I think number one, their

17:40

models seem to outperform the others.

17:41

Number two, they've really just

17:43

completely dominated the mind share

17:45

among developers. Um everything from

17:47

cloud code to they develop the MCP. Um

17:50

they developed all of these tools. Uh

17:52

they developed skills. um different

17:54

things that developers all over the

17:56

world use now whether you're using

17:58

Anthropic or not and then they just

18:00

seems like they continue to dominate the

18:01

news cycle with with constant releases.

18:04

So I would say they are likely number

18:05

one. Number two I would actually say

18:07

right now is Google. I'm I'm an ex

18:09

Googleler myself. I worked at Google for

18:10

a number of years um on their on their

18:12

search team. I just think they've done

18:14

they've done a really excellent job.

18:15

Their their Gemini models are really

18:17

strong. They're very friendly to to

18:19

working with developers and and new

18:21

companies. their notebook LLM product is

18:23

is pretty great and they've continued to

18:25

come across as like a very good you know

18:28

respected player in the space. Um and

18:30

then third I'd say is is JGBT and anth

18:33

and open AI. You know they obviously

18:35

came in first um but our take has been

18:37

that their their models are less

18:38

reliable for these agentic tasks uh that

18:41

we're really building our systems around

18:43

it. It was just less reliable

18:44

infrastructure for us and it seems like

18:46

they are they are dropping in their mind

18:48

share. I think we have a a big trial

18:50

ending in about two weeks that's going

18:51

to really reveal where they sit. So,

18:53

I'll leave it there.

18:54

>> We just internally just shifted away

18:56

from OpenAI over to anthropic and we use

19:00

both Anthropic and um and perplexity as

19:03

well, which we find computers quite

19:04

good. One more question I want to ask

19:06

before we dive into talking about where

19:08

you are right now, what you're building

19:10

as a founder of a company. I'd love to

19:12

tap into that. But the last question I

19:14

want to really dive into as far and

19:16

unpack as far as this topic of the big

19:18

players is there are two other big tech

19:21

companies that seem to have just lost

19:23

their way when it comes to this new

19:25

evolution, this new wave of AI. One

19:27

being, and I could be completely wrong,

19:29

I'm looking at Microsoft. I'm thinking

19:30

Microsoft made a massive investment to

19:32

open AAI. That was kind of their play.

19:34

But Apple and Amazon seem to have just

19:37

gone into a different path. you don't

19:39

really see or at least hear of a lot of

19:42

action there. What What's your thoughts

19:44

on that?

19:44

>> Oh man, I I think that's going to be an

19:46

outdated take pretty soon. Amazon, first

19:49

of all, they own a lot of the GPUs. They

19:51

have these, you know, big deals with

19:52

Anthropic and a lot of teams that we

19:55

talked to are using Anthropic through

19:57

their Amazon Bedrock accounts. They're

20:00

running them on, you know, Amazon GPUs.

20:02

I think their massive cloud footprint

20:04

isn't going anywhere.

20:06

>> Well, that's the thing. I think I think

20:07

a lot of this is around branding and

20:09

marketing and how what is known in the

20:11

market, right?

20:12

>> But but they've become, you know,

20:13

Switzerland in a way because of that and

20:16

they're just benefiting from you might

20:18

have the best model in the world, but

20:19

you got to have the GPUs and the

20:20

infrastructure to run it. And on top of

20:22

that too, as it gets cheaper and cheaper

20:24

to run a language model and do this

20:26

agentic work, the the compute

20:28

surrounding it gets more important. How

20:30

do you call tools? How do you access

20:31

data? How do you do the things that AWS

20:33

does really well? On the other side,

20:34

I'll say Apple, too. We're we're super

20:37

excited about what they're doing. Um,

20:39

and they have been a slow mover and

20:41

said, you know, we're not going to build

20:42

our own model. It's not really what we

20:44

do. But they see this wave coming too of

20:47

why shouldn't we have a PhD in your

20:49

pocket for every Apple user? Why

20:51

shouldn't one live on your laptop and

20:53

live on your iPhone and live on your Mac

20:55

Mini, which is already happening, right?

20:58

>> Interesting. Um and they have really

21:00

committed to ondevice AI that their

21:02

customers will own which really fits

21:04

into their mantra of privacy and

21:07

ownership and [music] fully uh you know

21:09

vertical infrastructure for whatever end

21:12

experience they're giving to their users

21:14

and I think the story by the end of the

21:15

year will be Apple has emerged as one of

21:18

the clear AI winners because of that.

21:20

>> Wow. Okay. Well, we'll do a second

21:23

episode in person and talk about that.

21:25

[laughter]

21:25

>> Yeah,

21:26

>> Jack, let's move on. This was really

21:27

fascinating. Let's move on to where you

21:29

are today. I'd love to get to know your

21:30

business a little bit more and

21:32

understand what is it you're building

21:34

today. What is the problem statement?

21:36

Start off there. What is the problem

21:37

statement that you're solving? We

21:39

basically ourselves heard a lot of the

21:42

hype around building uh AI agents but

21:45

really struggled to actually build

21:47

agents ourselves and we think it was

21:49

because the tooling that was built

21:51

around AI was really built for chat bots

21:53

um and not specifically for agentic

21:56

systems. So what we do as a company is

21:58

we take open source models, we retrain

22:01

them to think in terms of these longer

22:04

running workloads and then we run them

22:05

on top of our own infrastructure that's

22:07

that's very very efficient. What that

22:09

amounts to is we offer a series of

22:12

language models to customers that are

22:15

more accurate especially on longunning

22:17

complex tasks and much much cheaper to

22:20

run and then can run at really any scale

22:23

anything from data center scale all the

22:24

way down to you know the devices that

22:26

we're talking on right now. So this wave

22:28

has been really exciting for us because

22:29

what we can do is we can take a language

22:31

an open source language model that's

22:32

already really great. You know, maybe it

22:34

can live on your computer and be that

22:36

replace your chatbt subscription because

22:38

it's as good a chatbot as anything else

22:40

in the world, but we can post train it,

22:42

run it on top of our own way that we

22:44

would serve up the model to you in a way

22:47

that it can solve long context problems,

22:49

things like, [music] you know, deep

22:50

research and coding and interacting with

22:54

your browser. Things that today only the

22:56

best most frontier models can do. We

22:58

allow uh smaller language models to do

23:01

that uh at any scale. It's very

23:03

fascinating. I'm just wondering when you

23:05

thought about this being a area of

23:07

interest, what was that epiphany or

23:10

moment where you realized this is an

23:11

interesting area to go after?

23:13

>> We really started the company around how

23:14

do we build agents that can reason over

23:16

long context, not lose the thread and

23:18

solve these these longer, more

23:20

challenging tasks. And our process to do

23:22

that as a small company with limited

23:23

resources is let's actually prove this

23:25

out with small language models and then

23:27

we'll show what we've done. we'll go

23:29

raise more money and then we'll be able

23:31

to do it with big language models which

23:33

take a lot of time and resources to to

23:35

retrain and run. And through that

23:36

process, we started working on these

23:38

smaller language models and we hit some

23:40

of our stretch benchmarks for much later

23:44

uh trainings of much more bigger bigger

23:46

and powerful models. And we thought like

23:48

oh my god the tech is already here. uh

23:50

what we've just done is actually you

23:52

know proven this at a small scale but

23:54

proven it in such a way that it actually

23:56

makes these small language models act

23:58

like the biggest and baddest AI models

24:01

that are out there and so that's really

24:02

led us down this path of okay it's very

24:04

clear to us every person's going to own

24:06

their own intelligence companies

24:08

businesses around the world are going to

24:10

have the opportunity to have you know

24:11

their entire workforce have these agents

24:14

on their computers live in workstations

24:16

in their office so that data doesn't

24:18

have to leave the floor let alone the

24:20

the company. And then there's a bunch of

24:22

implications for consumers too, you

24:24

know, as can is this something that you

24:26

can reasonably download with an iPhone

24:27

app and and live on your phone. That's

24:29

what we're we're more selling to

24:31

businesses now, but we just see the the

24:32

world opening up in front of us.

24:34

>> What would you say the TAM is for your

24:36

company for a market like this?

24:37

>> There's kind of two markets that we sell

24:39

into right now. Number one is we sell

24:41

inference uh to companies via some cloud

24:43

providers and we're able to offer

24:45

Frontier Performance at a much much

24:48

lower cost. Uh we're doing that with a

24:50

number of customers now. We think that

24:52

market is pretty pretty massive. Hard to

24:54

put a number on it, but there's there's

24:55

been tens of billions of dollars spent

24:57

on AI inference in the past year.

24:59

Probably more spent in the last 5 months

25:01

than at all of 2025. That is a clear

25:04

large and and and growing market. The

25:07

other thing that we've been doing is

25:08

working directly with some hardware

25:10

companies to ship our models on device.

25:12

So if you buy a not yet disclosed uh

25:15

workstation, it will have our our

25:16

subconscious models embedded on the

25:18

system. That is a small market today,

25:20

but we think it's going to grow to be

25:22

something that's that's very meaningful.

25:24

>> Why did you call it subconscious?

25:25

>> We wanted it to represent doing work on

25:28

your behalf in the background. And we

25:30

think that it really just captures the

25:32

essence of what we do. And even as we've

25:34

refined how our system works under the

25:36

hood, it reflects it even better because

25:38

really what we're doing is over long

25:41

long reasoning chains, we are as the

25:43

model is deciding what words, what

25:45

tokens to share next, we are doing some

25:47

compression of of the previous

25:50

information that's encountered,

25:52

specifically information that's no

25:53

longer relevant. And what that

25:55

information does is it compresses it and

25:57

it still sits in its memory but in kind

25:59

of a latent space that doesn't have full

26:01

context of all of the data around it.

26:04

And so in the model's perspective, you

26:06

know, we we we stuff that in its

26:07

subconscious. So it's still aware of

26:09

everything that it's encountered, but

26:10

maybe not every exact detail, but enough

26:12

to complete whatever task over these

26:14

really long periods of time. Kind of

26:16

number one, models working in the

26:17

background. Number two, it actually

26:19

really reflects what we do under the

26:20

hood.

26:21

>> Love it. It's been a pleasure having you

26:22

on the show. You and I talked about

26:24

doing this and the thing that stuck out

26:25

for me is this whole idea as you said of

26:28

open source and AI and smaller models.

26:32

The number 95% really struck out. The

26:34

fact that you said 95% of what is

26:37

effectively we need to do could be done

26:39

by smaller models. It really is

26:41

interesting. Jake, just want to wrap up

26:43

with one final question uh which is a

26:45

book recommendation. Yeah, I'd love to

26:47

hear yours. You know what what would be

26:49

a book that you'd recommend to our

26:50

audience? God, maybe my favorite book of

26:53

all time is uh in the three body problem

26:56

series. Uh the second book which is

26:58

called uh The Dark Forest. So so good.

27:03

It's a uh kind of fate of the world. Um

27:06

I don't know how to really explain it

27:08

without explaining the book, but I would

27:09

say the first book in the series is

27:10

seven out of 10. The second book, which

27:12

I'm recommending, is a 10 out of 10, and

27:14

the third is a nine out of 10.

27:16

>> Uh my co-founder is from China. The book

27:18

was originally actually written in

27:19

Chinese, translated to English. And we'd

27:21

worked together for a year and a half

27:23

and we finally put that together a

27:24

couple weeks ago that we both love these

27:26

books.

27:27

>> Really, really incredible.

27:30

>> Definitely worth, you know.

27:31

>> Yeah.

27:31

>> Yeah. Well, nice timing for this uh for

27:33

this podcast. Thank you so much for the

27:35

recommendation. Thank you for your time.

27:36

Yeah. I wish you all the best of luck.

27:37

It's it's really interesting the area

27:39

that you're tackling. It's it's a very

27:41

important topic, which is why I wanted

27:43

to do this. And when you talk about such

27:45

large numbers in terms of the impact on

27:48

what this really looks like going

27:50

forward, AI in your pocket, I love the

27:52

phrase you used. It's like having a PhD

27:54

in your pocket. Um

27:56

>> yeah, I I think it's something that it's

27:58

percolated through the hackers and the

28:00

people really on the edge real like, oh

28:02

my god, this is amazing. And it will be,

28:05

you know, top tier news in the next

28:07

couple months. And I think there'll be

28:08

talks of, okay, what does this mean for

28:09

OpenAI anthropic like what you're

28:11

asking? I think they will still have a

28:12

business, but I think it's going to open

28:14

up a whole new world of possibilities,

28:15

and that's what we're really excited to

28:17

to play in that arena.

28:18

>> Amazing, Jack. It was a pleasure. Thank

28:20

you so much for being on the show.

28:21

>> Yeah, thanks a lot.

28:23

>> Thanks for tuning in to another episode

28:24

of Inside the Silicon Mind. This podcast

28:27

is powered by Harrison Clark. For more

28:29

episodes, don't forget to subscribe and

28:32

hit that notification bell. As always,

28:34

stay curious, stay consistent, and stay

28:37

inside the Silicon Mind.

Continue with YouTLDR

Analyze another video with Pro

Process a new video, search every timestamp, compare sources, and keep the result in your library.

Get Pro — $12/month30-day money-back guarantee

More transcripts

Explore other videos transcribed with YouTLDR.