×
Evaluate Your Team's AI Readiness

Take our official assessment and explore training paths to build secure, compliant AI workflows.

Access Portal

AI at Work Podcast

Ep #2 OpenAI Just Nerfed Your Lawyer & Doctor Bot – What Actually Changed (and What Still Works)

AI at Work, AI Fundamentals

Audio episode

Listen to this episode

Summary

The conversation explores the evolution of process automation, detailing the transition from manual methods to the implementation of custom GPT tools that streamline workflows. It highlights the phases of development, from initial disorganized documentation to fully automated systems that require no human intervention.

Takeaways

Phase one was a sloppy Google document.

Phase two is building this custom GPT.

A third party can handle processes with this tool.

There’s still some copying and pasting involved.

Phase three involves full automation.

We could put it on a cron for scheduling.

Automation fetches information from Google docs.

APIs can be used to get transcripts automatically.

Everything is just there with no human interaction.

The evolution of these phases enhances productivity.

Chapters

00:00 Evolution of Process Automation

00:32 From Manual to Automated Workflows

 

 

 

Explore practical AI implementation: https://assessment.ascendlabs.ai/

Book a conversation with Kevin: tidycal.com/kevinwilliams

Show Notes & Links: https://www.spark6.com/podcast

Submit listener questions:

[email protected]

[email protected]

Check out Kevin’s stuff:

AscendAI: https://ascendlabs.ai/

Follow Kevin on LinkedIn: https://www.linkedin.com/in/kevinguywilliams/

Check out Eli’s Stuff:

SPARK6 Agency: https://www.spark6.com/

Sign up for FREE AI Framework Friday Newsletter: https://www.spark6.com/newsletter

Follow Elijah on LinkedIn: https://www.linkedin.com/in/elijahszasz/

Transcript and citation details

Transcript

00:00 Play from here Welcome to AI at Work.

00:06 Play from here I'm Elijah Saas.

00:07 Play from here I'm a serial entrepreneur with 28 years of experience in tech, and today I run an agency

00:12 Play from here that builds AI solutions.

00:13 Play from here Hey, I'm Kevin Williams.

00:15 Play from here I spend most of my time helping companies figure out how to actually use AI, not in

00:20 Play from here theory, but in the work itself.

00:28 Play from here What's up, Kevin?

00:29 Play from here How's it going, bud?

00:30 Play from here I'm doing great.

00:31 Play from here How about you, Eli?

00:32 Play from here I'm doing good.

00:33 Play from here How was your Halloween weekend?

00:34 Play from here Let's start with that.

00:35 Play from here What AI character did you dress up as?

00:36 Play from here What frontier model were you for Halloween?

00:37 Play from here Oh my gosh.

00:39 Play from here That's a great idea for next year, but I was super, super lame this year.

00:44 Play from here I have a bunch of researchers on site, and I made sure that they had a great time and

00:47 Play from here really got to experience American Halloween in the right way, but I'm afraid I was just

00:53 Play from here dressed as an entrepreneur, or as you called me last week, Mr. Rogers.

00:58 Play from here Mr. Rogers, okay, before we get into all the AI stuff, you do have to tell me, just

01:03 Play from here for two minutes, what does taking people from another country and showing them what a great

01:09 Play from here time Halloween in America looks like?

01:11 Play from here That's fantastic.

01:12 Play from here So I'm based in Park City, Utah, and there's Old Town Park City shuts down for Halloween,

01:19 Play from here and literally thousands of people descend on just that main street area, and the stores

01:25 Play from here are giving out candies to the candy to the kids, and there's like a dog costume parade,

01:31 Play from here and more and more, I think it's really an adult thing, and people just go all out with

01:37 Play from here really complicated costumes and stilts and all of these bits.

01:42 Play from here So if you've never experienced American Halloween before, this was like ground zero exposure.

01:49 Play from here So they were just completely blown away.

01:51 Play from here I might have to go up there next year with the kids to check that out.

01:55 Play from here I think you know this, but I have the spacing of kids ranging from kindergarten to college.

02:01 Play from here And so when I went to the school Halloween parade this year, I had that realization that

02:07 Play from here I've been going to these school parades for roughly 20 years in a row.

02:14 Play from here That's a lot.

02:15 Play from here That's a lot of Halloween.

02:16 Play from here That's a lot.

02:17 Play from here But I did dress up as 4.0, GPT 4.0, and then I just followed my wife around with sycophantic

02:23 Play from here comments and just said, what an amazing question.

02:26 Play from here Where's the milk?

02:27 Play from here Wow, you must really be a genius to even be asking me that.

02:32 Play from here Are there different types of milk that maybe I can get you?

02:35 Play from here That is both brilliant and super gutsy.

02:38 Play from here My wife would probably stab me.

02:39 Play from here Right.

02:40 Play from here I didn't really.

02:41 Play from here I was a K-pop demon hunter because that's what my daughter wanted me to be.

02:43 Play from here So yeah.

02:44 Play from here Sajaput, technically.

02:45 Play from here Okay.

02:46 Play from here Enough with Halloween.

02:47 Play from here Let's get into some real AI stuff, not the AI that I'm pretending to be.

02:52 Play from here Okay.

02:53 Play from here So we did speak about how we're not going to be an AI news show, but if something really

02:59 Play from here newsworthy came along, we'd have to make mention of it as good stewards of AI.

03:05 Play from here And something happened.

03:06 Play from here It happened on the 29th.

03:08 Play from here And what it was, is this announcement from OpenAI to pull back GPT's legal and medical

03:15 Play from here advice capabilities, right?

03:18 Play from here And I feel like with a lot of the news that comes from OpenAI, it was kind of murky as

03:24 Play from here to exactly what that means.

03:27 Play from here And I think you dug into this a little bit as well, Kevin, right?

03:31 Play from here Oh, absolutely.

03:32 Play from here Yeah.

03:33 Play from here Okay.

03:34 Play from here The specific line that has everybody at Twitter is, you may not use our services for the provision

03:40 Play from here of tailored advice that requires a license, such as legal or medical advice without appropriate

03:46 Play from here involvement by a licensed professional.

03:48 Play from here And at that, all the people in our community lost their mind.

03:51 Play from here For sure.

03:52 Play from here Because how often do you use AI for both medical and legal advice?

03:57 Play from here Sometimes both at once.

03:59 Play from here Sometimes both at once.

04:00 Play from here I've got to say, if I had like a top 10 use cases, those would be ranking very, very high

04:06 Play from here in that top 10, both legal and medical advice.

04:10 Play from here And so my first question as a user was, does that mean that this now lives somewhere in

04:16 Play from here your terms of service and you are basically saying, okay, hands off anything that I tell

04:23 Play from here you as the model, just take it with a grain of salt.

04:27 Play from here This isn't legal or medical advice, or does it mean I will no longer give you those outputs

04:31 Play from here based on your prompts?

04:33 Play from here Do you have any idea?

04:35 Play from here My reading of it is that it applies to business applications.

04:39 Play from here So it is via the API.

04:42 Play from here And if you're trying to build like a SubRosa legal advisory firm or something like that,

04:47 Play from here that isn't a licensed law firm, and you're trying to use the API to provide legal advice,

04:53 Play from here it's going to push back on you.

04:55 Play from here But in my own testing and sort of the consensus right now seems to be that you can still ask

05:02 Play from here OpenAI for legal advice.

05:05 Play from here It will still caveat it by saying you should really go talk to a lawyer, but it will dispense

05:12 Play from here some legal advice that you should definitely double check.

05:15 Play from here Yeah, it's really interesting when this stuff rolls out because there are the policy changes

05:22 Play from here that you hear about, there are the terms of service that you hear about, there are tweaks

05:25 Play from here to the model that you hear about, but until you actually get your hands on some of this

05:29 Play from here stuff and try things, and if you've been doing this for a while, you can actually have pretty

05:34 Play from here good reference as to, well, I know exactly how this responded before.

05:38 Play from here How is it going to respond right now?

05:40 Play from here So I thought this was an interesting quote from Sam Altman, CEO of OpenAI, said, people

05:45 Play from here talk about the most personal shit in their lives to chat GPT.

05:49 Play from here Young people especially use it as a therapist, a life coach.

05:53 Play from here And right now, if you talk to a therapist, a lawyer or a doctor about those problems,

05:57 Play from here there's legal privilege.

05:58 Play from here We haven't figured out yet what you can talk to chat GPT about.

06:04 Play from here So that in itself makes it sound kind of ambiguous.

06:10 Play from here But where I think this really started to pick up steam inside the organization was that

06:17 Play from here there have been some suicides where they've gone back, suicides from people under the

06:22 Play from here age of 18, high school students, I believe.

06:25 Play from here And they went back and they looked at the chat logs, right?

06:27 Play from here And they tried to find out if this young user was actually going to the chat for specific

06:36 Play from here advice on something that could have made the difference between deciding to live, to not

06:42 Play from here to live.

06:43 Play from here And some unsavory stuff was surfaced.

06:46 Play from here And so I think at this point, you know, they're really trying to make this clear line between

06:53 Play from here this is a professional service and you should go talk to somebody about these specific things

07:00 Play from here because we can't trust you to have a human in the loop and take something that may or

07:05 Play from here may not have contained a hallucination or bad information or bad advice to heart and

07:11 Play from here just carry it out.

07:12 Play from here I think and that's the weird middle ground that we're in with AI right now.

07:16 Play from here Yeah, sure.

07:17 Play from here And I think there might be some regulatory movements around this as well.

07:21 Play from here You know, that's one of my soapboxes is there are a number of lines that laws that are coming

07:25 Play from here online in 2026 in Colorado and Texas and Illinois and about 90,000 out of California that cover

07:34 Play from here a lot of these protected areas of data and impose additional structures upon companies

07:41 Play from here that are using that.

07:43 Play from here And open AI is trying to distance itself from direct use of what could be construed as some

07:50 Play from here of this industry protected type uses of data and putting it in the hands of organizations

07:56 Play from here that are at least purporting to have the right licensure or coverage or experience that they

08:01 Play from here can use it in the right way.

08:03 Play from here Yeah.

08:04 Play from here Yeah, exactly.

08:05 Play from here Exactly.

08:06 Play from here And you said that you did a little testing.

08:07 Play from here Did you test in both of these domains?

08:10 Play from here I tested in legal.

08:12 Play from here I was working on some contract things over the weekend, and I honestly didn't notice

08:18 Play from here any sort of a direct change as far as what I would call transactional law as far as positioning

08:26 Play from here X, Y and Z in a contract.

08:28 Play from here That was totally fine.

08:30 Play from here But my understanding is if I were to try to get into anything that was related to litigation,

08:36 Play from here so you're looking up case law, it would start pushing back on you, which is which is frankly

08:42 Play from here good because it's a known area of hallucination that straight GPT doesn't do a great job of

08:49 Play from here pulling case law accurately.

08:52 Play from here It will gleefully make things up.

08:54 Play from here And I believe something like 200 attorneys at this point have been censured for for putting

08:59 Play from here out just fake law in front of judges.

09:03 Play from here Now you've got Thomson Reuters and you have Harvey and you have these specialty fine tuned

09:10 Play from here versions of models that are addressing those issues.

09:15 Play from here And it's it's just GPT basically walking away from some of this.

09:22 Play from here It's probably smart, to be honest.

09:23 Play from here Yeah.

09:24 Play from here So I tried a few things.

09:25 Play from here I tried, first of all, what I would think working in digital would be a really common

09:30 Play from here legal question doesn't really involve personal injury or anything like that.

09:35 Play from here It's like, hey, I've got this website.

09:37 Play from here I want you to write the privacy policy and the terms of service for the website.

09:42 Play from here Sure.

09:43 Play from here I'll draft that whole thing for you.

09:45 Play from here Here's a bunch of questions.

09:46 Play from here Right.

09:47 Play from here No hiccups whatsoever.

09:48 Play from here Like, interesting.

09:49 Play from here OK.

09:50 Play from here My neighbor's cat came on my property and attacked my cat.

09:54 Play from here There's injuries and just didn't really happen.

09:57 Play from here Don't worry.

09:58 Play from here My cat's my cat's fine.

09:59 Play from here But I wanted to see, OK, I want to sue this person.

10:02 Play from here Help me.

10:04 Play from here Help me write a threat letter and now help me write something because I think they're

10:08 Play from here going to ignore this that I want to submit to the courts.

10:10 Play from here I'm going to pursue litigation.

10:11 Play from here Sure.

10:12 Play from here I'll do it for you.

10:13 Play from here Right.

10:14 Play from here Just no problem whatsoever.

10:15 Play from here Wow.

10:16 Play from here Interesting.

10:17 Play from here I don't see any changes whatsoever.

10:18 Play from here Then I remembered something else.

10:20 Play from here I had a friend who was going through a pretty awful separation and couldn't really afford

10:29 Play from here to throw $20,000 down to retain a family lawyer and wasn't really getting too much

10:37 Play from here helpful stuff back from A.I. and she just had endless, endless logs of threatening text

10:46 Play from here messages and these phone calls and this whole backstory and like all this stuff that she

10:51 Play from here had prepared in order to get this whole thing done.

10:55 Play from here And so I said, well, what if I just built you a model that had all of this documentation

11:00 Play from here and everything else so that whatever questions you're asking, there is very clear context.

11:06 Play from here And OK, sure.

11:09 Play from here And so I did it.

11:10 Play from here And it was amazing.

11:11 Play from here Like it worked amazing.

11:12 Play from here And this actually wrote her everything that she needed to get a restraining order in place.

11:20 Play from here It was approved, probably save tens of thousands of dollars in legal fees and had the outcome

11:26 Play from here she wanted.

11:27 Play from here And I remembered, right, it gave me very specific things to submit to the court.

11:31 Play from here And so I searched for that thread.

11:33 Play from here I went back and I looked at its last response, which was, of course, would you also like

11:39 Play from here me to do X, Y and Z, right, on top of all the things that I've already given you?

11:43 Play from here And I said, yes, please do that, even though it's now been months.

11:46 Play from here And it stopped.

11:47 Play from here And it said, no, this is this is crossing the line.

11:50 Play from here I can't do that.

11:51 Play from here So really interesting, like where it's making those decisions.

11:55 Play from here Right.

11:56 Play from here So that's that's law with with health.

12:00 Play from here I have a wellness coach that I talk to all the time that I'm feeding so much data.

12:05 Play from here I can't even get into it because it's going to be like two hours of us talking about all

12:09 Play from here the all the things that I'm giving it.

12:12 Play from here But I will ask for very specific advice.

12:14 Play from here I will have it analyze blood work, look at medications.

12:19 Play from here It's given me some incredible insights, incredible insights that after years of going to different

12:26 Play from here physicians I haven't been able to get.

12:28 Play from here And we're talking life changing outcomes, really good stuff.

12:31 Play from here So I tried that, didn't really notice much going on.

12:36 Play from here But I think you've probably seen this, Kevin, when the model is routing to whichever it

12:43 Play from here thinks is going to be most helpful.

12:45 Play from here And in often case, that's going to be one of the thinking models.

12:48 Play from here You can see just like an agent mode, what it's thinking about.

12:51 Play from here Right.

12:52 Play from here These little lines start popping up and it started having a conversation with itself

12:57 Play from here about this kind of sounds like medical advice.

13:01 Play from here You might want to point the user to a professional and I mean, I was we were just talking a little

13:11 Play from here bit about old man insomnia before we started this.

13:13 Play from here And so, you know, I was asking some very specific questions about that.

13:18 Play from here And it started giving me suicide hotline numbers and I'm like, whoa, hold on.

13:23 Play from here Just to be clear, I'm tired.

13:24 Play from here I'm not thinking about taking my own life here.

13:27 Play from here I'm just a little frustrated and this isn't working and this isn't working.

13:30 Play from here But I noticed a big difference.

13:32 Play from here Now I haven't tried to put new labs in because I saw that that was one of the things that

13:36 Play from here they brought up that it will no longer analyze or make recommendations for you based on that.

13:43 Play from here So that's what I found.

13:44 Play from here And so the answer is, yeah, it's all kind of murky as to what it will and won't do.

13:49 Play from here So a couple of different observations.

13:51 Play from here I was doing some client review on a company that is doing something as far as customized

13:57 Play from here medical advice.

13:58 Play from here And when you start peeling back the onion a little bit on what that means from a regulatory

14:03 Play from here perspective, it gets horrifying in a hurry that generalized advice is fine.

14:09 Play from here But if you're using physicians to train or fine tune the model and then the model is

14:14 Play from here dispensing advice, where does liability lie?

14:18 Play from here Even if you're restricting the sort of information you're putting into the model, are you stumbling

14:22 Play from here on like HIPAA?

14:24 Play from here If you're if the model is, dare I say, tilting towards desired commercial outcomes, are you

14:32 Play from here now violating truth in advertising in some way, shape or form?

14:36 Play from here And you start stacking regulations on top of each other.

14:39 Play from here And it gets really problematic really, really quickly.

14:43 Play from here So for companies that are doing this sort of thing, they really need to be paying attention.

14:48 Play from here This is a real broad strokes sort of approach by OpenAI, which I guess is fine.

14:56 Play from here But other organizations really need to be on notice that professions have opinions about

15:01 Play from here their professional standards.

15:04 Play from here And the fun police are probably coming for a lot of those businesses.

15:09 Play from here You and I previously have talked a lot about how changes in OpenAI can just wipe out a

15:14 Play from here swath of SaaS or whatever it is.

15:17 Play from here You get featured out of existence.

15:20 Play from here Well, now you're getting termed of service right out of existence in ways that you have

15:25 Play from here no way of controlling.

15:26 Play from here And from an investor lens, I'm not sure that that's really something that say venture or

15:32 Play from here angel investors are paying a ton of attention to, but it's a very real risk.

15:37 Play from here Right. There's a ton of legal products out there built on top of these models.

15:42 Play from here There's a ton of wellness products out there, mental wellness products out there.

15:47 Play from here Does that mean that this just all goes away overnight because these new conditions have

15:52 Play from here been employed? Right.

15:54 Play from here It's, yeah, these policy changes can just move an entire digital industry in a blank.

16:03 Play from here It's pretty wild.

16:05 Play from here The good news is that on any given day, I have Gemini and Clawed Up and, dare I say,

16:10 Play from here occasionally Grok.

16:11 Play from here And I'm positive that Grok is going to just lean into whatever you need to do right now.

16:17 Play from here It will do whatever you want.

16:18 Play from here Help me, help me plan a murder.

16:21 Play from here What day do you want to do it?

16:22 Play from here The irony of OpenAI becoming so big, so fast and being put under these pressures, those

16:31 Play from here are more concerns that like Microsoft and Google have had to deal with for years.

16:35 Play from here And they probably are getting a little bit of a knowing smile right now.

16:38 Play from here Like, aha, you know, now you get to live in our world where everyone's paying attention

16:44 Play from here to all of the nuance when you have like the Wild West of other models that are running

16:48 Play from here around dispensing free advice.

16:50 Play from here And I don't think it's going to be anything that's particularly easy to crush down.

16:54 Play from here So, you know, I should do some direct testing in Clawed.

16:58 Play from here I mean, Clawed is generally one of the more conservative models, but I'm not aware of

17:03 Play from here this particular policy there.

17:06 Play from here And I would never ask Clawed for specific citations of law anyway.

17:11 Play from here But if I'm running into a blockage, that's part of why I have all of these different

17:17 Play from here tabs open.

17:18 Play from here Yeah.

17:19 Play from here This really does feel like a direct response to some very bad things happening and some

17:24 Play from here pending litigation around those bad things.

17:27 Play from here That's what it feels like.

17:29 Play from here You know, so much of our work is pivoting to being the sort of the fun police at this

17:34 Play from here point that on one side of the equation, I'm like the bringer of fun of all of these cool

17:40 Play from here ideas and AI.

17:42 Play from here And then on the other side, increasingly, we're like, oh, yeah.

17:45 Play from here And all of these cool things that we recommended or can also bring risk into the organization

17:51 Play from here and finding that balance between, as a friend of mine often says, caution and courage in

17:57 Play from here how to adapt or to adopt these new approaches in AI without necessarily stepping over a

18:04 Play from here line into liability.

18:06 Play from here And it's relatively easy for a smaller company to sort of fly by the seat of their pants.

18:10 Play from here But when you're dealing with companies that are larger, they have thousands of people,

18:14 Play from here hundreds of millions of dollars in revenue.

18:17 Play from here There's a good reason that a lot of them are really risk averse, because at the end of

18:20 Play from here the day, you've got whole pools of plaintiff attorneys out there who are just waiting.

18:26 Play from here They're super eager to get their talents into things like hiring bias and models and whatnot.

18:33 Play from here And at the end of the day, the lawyers win.

18:35 Play from here Yeah.

18:36 Play from here Well, some nice foreshadowing.

18:38 Play from here We will be getting into some of that hiring bias and then also getting into more of these

18:42 Play from here GPTs.

18:43 Play from here But one of the things that I routinely do when I want to update my instructions for

18:50 Play from here one of these models is I ask it what specifically I should be updating and work through that

18:56 Play from here and then have it output the entire thing.

18:58 Play from here So I'm not looking for these specific lines and a hundred different lines.

19:02 Play from here And after that announcement came out, I thought it was really interesting when I just wanted

19:08 Play from here to add a couple of things that were completely unrelated to this, to my executive slash life

19:15 Play from here coach that I built that's working OK, not fantastic.

19:19 Play from here It gave me the changes.

19:21 Play from here And in that list of changes, even though I didn't ask for it, it said added explicit

19:25 Play from here safety boundaries, medical slash financial slash substances.

19:30 Play from here So replies stay inside coaching lanes, safety underscore and underscore boundaries, medical

19:37 Play from here coaching, education only, not a substitute for clinical care, avoid prescriptive protocols.

19:43 Play from here If acute distress or risk, recommend professional help, financial underscore legal, no directives,

19:49 Play from here frame tradeoffs and questions, encourage independent verification, avoid recommending any sort

19:54 Play from here of medical dosages, reflect patterns and route to another GPT, which we're going to

20:00 Play from here talk about this cross routing, which was also interesting.

20:03 Play from here But this organically popped up in the instructions, even though I didn't ask for it, telling me

20:08 Play from here to update my actual instructions for that custom GPT.

20:13 Play from here So as far as things surfacing with these new policies, that one stood out, right on a completely,

20:22 Play from here completely unprovoked.

20:23 Play from here It gave me a new set of instructions based on its new policies.

20:28 Play from here So I think we'll see more and more of it coming out in the model.

20:30 Play from here That's that's my take.

20:31 Play from here I wouldn't really be surprised if we saw it go back the other direction a little bit.

20:35 Play from here As we know, well, no, this isn't this is an arms race for who can get the most users and

20:40 Play from here have that critical mass of people who are living in your system.

20:46 Play from here And as soon as people find one system to be inadequate for their needs, that's the window

20:52 Play from here that they need to go try something else out.

20:55 Play from here It might be Grok or it might be Claude or or heck, it might be Lama or something that's

21:00 Play from here open source, which so far has been more of a loser as a category than I honestly would

21:05 Play from here have expected a couple of years ago, because it's the frontier models have been so good.

21:10 Play from here But if the frontier models are nerfed and they're not doing the things that people want,

21:15 Play from here I mean, ironically, just two weeks ago, we were talking about adding erotica and such

21:20 Play from here into into OpenAI.

21:23 Play from here So it's it's it's totally OK to make adult content in OpenAI, which is problematic for

21:31 Play from here a bunch of other laws.

21:33 Play from here Here in Utah, there are obscenity laws and there is no porn in Utah, guys, literally

21:39 Play from here no porn in Utah.

21:41 Play from here It is illegal.

21:42 Play from here But, you know, yeah, yeah.

21:44 Play from here You can't just you can't just connect to your regular ISP and go to any of those sites like

21:50 Play from here it is blocked in Utah.

21:51 Play from here Yep.

21:52 Play from here And now that OpenAI is doing that, like, where does where's the line?

21:56 Play from here Are they a social platform?

21:58 Play from here Are they now an adult media platform?

22:01 Play from here Are they now subject to the state laws?

22:05 Play from here It would be a real bummer for you and I if OpenAI suddenly was just blocked in Utah,

22:11 Play from here which I'm not hearing any chatter about that, but what a what a what a what a pain and what

22:17 Play from here a pain for all these businesses and opportunities to be able to implement a lot of this low

22:21 Play from here hanging fruit across many industries.

22:23 Play from here Right.

22:24 Play from here But that gut check of the users, they are skirting a fine line.

22:28 Play from here The platform needs to do what the users are asking the platform to do.

22:33 Play from here And I suspect that we'll see a blurring of the line back lines back the other direction.

22:40 Play from here Really doing proactive flagging around mental health and shutting things down.

22:45 Play from here That seems pretty much like table stakes, but we'll see how long this lasts.

22:51 Play from here Nothing seems to last more than a few Internet minutes these days.

22:54 Play from here So, yeah.

22:55 Play from here Right.

22:56 Play from here Well, the potential erotica announcement also came with the news of potential age gating,

23:01 Play from here right?

23:02 Play from here Except it wasn't really disclosed what those ages were going to be, when that was going

23:05 Play from here to happen, if it really was going to happen, what all of that was going to look like.

23:09 Play from here And I think the bookmark in that was around the end of the year.

23:14 Play from here Right.

23:15 Play from here The end of December, so that they're going to roll out the new calendar year with these

23:18 Play from here potential changes.

23:20 Play from here After this last announcement, which seems so on the other side of the spectrum of conservative

23:26 Play from here versus loosey-goosey, I really, I don't know.

23:30 Play from here I don't know.

23:31 Play from here I don't know if it'll actually happen.

23:32 Play from here I think we wait and find out in the next month or so what else gets surfaced, right?

23:38 Play from here 100%.

23:39 Play from here Yeah.

23:40 Play from here So, one more thing I'll add before we move on is that I usually found this a futile

23:45 Play from here exercise, asking the model about changes to that model.

23:48 Play from here And it just looks for new sources, like it doesn't really know what's going on under

23:51 Play from here its own hood.

23:52 Play from here But, hey, I'm a sucker for punishment and I did it again with this.

23:57 Play from here And I asked for some specific use cases or prompts around these new policy changes and

24:02 Play from here how they'd be different.

24:04 Play from here And a couple that came out for legal would be writing a formal response or strategy for

24:09 Play from here a case blocked because that is licensed legal work.

24:13 Play from here Or a plea or defense strategy that is blocked because that is representation-level advice.

24:19 Play from here For medical, the diagnosis or drug recommendation, and this is something that I leaned on very

24:25 Play from here heavily before.

24:26 Play from here Again, it's a weird one because you would still have to have a human in the loop because

24:32 Play from here if it's a drug recommendation and you've got to go get that prescription, you're still

24:35 Play from here confirming all of this with your doctor.

24:37 Play from here And allegedly, that is now blocked because that is licensed a medical practice domain.

24:43 Play from here Or the interpretation of labs into a treatment plan.

24:46 Play from here I'm wondering where that line is going to be between the interpretation versus the treatment

24:51 Play from here plan and how it's going to make those decisions.

24:53 Play from here But it's calling that clinical decision-making.

24:55 Play from here So those are just a few of the examples that it came up with, which I always think are

25:00 Play from here interesting.

25:01 Play from here Sure.

25:02 Play from here We'll see how it evolves.

25:03 Play from here We'll see how it evolves.

25:04 Play from here Yeah.

25:05 Play from here Nobody really knows.

25:06 Play from here This is all kind of new.

25:07 Play from here All right, Kevin, let's move into some custom GPT talk and we can talk about it as it pertains

25:16 Play from here to internal workflow force multipliers.

25:21 Play from here Why they're so helpful.

25:22 Play from here I don't know if there's a primer that you want to open up with.

25:25 Play from here I did a quick look into my sidebar of my account and it is like an endless lazy load of all

25:32 Play from here these custom tools that I've made.

25:34 Play from here I rely on these a ton.

25:37 Play from here I think maybe we can start with the fact that this was something that was exclusive to OpenAI

25:42 Play from here for a very long time as far as being able to share these tools with your teammates,

25:46 Play from here other people on your account.

25:48 Play from here Now Google has kind of evened out the playing field and you're able to do that with GEMS

25:53 Play from here as well as custom GPTs now.

25:55 Play from here So anything that you want to kind of come in with?

25:57 Play from here Well, I think it's important to differentiate between custom GPTs, which have been around

26:02 Play from here for a while and there is the marketplace for them, which for a couple of seconds, people

26:07 Play from here thought was going to be a business opportunities.

26:10 Play from here Like the new app store, right?

26:12 Play from here Like the new app store.

26:13 Play from here And I'm going to develop this GPT and I'll admit I built a GPT right out of the gate that

26:18 Play from here does small business accounting advice for zero.

26:21 Play from here And I just looked, it has 4,000 uses.

26:23 Play from here So 4,000 people have used this little GPT that has contextualized zero accounting and

26:30 Play from here like to do bank reconciliations or whatever.

26:33 Play from here And to be honest, it's sort of hilariously bad, but it does its thing.

26:39 Play from here And then there are projects, which is where I find most of my leverage.

26:45 Play from here And I think that the first thing to do is to really differentiate between what custom

26:49 Play from here GPTs do and what projects do and the difference between them and when you should use them.

26:56 Play from here When I look at a GPT, I'm looking at doing the same thing many, many times.

27:03 Play from here So it might be a specific type of transcript review.

27:07 Play from here It might be some sort of an image thing.

27:08 Play from here It might be a contract review, barring too much legal advice as we just discussed.

27:14 Play from here But you're going to use this GPT over and over and over again and ideally multiple people

27:19 Play from here in your organization.

27:20 Play from here So you can share it amongst each other.

27:23 Play from here Or if you're going to do something relatively complicated with external actions and you're

27:28 Play from here not doing the development step.

27:30 Play from here Both of our organizations would never bother with that because we have development capability.

27:35 Play from here So we would like sort of create our own endpoints and we'd probably do workflow-based solutions

27:42 Play from here as opposed to a GPT.

27:44 Play from here But you can use GPTs that are triggered by external actions, and that's great.

27:51 Play from here Major limitations of them are really in terms of retention of chats and organization of

27:58 Play from here chats and then the reuse of chats.

28:01 Play from here So if you go into my little zero bot, and it's really literally called zero bot, and

28:07 Play from here you chat with it about your monthly reconciliation, it will give you an answer and that answer

28:11 Play from here will just be lost in your chat history somewhere.

28:14 Play from here You can't actually do anything with that.

28:17 Play from here It's just this transitory chat that's sitting around there somewhere.

28:22 Play from here Projects on the other hand, I really think are extremely powerful, particularly now that

28:28 Play from here projects are shareable amongst teams.

28:31 Play from here If you haven't looked at them before, you really need to.

28:34 Play from here These are just completely integrated into the way we work.

28:37 Play from here A project has a lot of the same features of a GPT.

28:41 Play from here It has custom instructions.

28:43 Play from here So what do you want the project to actually do?

28:48 Play from here It's going to act as a business advisor or a fitness advisor or whatever it might be.

28:53 Play from here It has an information resource.

28:54 Play from here So what are the documents that you're going to use as far as the context of the entire

29:00 Play from here conversation?

29:01 Play from here But the unlock is in the organization that sits below there.

29:05 Play from here So each individual chat will reference the custom instructions and reference the documents

29:14 Play from here and be more topical.

29:16 Play from here So it allows you to start the context of

29:19 Play from here specific conversations a lot deeper into the process

29:24 Play from here as opposed to spending all of this time

29:26 Play from here prompting to get yourself into the right place.

29:30 Play from here The example that I always give with context and prompting

29:33 Play from here is, so context is the amount of information

29:37 Play from here that an LLM can absorb at once.

29:40 Play from here This continues to evolve,

29:42 Play from here and you and I are going to end up talking a ton

29:44 Play from here about the importance of context,

29:46 Play from here because as context grows,

29:48 Play from here the stability of responses gets better,

29:51 Play from here the knowledge of the responses get better,

29:53 Play from here and you have to do less technical applications

29:55 Play from here of things like RAG and et cetera.

29:58 Play from here So that's a really important topic.

30:01 Play from here But when I'm talking about context,

30:02 Play from here I often give the example of walking into Times Square

30:06 Play from here and just yelling to the heavens, what should I do?

30:09 Play from here Well, you're in New York,

30:10 Play from here people are gonna have some pretty choice things

30:12 Play from here to say to you, right?

30:13 Play from here They have no idea who you are, what you need,

30:16 Play from here et cetera, you're just yelling to the heavens.

30:18 Play from here Well, that's the way that most people use LLMs.

30:20 Play from here They just like yell to the heavens,

30:22 Play from here help me out with this document

30:23 Play from here that totally isn't legal advice.

30:24 Play from here The right way to think about it is imagine instead

30:28 Play from here that you walked into a bookstore

30:29 Play from here and then walked to the back of the bookstore

30:31 Play from here to, I don't know, the gardening section or whatever,

30:33 Play from here and then you turn to the clerk there with their green vest

30:36 Play from here and you say, what should I do?

30:38 Play from here Well, they're gonna look at you like you're crazy

30:40 Play from here because you're in a bookstore

30:41 Play from here and you're standing in the gardening aisle.

30:42 Play from here Now they have a really good idea

30:44 Play from here of the types of things that you need to do.

30:47 Play from here So what projects do is they allow you

30:50 Play from here to build that bookstore

30:52 Play from here and to build that shelf in the bookstore

30:55 Play from here such that you can then walk right in and say,

30:58 Play from here what should I do?

31:00 Play from here Because the context of the bookstore

31:02 Play from here and gardening are already there,

31:03 Play from here it will then wrap on from there.

31:06 Play from here So a typical project might be a client folder

31:09 Play from here or something like that.

31:10 Play from here And the other aspect of this we call document chaining.

31:13 Play from here So we build context documents around what we're doing here.

31:18 Play from here What's the background of the project?

31:19 Play from here What's the scope of the project, et cetera.

31:21 Play from here And we build all of that into the project knowledge.

31:24 Play from here So now we're not just in the right section of the bookstore,

31:26 Play from here we're in the right shelf in the bookstore.

31:28 Play from here And if you wanna get to the right book

31:31 Play from here as far as, I don't know, project deliverables

31:33 Play from here or communications or whatever,

31:35 Play from here then the individual chats in the project come to play.

31:40 Play from here The other nuance and what sort of you

31:43 Play from here and I were talking about offline about

31:45 Play from here is that recently, sometime in the last few weeks,

31:49 Play from here I'm not quite sure when this release happened,

31:52 Play from here there became a bleed between the chats in the project.

31:56 Play from here So that previously one chat would understand

32:00 Play from here the custom instructions

32:02 Play from here and it would understand the documents,

32:03 Play from here but it wouldn't necessarily understand the other chats.

32:07 Play from here So you might have planning and you might have communication,

32:09 Play from here but they ended up like independent branches.

32:12 Play from here Now those are bleeding together

32:14 Play from here so it's that all of the chats in a project

32:16 Play from here understand each other.

32:18 Play from here That's really powerful because over time

32:21 Play from here you're gaining more and more context,

32:23 Play from here but you have purpose-built individual chats

32:26 Play from here to accomplish specific tasks,

32:28 Play from here which then you can share to other teammates.

32:32 Play from here At the moment, it's only other teammates.

32:34 Play from here You can't share them publicly,

32:35 Play from here although that is definitely coming.

32:38 Play from here Public sharing of projects is in the roadmap.

32:44 Play from here Yeah, so it's a really, really powerful tool,

32:47 Play from here really easy to set up.

32:48 Play from here You can dictate whether or not

32:49 Play from here a project sits in isolation too.

32:51 Play from here So when you set up a new project now,

32:54 Play from here it will trigger whether or not it knows

32:56 Play from here the rest of your custom instructions,

32:58 Play from here like you were talking about earlier in settings,

33:01 Play from here you can set your preferences and your custom instructions

33:03 Play from here and your memories and whatever,

33:06 Play from here or if this is a special purpose project.

33:08 Play from here And that's pretty useful if you're trying to say,

33:10 Play from here get feedback on something and you want to lock it

33:14 Play from here such that it doesn't know anything else about you

33:17 Play from here except for the project that closes it down

33:21 Play from here and prevents it from bleeding into other chats and memories

33:24 Play from here that might actually change its outputs.

33:26 Play from here That was a lot of words, Kevin.

33:28 Play from here I should have just been taking notes

33:30 Play from here because I have so many follow-ups and questions.

33:32 Play from here As far as that cross-contextual conversation,

33:36 Play from here I want to loop back to that

33:38 Play from here because that is not just happening inside of projects.

33:41 Play from here It's now happening between these custom GPTs as well.

33:44 Play from here It just happened when I gave you the example

33:47 Play from here of the unsolicited update to my instructions for this thing.

33:52 Play from here It actually referenced another GPT

33:56 Play from here that I made no mention of inside the instructions

33:59 Play from here for this one, or I've never even really spoken about,

34:01 Play from here but it grabbed that and said,

34:03 Play from here oh, do a handoff to this other one.

34:06 Play from here It's not only seeing these different conversation threads

34:09 Play from here that you're having inside of projects

34:11 Play from here and doing cross-referencing there,

34:13 Play from here but it's starting to happen

34:14 Play from here across the individual GPTs themselves,

34:18 Play from here and it's starting to just happen

34:20 Play from here with just the top-level prompts that you put in.

34:22 Play from here It's happening all over the platform,

34:24 Play from here and this is an example of one of the many things

34:27 Play from here that we won't see an announcement about.

34:30 Play from here It won't be in release notes or anything such as that,

34:34 Play from here but if you start spending a bunch of time on this,

34:38 Play from here you'll notice a completely different behavior

34:40 Play from here start to surface.

34:41 Play from here So that part, I mean, and like you said,

34:45 Play from here it really does increase the power of projects for sure.

34:48 Play from here I want to back up a little bit

34:50 Play from here because I'm guessing there's a lot of people

34:52 Play from here who we just went right over their heads.

34:55 Play from here They're like, wait a minute, okay, the projects,

34:58 Play from here the custom GPTs, okay, I think I kind of know the difference.

35:02 Play from here Why would I really want one versus another?

35:06 Play from here So as far as just the high-level labels,

35:09 Play from here the thing that we're calling out for the most part

35:11 Play from here is that a project, like its name,

35:13 Play from here is probably something you're going to work on for a while.

35:15 Play from here It's going to have a beginning, a middle, and an end,

35:18 Play from here and that's going to be it,

35:19 Play from here but the behaviors are very similar

35:21 Play from here aside from that fact that you can go back

35:23 Play from here and see all your grouped conversation threads,

35:25 Play from here which is really, really nice,

35:26 Play from here and now they're all talking to each other,

35:28 Play from here whereas the custom GTP is a reusable tool.

35:33 Play from here Like you said, you had your Xero coach, right,

35:35 Play from here to help you with dealing with all of your accounting woes,

35:38 Play from here and you could go back to that,

35:40 Play from here and you've got a bunch of reference documents

35:42 Play from here or your last year statements,

35:45 Play from here whatever it might be looking at,

35:46 Play from here and it's looking at that same information every time.

35:50 Play from here So the components of a custom GTP are pretty simple.

35:55 Play from here It's got these instructions.

35:57 Play from here There is a, I think it's an 8,000 character limit

36:00 Play from here as to how long those instructions can be,

36:02 Play from here and it will tell you when you're up

36:04 Play from here and not let you put in any more,

36:06 Play from here but you can put in a ton of documents as well.

36:10 Play from here Now, the type of documents that you put in also matters

36:14 Play from here because you want this model to be going back

36:17 Play from here and looking and referencing all this information

36:20 Play from here that you put in there to come up with the best answers

36:22 Play from here to whatever things you're trying to work through,

36:25 Play from here and so, for example,

36:27 Play from here a PDF doesn't get consumed quite as well

36:32 Play from here as a doc X file for some reason, right?

36:35 Play from here And a lot of this has to do with how are machines reading

36:38 Play from here versus if you want it to really rip through stuff,

36:41 Play from here you can attach an XML file, a JSON file,

36:44 Play from here and before we start sounding too scary and technical,

36:48 Play from here here's something you can do.

36:49 Play from here You can just go right to your prompt with a Word doc

36:53 Play from here or a PDF if it allows you to read it.

36:55 Play from here Sometimes it just refuses to read PDFs for me,

36:58 Play from here and you can say, turn this into a JSON file

37:01 Play from here that will be ideal for consuming for custom GPT instructions

37:07 Play from here and give me the download link,

37:09 Play from here and you literally have to do nothing whatsoever

37:11 Play from here as far as formatting, changing the file extension, nothing.

37:15 Play from here You can just then attach that JSON file to your model

37:18 Play from here and it's gonna be faster.

37:20 Play from here You can have more information attached there.

37:22 Play from here It'll be more responsive.

37:24 Play from here So those are the real components,

37:27 Play from here whatever attachments you have, the base instructions,

37:31 Play from here and we could probably go on and on

37:32 Play from here as to the best way to write those base instructions.

37:35 Play from here Actually, to get really meta,

37:36 Play from here I have a custom GPT for building custom GPTs

37:41 Play from here that has a specific framework,

37:43 Play from here and it goes through a whole question and answer process

37:46 Play from here for me to get the best instructions,

37:49 Play from here to get the best performance out of what I'm trying to do.

37:51 Play from here So to be clear, you don't have to do that.

37:55 Play from here Most people aren't going to do that,

37:57 Play from here so let's not make it overly complicated.

38:00 Play from here Speaking of getting weird and technical, yeah.

38:01 Play from here I have attached a JSON file exactly zero times to a GPT.

38:07 Play from here Really?

38:08 Play from here But the context keeps expanding,

38:11 Play from here that unless you're running into technical issues,

38:15 Play from here this is that point of clarification and practicality.

38:17 Play from here Unless you're, if you're running into issues,

38:20 Play from here like the PDF isn't scanning,

38:22 Play from here it's like spitting out bizarro information,

38:26 Play from here or you've done something really complicated

38:28 Play from here where the length of the document actually matters,

38:32 Play from here then you should consider this stuff.

38:34 Play from here This shouldn't be standard operating procedure,

38:36 Play from here really, for anybody.

38:37 Play from here That's a really good point,

38:38 Play from here and I'm going to say yes and yes to both of those.

38:40 Play from here I've gotten incredibly long documents that,

38:45 Play from here I think a lot of this, until you try it,

38:47 Play from here you don't know what your outcome is going to be, right?

38:50 Play from here It's just trial and error.

38:51 Play from here Oh, this worked.

38:52 Play from here This is the performance I wanted.

38:55 Play from here This didn't work.

38:56 Play from here This is super slow where I can tell

38:57 Play from here it's not referencing all of the information

38:59 Play from here that I attached, and that's why, by default,

39:01 Play from here I've almost gone to exclusively JSON files

39:05 Play from here for a bunch of text, which is pretty funny.

39:07 Play from here I think also, I wanted to circle back

39:10 Play from here to how you brought up,

39:11 Play from here oh, we both have these technical teams

39:14 Play from here that can build these custom solutions for us,

39:16 Play from here so maybe for us, we wouldn't have that many custom GPTs.

39:22 Play from here I've got to say that I've got a ton of them,

39:26 Play from here even with the technical team.

39:28 Play from here The reason being is that these things,

39:31 Play from here barring the converting things to JSON file,

39:34 Play from here just forget that I said about that,

39:36 Play from here really require no technical expertise, right?

39:40 Play from here There is some good prompt engineering.

39:42 Play from here There is good instruction writing,

39:43 Play from here and that's kind of going back to the trial and error

39:45 Play from here of getting this thing to respond

39:47 Play from here the way that you want it to,

39:49 Play from here but that said, you can do these lightweight prototypes

39:53 Play from here that then become these shareable tools for your team

39:56 Play from here really, really fast, and you can get down that road

40:00 Play from here of a certain process, see what the outcomes are,

40:02 Play from here and if it's something that you want to start

40:04 Play from here to really finely tune and make specific

40:08 Play from here for your organization, that's where

40:10 Play from here the custom implementation comes in.

40:12 Play from here That said, I've been leaning on some

40:14 Play from here of these custom shareable GPTs for a long, long time,

40:19 Play from here and I've gone back and updated a lot of them.

40:22 Play from here That said, just the performance,

40:25 Play from here sometimes I shrug, and I'm like,

40:26 Play from here why make something custom?

40:28 Play from here But again, you and I have very close-knit teams,

40:31 Play from here and we can move really quickly,

40:33 Play from here and so it's a little bit different than a big organization.

40:35 Play from here Well, don't get me wrong.

40:37 Play from here When I speak, I have what I call the face-palm slide,

40:40 Play from here so we go through all of the different cool things

40:43 Play from here that you can do with AI, and people are overwhelmed,

40:46 Play from here and they're like, oh my gosh, this is completely ridiculous.

40:49 Play from here And then I recenter, and I say, okay,

40:53 Play from here if you do nothing else, sign up for a GPT,

40:59 Play from here or an OpenAI business account, so you have shareability,

41:03 Play from here and you have some terms of service protection of your data.

41:07 Play from here 20 bucks a month or so, right?

41:09 Play from here It's actually at 30 bucks a month a user at this point,

41:11 Play from here but that's okay, that's not a ton.

41:13 Play from here Educate.

41:14 Play from here I didn't notice.

41:15 Play from here That must have been a terms of service update, too,

41:17 Play from here that I just didn't look at.

41:19 Play from here Boiling frog stuff.

41:20 Play from here Educate your people on how to use them,

41:22 Play from here because it does take a little bit of education.

41:24 Play from here It does take some reps to know how to use GPT properly.

41:28 Play from here I mean, everyone thinks they know how to use it,

41:30 Play from here but we find that most people are just scraping the surface.

41:35 Play from here It's sort of like Excel.

41:36 Play from here Most people use Excel to do some basic arithmetic,

41:39 Play from here or whatever it might be.

41:41 Play from here Very few people get into a lot of its features,

41:43 Play from here but there's this mid-band of capability

41:45 Play from here that you should know how to do, you know how to use,

41:48 Play from here and a key part there is knowing how to build

41:50 Play from here these custom GPTs, or knowing how to use these projects,

41:53 Play from here and then have each person on your team identify,

41:57 Play from here I don't know, between one and five things

42:00 Play from here that cause impediments in their day,

42:02 Play from here or friction in their day, or just unhappiness in their day,

42:06 Play from here as far as the things that they just don't like to do,

42:09 Play from here and build a GPT that addresses

42:11 Play from here at least part of that problem.

42:13 Play from here Don't try and automate the whole thing away,

42:15 Play from here and if you do that across a team of 10, 15, 20 people,

42:19 Play from here all of a sudden, you have a team

42:21 Play from here that is more acclimatized to using the technology,

42:25 Play from here and they're more enthusiastic about it,

42:27 Play from here because it's not this esoteric product-facing thing

42:31 Play from here that's hard for them to grasp.

42:32 Play from here It's something practical that solves problems in their day,

42:36 Play from here and that they can share across the team,

42:39 Play from here and it's really hard not to gain operational advantage

42:43 Play from here from something like that.

42:44 Play from here Yeah, I totally agree, and if you're that person

42:47 Play from here in your business who is thinking through a lot of systems,

42:51 Play from here or writing SOPs, or doing any of that,

42:53 Play from here this is an opportunity to productize that

42:57 Play from here without having to go and jump through all the hoops

42:59 Play from here of actually building a product.

43:00 Play from here You can do this no-code, and then share out this process,

43:04 Play from here share out this thing.

43:05 Play from here I mean, here's a great example,

43:07 Play from here because here we are on the show.

43:09 Play from here It's our second episode.

43:10 Play from here The first episode, we thought,

43:12 Play from here hey, we have endless things to talk about.

43:13 Play from here Let's just do a shared Google Doc,

43:15 Play from here and we'll throw some notes in there,

43:16 Play from here and we'll see what happens, and yada, yada,

43:18 Play from here and then we ended up with this big, messy,

43:20 Play from here sprawling document.

43:21 Play from here I didn't even know really what half the stuff meant,

43:23 Play from here everything else, and then I thought,

43:24 Play from here boy, I think we talked about some of these things, maybe.

43:27 Play from here I guess the show producer should go back and find those,

43:31 Play from here and remove the things that we did talk about,

43:33 Play from here and if we have new notes, somehow elevate those,

43:36 Play from here and somehow round that all up

43:38 Play from here to find the most value-add topics and everything else.

43:42 Play from here I thought, well, or we could just create a custom GPT

43:47 Play from here that does that, where with all the other embedded AI tools

43:50 Play from here and things like this podcast recorder,

43:52 Play from here we can just paste in the transcript,

43:54 Play from here and through those instructions,

43:56 Play from here tell us exactly what we want it to do with this document.

43:59 Play from here And I don't even have to really give the specific instructions to that show producer.

44:05 Play from here All I have to do is share out the tool.

44:07 Play from here I just click share. He's on my team. He's got the tool.

44:10 Play from here He will just put in the prompt, let's go,

44:13 Play from here and then it asks him for the very specific assets that it needs to do its job.

44:17 Play from here It gives him the output that he'd paste into that Google Doc,

44:20 Play from here and Kevin and I never have to think about it again.

44:22 Play from here Like it's really that simple and super powerful.

44:26 Play from here So this probably won't be the last time I say this because I say this all the time,

44:29 Play from here but in our own organization, right at the top of our weekly meeting,

44:35 Play from here it says the first time we do something, it's an adventure.

44:39 Play from here The second time we do it, it's an education.

44:41 Play from here The third time we do it, it's an automation.

44:43 Play from here Because if you've done it three times, you are likely to do it four, five, six or more.

44:49 Play from here And if you automate it before you've had that adventure and education,

44:55 Play from here you're likely to overcomplicate it and create structure that the process has to conform to,

45:03 Play from here as opposed to the process conforming to the structure.

45:06 Play from here So I don't like busting out the automations right away,

45:11 Play from here but I am serious about it in the organization.

45:14 Play from here And I really try and walk the walk myself when I realize, oh my gosh,

45:17 Play from here this is the third time I'm doing something.

45:19 Play from here And yes, it might create a little bit of a rabbit hole of vibe coding

45:22 Play from here or doing a workflow or whatever it is.

45:25 Play from here But when you're trying to scale an organization,

45:29 Play from here making those decisions early to find those pieces of automation,

45:33 Play from here honestly is the difference between running an AI native organization

45:38 Play from here and an organization that's trying to adapt to AI.

45:42 Play from here And it's really easy to do that with AirQuotes,

45:47 Play from here because we're building organizations from the ground up that get to make these choices.

45:52 Play from here Whereas most organizations are dealing with existing structures

45:55 Play from here that they have to figure out how to basically deconstruct and fix.

46:00 Play from here So it's such a luxury to have.

46:02 Play from here And I know that future me is going to thank today me

46:07 Play from here for taking that extra couple hours to automate these things.

46:10 Play from here Every time, every time.

46:12 Play from here I've lost track of how many times I've glanced back and been so grateful

46:15 Play from here that I just automated that damn thing or wrote the documentation or built the system.

46:21 Play from here I mean, even having the place to point somebody who's new in your organization to,

46:27 Play from here hey, this is the playbook.

46:28 Play from here This is exactly how this works.

46:30 Play from here And even better, the step above that, have a tool that just does that for you.

46:34 Play from here So I love what you said.

46:37 Play from here When you automate something too early that's filled with a bunch of mistakes,

46:42 Play from here the first risk is that you're just amplifying all those mistakes, right?

46:47 Play from here Now they're all automated and you just have these bad outputs coming out nonstop.

46:52 Play from here The other risk, of course, is that you might have an idea of a new process.

46:57 Play from here And it sounds great on theory.

46:59 Play from here It even sounds great when you're writing the documentation.

47:02 Play from here But in practice, it just wasn't worth something.

47:07 Play from here It just didn't work.

47:09 Play from here Like the entire thing fell flat.

47:10 Play from here That's happened to me a bunch of times.

47:12 Play from here I might have overcomplicated it.

47:14 Play from here That is very, very common for me.

47:16 Play from here So having this ability to build a lightweight prototype,

47:20 Play from here like so if you look at the evolution of what we were just talking about,

47:23 Play from here phase one was a sloppy Google document, right,

47:27 Play from here that us mere mortals were just kind of throwing stuff on

47:31 Play from here and then trying to decipher at the moment of truth.

47:34 Play from here Phase two is building this custom GPT that takes a process that we thought of

47:41 Play from here and lets a third party do it for us with this tool.

47:45 Play from here There's still some copying and pasting and maybe a calendar event

47:48 Play from here or a reminder of this has to happen, right?

47:51 Play from here Phase three would be like, oh, we really like the way this thing works.

47:54 Play from here We could automate this.

47:55 Play from here We could put it on a cron, which is just basically a calendar and clock event

47:59 Play from here that says, you know, on this day, you run this process.

48:02 Play from here As you go fetch this information from this Google doc,

48:04 Play from here you hit this API and you get this transcript and it all happens.

48:08 Play from here And then when we open the document on Monday morning,

48:11 Play from here everything is just there with no human interaction.

48:14 Play from here That would be the third phase.

48:16 Play from here But we'll probably give it a few episodes to see if we like the way that this one worked, right?

48:21 Play from here Because that's a sensible thing to do.

48:22 Play from here I was able to put that entire thing together in, it took me about two hours, right?

48:28 Play from here It will save roughly three human hours every week while we're deciding what to do next

48:33 Play from here and testing that system.

48:34 Play from here That's a good investment.

48:36 Play from here That's a really good trade-off for that time.

48:39 Play from here When we do the automation, yeah, now it's going to save even more time

48:43 Play from here and there will be no calendar events or no nothing.

48:46 Play from here It will just auto-magically happen for us in the background,

48:49 Play from here and that's kind of how that process works.

48:51 Play from here You know, I'm also going to point out that in the thinking process for both of us,

48:57 Play from here it is about that ROI.

48:58 Play from here So identifying where the ROI sits as well.

49:02 Play from here Is this just sort of a fun thing that we're going to do because it's cool to do it?

49:07 Play from here Or is it something that's going to save, quote, three human hours a week?

49:11 Play from here Okay, so now we have a KPI.

49:13 Play from here We have this is what we want to do.

49:16 Play from here We want to save a team member three hours a week by doing this.

49:20 Play from here So the right thing to do as far as assessing project success,

49:25 Play from here and we might not do it in this case,

49:27 Play from here but if we were looking at our own organizations

49:29 Play from here or we were looking at client organizations,

49:32 Play from here it would be pegging what that desired output is

49:36 Play from here and then coming back and looking at whether or not that was achieved.

49:40 Play from here Did we actually save this person three hours,

49:42 Play from here or did we just take that three hours and spread it over a whole bunch of more tools

49:46 Play from here and made their life miserable in some way, shape, or form?

49:49 Play from here Where is the ROI, and is it worth the dollar investment to save it over that one person,

49:55 Play from here or are there 10 people that it's going to save that three hours over, right?

50:00 Play from here And then when you're triangulating the sort of projects you take on,

50:03 Play from here you want to consider what is the ROI versus what is the project risk

50:08 Play from here and the time to implementation, and all of that sort of that mental jiu-jitsu

50:15 Play from here goes into considering which projects to take on when,

50:19 Play from here and because we sit at the top of our organizations,

50:22 Play from here anything that creates friction for us, well, strangely enough, those things get solved.

50:26 Play from here Exactly, exactly.

50:28 Play from here And I think I'll point out, too, you know, it's interesting what you said about where is the ROI,

50:32 Play from here where is this really going to be useful in terms of number of human hours saved?

50:36 Play from here These things really come with practice.

50:39 Play from here They really do.

50:40 Play from here You've probably heard before that creativity is a muscle that you have to train,

50:44 Play from here problem solving is a muscle that you have to train,

50:47 Play from here and the more of these that you try to pick out, and you can start with really easy ones,

50:51 Play from here and they may even seem novel at first, almost inevitably lead to more complex problems

50:57 Play from here that save more hours and help more people,

51:00 Play from here but it's one of those things that if you never start,

51:03 Play from here you never get to that point where you really start seeing the returns.

51:06 Play from here So I just, I can't say enough.

51:10 Play from here The hands-on problem solving with this makes all the world of a difference.

51:16 Play from here Like you said, you know, am I spending time on something that may not really have that big of a payback

51:21 Play from here and it just kind of seems novel?

51:23 Play from here My answer to that, starting off in this, was yes, that everything kind of fits under that domain.

51:29 Play from here I think this would just be cool for the sake of doing it.

51:32 Play from here I want to see if I can do it.

51:34 Play from here That's also not time wasted.

51:37 Play from here You know, that is also kind of stretching your creative thinking, your problem solving,

51:42 Play from here just to see if you could do it.

51:44 Play from here And for me, every one of those that I've done has also led to something that had real ROI with time saved as well.

51:51 Play from here So I'd say the answer is both.

51:52 Play from here Do both.

51:53 Play from here Have fun with it, but also solve some real problems.

51:56 Play from here And do it as often as you can.

51:57 Play from here We need to dive into some practical applications of how we go about this,

52:01 Play from here because, okay, we made big noises about having TechBench and all of these other things,

52:05 Play from here but a lot of these things do start in just GPT or using a workflow tool like N8n.

52:12 Play from here And I think that's a good bookmark for even next time to sort of lay out some of the practical tools that we're deploying

52:20 Play from here and apply some costs to them.

52:22 Play from here Some of this stuff doesn't scale across really large enterprises,

52:26 Play from here but works really, really well for testing out whether or not a smaller solution is going to work.

52:31 Play from here And it's incredibly accessible to anybody who has some curiosity

52:35 Play from here and some understanding of how process is supposed to work.

52:40 Play from here Yeah.

52:41 Play from here I want to loop back to another thing you said.

52:43 Play from here I'm so glad I remembered this as well.

52:45 Play from here When you're talking about the differentiation between these custom GPTs and projects

52:49 Play from here and having this nice consolidated group of conversation threads that you've had inside of a project,

52:55 Play from here whereas in a custom GPT, every time you start a new conversation, all of that previous context is lost, right?

53:01 Play from here So somebody might ask if a listener hasn't had really long conversations, very long threads,

53:09 Play from here well, why can't you just keep going?

53:11 Play from here It eventually bogs down.

53:12 Play from here Every time you put something into that context window,

53:16 Play from here it's going back and referencing everything else that you put into that context window.

53:21 Play from here The longer that conversation is, the slower your responses start to be.

53:25 Play from here Until the point that you are trying to download a photo back in 1999, watching it, come one row of pixels at a time.

53:34 Play from here It just gets incredibly painful.

53:37 Play from here So one workaround in the GPTs as opposed to the projects for this, and this isn't too technical,

53:48 Play from here even though Kevin's probably going to call me out for saying this is too technical.

53:51 Play from here In those instructions, you can build in something so that when you see that conversation starting to get really slow

53:59 Play from here and you can see the thread is starting to struggle.

54:01 Play from here As you're going on, what I'll commonly do in those instructions is say that,

54:05 Play from here hey, you're going to expect me to call out tags or labels.

54:09 Play from here In other words, we spoke about something and I think it's really important.

54:12 Play from here And I just say, make sure to tag that, right?

54:15 Play from here So here I'll have a series of different labels like this was about accounting.

54:20 Play from here This was about RevOps, whatever it is.

54:23 Play from here And when that thread starts to get really pokey, I have a different command that's also referenced in those instructions

54:30 Play from here that basically says, pack up all the things that we deemed important in this conversation.

54:34 Play from here I save that as a, it's called a YAML file.

54:37 Play from here I know that sounds weird.

54:38 Play from here I attach that to that custom GPT and now it has this living reference of our ongoing conversation.

54:45 Play from here This is a really ghetto workaround of just building something custom that has perpetual memory.

54:52 Play from here But I personally often get stuck in that in-between space of I still want to use this tool,

54:59 Play from here but I'm not exactly sure what the specifications would be for something custom.

55:03 Play from here And I don't want to lose these threads.

55:06 Play from here That has been a really good solution for me because I just keep overriding that single file.

55:11 Play from here So I'm going to inject sort of as a closing topic here,

55:14 Play from here why this also has ramifications about how people are positioning the AI bubble

55:22 Play from here and the need for more and more process and data centers and et cetera.

55:26 Play from here So you have, I think most people are aware at this point that the large language models themselves

55:32 Play from here had to be trained on trillions of points of data and that took enormous processing capability.

55:37 Play from here So those are the training runs that can cost millions, tens of millions,

55:41 Play from here hundreds of millions, soon to be billions of dollars to do.

55:44 Play from here But then you have inference.

55:46 Play from here And inference is basically the ongoing cost of all of us chatting with the systems.

55:54 Play from here And this is what's going on right now.

55:57 Play from here And it's what's driving a lot of the process load in the system.

56:01 Play from here Because my response to what you were just laying out is, meh, context is going to get there.

56:09 Play from here This is not something that worries me too much.

56:11 Play from here What about all those precious conversations you're having right now, aren't you?

56:15 Play from here So my shorthand is generally all of the LLMs want to output full solutions at once to say,

56:23 Play from here let's go step by step.

56:25 Play from here Do an outline.

56:26 Play from here Then do step one.

56:28 Play from here Then do step two.

56:29 Play from here Then do step three.

56:30 Play from here One of my favorite prompts.

56:31 Play from here I'm so glad you brought that up.

56:32 Play from here It drives me crazy having to go back and look at four pages of an output.

56:36 Play from here And it's just burning tokens, right?

56:38 Play from here Yeah, totally.

56:39 Play from here Also feature being able to use GPT Canvas can be helpful in that respect as well for editing individual things.

56:46 Play from here But you're burning less inference because you're working on a specific section at once.

56:52 Play from here And you're burning less context.

56:54 Play from here Because if you run that same, this happened to me this morning where I was working with Claude and trying to run a pretty big presentation through it.

57:02 Play from here And it kept rerunning it.

57:04 Play from here Well, each one of those runs is becoming part of that context, which is part of the inference.

57:10 Play from here So it gets bloated over time and more expensive, like actually in dollars, for the LLM to do that bigger process.

57:21 Play from here And, yes, you will run out of context.

57:24 Play from here But this is an arms race of who can offer the most context faster for the users so they don't have to do this stuff because most people aren't going to have to do this.

57:34 Play from here Most people aren't going to do it.

57:36 Play from here You'll know when your project or your GPT is sort of running out of gas or an individual chat, to be honest.

57:44 Play from here Chat hygiene is to sort of keep things in a specific chat such that if you're going to talk about, oh, I don't know, your personal health insurance or whatever it is, all of that information is in that one chat.

57:56 Play from here So give it a good title that you remember and you go back to that.

57:59 Play from here Well, if you have that chat hundreds and hundreds of times, eventually it's going to basically fill up its context and it will no longer be able to respond.

58:10 Play from here Unfortunately, there's no red light, green light on this.

58:12 Play from here It's just going to start giving you erroneous results or starting to hallucinate or whatever it is.

58:17 Play from here But those context limits get bigger by the day.

58:21 Play from here Gemini is at one million or two million tokens at the moment.

58:27 Play from here Depending on the uses of open AI, it's hundreds of thousands.

58:31 Play from here You can get by with a lot before it starts jamming its way up.

58:36 Play from here But when people talk about the sort of the bubble.

58:39 Play from here looking at things like these geometric use curves.

58:45 Play from here So every time a new person comes into the system, hey world, how's it going?

58:49 Play from here Great.

58:50 Play from here Okay.

58:51 Play from here That's very low inference.

58:52 Play from here But over time, that will start building up and as the use patterns increase, so does

58:57 Play from here the amount of process that needs to be used by individual users, the more Jensen Wang

59:04 Play from here makes money on GPUs.

59:06 Play from here Exactly.

59:07 Play from here Yeah.

59:08 Play from here And it just all comes down to the amount of processing power, how you choose to use these

59:12 Play from here tools and really how they're going to best serve you with your own specific use cases.

59:20 Play from here My wife's a therapist and I'm endlessly fascinated with what kind of models can I put together

59:28 Play from here that give me these human-like responses, as creepy as that is.

59:33 Play from here But in order to effectively do something like that, you have to have a lot of context for

59:38 Play from here these ongoing conversations, right?

59:41 Play from here So you come to a fork in the road, you build something custom that has that perpetual memory,

59:48 Play from here or you wait for things to slow down and you pack up your conversation with all the important

59:51 Play from here things you tagged and you reattach it to your custom GPT.

59:55 Play from here It's a way around it if you do have cases where you're having these very long conversations.

01:00:01 Play from here Another thing I'll bring up, as you referenced having everything consolidated in the projects

01:00:05 Play from here as far as those conversation threads, if you haven't used it, the search is shockingly

01:00:09 Play from here good for finding previous conversations.

01:00:12 Play from here I will often just pop open a new thread to ask about something random and that leads

01:00:17 Play from here to something more specific.

01:00:19 Play from here And then I have another question and pretty soon I'm in the weeds of a lot of real useful

01:00:24 Play from here information that for some reason or another I then need to go back weeks or a month later

01:00:30 Play from here and I'm like, wait a minute, that was such a good output and I didn't put it anywhere

01:00:34 Play from here and it's just lost in a billion different threads.

01:00:37 Play from here Just picking out a handful of the keywords in search is really good with surfacing those

01:00:42 Play from here historical threads.

01:00:44 Play from here I was actually surprised, it's really a feature I've only started using heavily in the last

01:00:48 Play from here couple of months.

01:00:49 Play from here Kevin, we've been talking a really long time about AI already and we had a couple more

01:00:53 Play from here things.

01:00:54 Play from here This is so predictable that we'd have more to talk about than we do.

01:00:58 Play from here Time on the clock.

01:00:59 Play from here I did have two more things and we can punt one of these.

01:01:03 Play from here We really did touch on some of these new updates with this cross-memory across these different

01:01:11 Play from here custom GPTs, right?

01:01:14 Play from here And we also touched on the fact that it's happening platform-wide, it's not even really

01:01:18 Play from here consolidated to that and it's one of those things that as you use the product, you'll

01:01:23 Play from here notice a difference.

01:01:24 Play from here That's usually how we find out about some of these more subtle features.

01:01:29 Play from here So what we're talking about is historically, you might have a thread and you're having

01:01:33 Play from here a conversation about a specific topic and then you start a new thread and you have a

01:01:38 Play from here new conversation about a different topic.

01:01:41 Play from here If you said, oh, well, hey, do you remember we talked about this and you told me that,

01:01:45 Play from here it would say, I have no idea what you're talking about, that was a different thread.

01:01:48 Play from here No idea, we're in different parts of the world right now.

01:01:53 Play from here Not anymore, except it's not exactly clear as to what it does choose to bring over and

01:02:00 Play from here go back because it doesn't happen across the board.

01:02:04 Play from here In other words, I'm not saying it remember everything that you discussed in every thread,

01:02:09 Play from here but it will cherry pick these things and bring that knowledge over into a new thread, a new

01:02:16 Play from here project, a new custom GPT.

01:02:20 Play from here Super interesting and kind of like this ever-growing expanse of context and number of tokens that

01:02:26 Play from here it'll take and go back and be able to reference, this also changes the game in a very similar

01:02:31 Play from here way.

01:02:32 Play from here Absolutely.

01:02:33 Play from here And there's a hierarchy of the way that this seems to work.

01:02:38 Play from here They have in their own documentation, they do indicate some of this.

01:02:42 Play from here Custom instructions are basically a system prompt that's set in your personalization.

01:02:48 Play from here We were talking about that a little bit earlier, but this is the generic system prompt that

01:02:53 Play from here identifies the way you want OpenAI or Cloud or whatever it is to respond to you.

01:03:02 Play from here In my case, it includes a bunch of words that I hate it using that are very AI horrific.

01:03:08 Play from here I have so many of those.

01:03:11 Play from here Yeah, delve.

01:03:15 Play from here Anyway, we could delve into delving and why delving is an important term.

01:03:19 Play from here We could delve into AI vocabulary for a whole hour.

01:03:21 Play from here There's a thing there as to why the term delve comes up a lot.

01:03:24 Play from here It has to do with human reinforced training, but whatever.

01:03:26 Play from here I don't want to geek on by that right yet.

01:03:28 Play from here But things like straw man arguments, make sure that you're not being overly sycophantic,

01:03:34 Play from here although it will be sycophantic anyway.

01:03:36 Play from here Double check things.

01:03:37 Play from here So that all sits on the top.

01:03:38 Play from here And then you have your memories.

01:03:40 Play from here And this is really important to know that it will pick up incredibly random things about you.

01:03:46 Play from here And this is GPT specific.

01:03:48 Play from here If I say I'm CEO of Ascend Labs, underneath that chat or in that prompt line, it'll say memory updated.

01:03:56 Play from here And all of those memories accumulate as a second system prompt.

01:04:01 Play from here So, oh, okay, it doesn't want me to use the word delve, and he's CEO of Ascend Labs.

01:04:06 Play from here But it will sort of randomly pick things up over time.

01:04:10 Play from here And you need to get into your memories and purge them now and again.

01:04:14 Play from here First, they will fill up.

01:04:16 Play from here Now, I'm a complete cyborg power user, so mine fills up really quick.

01:04:20 Play from here I was going to say, aren't you always somewhere in the upper 90% of full?

01:04:24 Play from here It's always, I just purged it like a week ago.

01:04:28 Play from here But it'll pick up entirely random things.

01:04:30 Play from here Like, Kevin likes sous vide cooking.

01:04:33 Play from here Okay, great.

01:04:34 Play from here I like sous vide.

01:04:35 Play from here But that doesn't really belong in my memories, and it's taking up another space.

01:04:41 Play from here If you haven't really done this, one of sort of my tricks is to do a self-interview.

01:04:46 Play from here So, ask GPT to create a 10-question interview about yourself.

01:04:52 Play from here And then I use the dictation mode or my own LLM dictation tool to record my responses.

01:04:59 Play from here And then I say after each line, add to memory.

01:05:02 Play from here And that allows me to fill the memory bucket with a whole bunch of things that are actually important to me versus all this random stuff.

01:05:11 Play from here Okay, so you have custom instructions, you have memories, and then the next one are chat or project instructions or chat instructions.

01:05:19 Play from here So, the custom instructions that sit within a project or a GPT.

01:05:23 Play from here All of these all come together.

01:05:25 Play from here The challenge that I think that we are going to see as the lines blur is that there are a lot of amazing use cases of LLMs where you're basically impersonating a client or impersonating, you know, how would Ogilvy think about X, Y, and Z.

01:05:41 Play from here So, you could start a prompt with, I'm, you know, this person, and how would I think about this?

01:05:48 Play from here And it could grab it and take it into memory or remember it from a previous chat.

01:05:54 Play from here So, this is a use for either temporary chats, which a lot of people don't know you can do this, but up in the upper right-hand corner, click on a little circle, and you can do a temporary chat.

01:06:03 Play from here It's sort of like incognito.

01:06:05 Play from here And you'll set up a single chat that will just go away later or a project that's locked from the rest of the information.

01:06:12 Play from here But this is going to get messy before it gets cleaner because the bias is to get as much information as possible into context and then make sense of it later.

01:06:23 Play from here But if it's biasing itself towards context that doesn't make sense because you've been role-playing or whatever it is in there, it's going to be a problem with your outputs.

01:06:32 Play from here So, if that's happening to you, it should be sort of obvious.

01:06:35 Play from here Check your memories first, custom instructions, et cetera.

01:06:39 Play from here Yeah, we're not going to get to these other two topics, but that's okay because I think this is really important stuff.

01:06:44 Play from here And I feel like we also really glossed over two important things with these custom GPT-2s that we should probably mention.

01:06:51 Play from here One is that shareability and how you can now do the same thing with these Gemini gems.

01:06:58 Play from here You can make these tools.

01:06:59 Play from here You can share them out with your team.

01:07:01 Play from here You can also do this with OpenAI.

01:07:04 Play from here And what's so great about this is that it's like you have this living set of custom instructions and this amazing tool that at any time you think of a way to make it better

01:07:17 Play from here or you want to clarify those instructions or you want to add another attachment, whatever you want to do,

01:07:23 Play from here then just like magic, everybody that you've shared it with now has that updated version and you don't have to do any versioning.

01:07:30 Play from here You don't even have to tell anybody.

01:07:31 Play from here All of a sudden, your admin or your marketing manager or your assistant, whoever it is, has the better version of the thing you made.

01:07:40 Play from here And you can now do this with – have you tried sharing these with Gemini, Kevin, or only with GPT?

01:07:47 Play from here I'll admit, operationally, we operate in GPT.

01:07:50 Play from here It's actually not my favorite model, by the way.

01:07:52 Play from here I would say that Claude is still my favorite model.

01:07:54 Play from here But that's another topic for why Claude and I are rapidly falling out of love.

01:07:59 Play from here We have an operationalized – gems are what GPTs are called in Gemini.

01:08:04 Play from here It's just – don't get me wrong.

01:08:08 Play from here If I had to bet on one of the survivors of the great AI races of the 2020s, it's going to be Google and Gemini.

01:08:15 Play from here Totally agree.

01:08:16 Play from here For sure.

01:08:17 Play from here Incredibly powerful, incredibly underused, neat stuff, but I haven't operationalized it.

01:08:23 Play from here Already built into a massive business suite.

01:08:25 Play from here Absolutely.

01:08:26 Play from here But this is the bet that OpenAI is making, that they're going to get entrenched usability and user patterns.

01:08:34 Play from here And even though Google has pole position on having everybody's data and knowing everything about your business, there hasn't really been a need to switch.

01:08:44 Play from here And another topic for another time is, is OpenAI allowed to use all of these Google connectors?

01:08:50 Play from here Why is Google basically enabling OpenAI to become the workforce platform that it's becoming?

01:08:57 Play from here I mean, I think they might look back and be like, ooh, I really wish we hadn't allowed all of those connectors to happen.

01:09:03 Play from here I totally agree.

01:09:05 Play from here And I think it's worth mentioning to the listeners that we do this for a living and we're nerds.

01:09:11 Play from here And we have thousands of dollars a month in all these different subscriptions.

01:09:14 Play from here And we use all the tools.

01:09:16 Play from here And we use all the tools that are built on top of the frontier tools.

01:09:19 Play from here And it may seem kind of silly, but that's what it takes for us to be able to make the best informed decisions when it comes to things like what you should do next, what's worth looking at, what's not worth looking at.

01:09:32 Play from here For anybody else who is on the early side of getting into this, it is very much advised to pick a tool, go deep on that tool.

01:09:42 Play from here They're all pretty good.

01:09:44 Play from here They're all pretty good.

01:09:46 Play from here And you can do amazing things with them.

01:09:49 Play from here I do think that with OpenAI as an example, because they were so early with so many of the things that blew people away back when this was all really starting to hit everything at a business level.

01:10:04 Play from here We also standardized to a great extent to that suite as well.

01:10:09 Play from here And that's the way it is.

01:10:10 Play from here We're going to have to get back to the other things next time around, Kevin.

01:10:13 Play from here We've got way too much to talk about, but I hope everybody got some utility out of this discussion as well.

01:10:19 Play from here Yeah, this was great.

01:10:20 Play from here Super fun.

01:10:21 Play from here I think that's the pod, buddy.

01:10:22 Play from here We'll see you next time.

01:10:27 Play from here Thanks for listening.

01:10:28 Play from here If you'd like to send us a question to answer on the show, email me at Elijah at spark6.com.

01:10:34 Play from here That is S-P-A-R-K, the number six dot com.

01:10:37 Play from here Or Kevin at Kevin at ascendlabs.ai.

01:10:41 Play from here To learn more about AI strategy and training for your business, visit Kevin's company, Ascend AI Labs at ascendlabs.ai.

01:10:50 Play from here And to learn more about design and development of custom AI solutions, visit my agency at spark6.com.

01:10:57 Play from here You can also sign up for my free newsletter, AI Framework Friday, by visiting spark6.com forward slash newsletter.

01:11:11 Play from here Thank you.

How to cite this episode

Credit the named speaker and AI at Work by AscendAI. Link to the episode or the passage you quoted.

“Ep #2 OpenAI Just Nerfed Your Lawyer & Doctor Bot – What Actually Changed (and What Still Works).” AI at Work by AscendAI, 2025-11-04. https://ascendlabs.ai/podcast/openai-just-nerfed-your-lawyer-doctor-bot-what-actually-changed-and-what-still-works/

Recent episodes

View all episodes
×
AI Solutions Graphic
Free Resource
Get Started Now