Numeracy, Probability, and Business – Embracing Randomness for Better Decisions
In this episode, host Andy Leonard sits down with Ilan Man, founder and CEO of Paradox Machines, a full-stack data and AI company based in Brooklyn. Ilan shares his fascinating journey from an actuarial career to the dynamic field of data science, exploring the rise of big data, the art of translating complex mathematics into code, and the importance of numeracy in society.
Together, they discuss the paradoxes at the heart of data and AI, the challenges of decision-making under uncertainty, and why intuition, risk management, and storytelling remain critical in a world driven by data. Whether you’re a data enthusiast, decision-maker, or just curious about how numbers shape our lives, this conversation delivers valuable insights and a healthy dose of skepticism about the limits, and possibilities, of analytics.
Links
Time Stamps
00:00 Starting a career in data science
03:34 Discovering a career in actuarial science
08:17 Learning coding and joining Squarespace
11:40 Understanding Probability in Code
15:36 Questioning Confidence in Decision-Making
20:06 Discussing COVID vaccine effectiveness
21:09 Understanding vaccine effectiveness
24:41 Consumers interacting with unpredictable AI
29:35 Discussing disease perception and interpretation
33:01 Casino audiobook and extra details
35:41 Balancing data-driven decisions
40:07 Career journey to founding Paradox
40:49 Building a data platform with AI
46:41 Data’s Role in Decision Making
47:30 Value and limits of data-driven decisions
Transcript
I went from Midtown New York to Dumbo, which is this cool
Speaker:warehousey, lofty space in Brooklyn. And I was like, what's
Speaker:this guy in the corner do? And she's like, oh, he's a data scientist. And
Speaker:I was like, what the hell is that? That sounds made up,
Speaker:you know? And she's like, oh, he tells us about the correlations
Speaker:of X and Y and the charts. I was like, huh?
Speaker:You're like, I know that. I know what the correlation, I mean. Right.
Speaker:You're speaking my language. And I met him, I chatted with him, and he's like,
Speaker:this is what I do. I was like, this is so cool.
Speaker:Hello and welcome back to Data Driven, the podcast where we explore the emerging field
Speaker:of data science, artificial intelligence, and all of it is possible
Speaker:through the hard work of data engineers, Like, my favorite is
Speaker:data engineer Andy Leonard. How's it going, Andy? Hey, Frank, it's
Speaker:going well. How are you, sir? I'm doing all right. I have been a
Speaker:busy man. I no longer work at Red Hat. I work now
Speaker:at a company called ClearML, but we will be rebranding to a new name.
Speaker:And as soon as I have authorization to share that new name wider, I will.
Speaker:Today, we've had a really fun conversation in the virtual green room, which
Speaker:sadly we will not share. But we have
Speaker:Ilan Mann, who has an interesting career.
Speaker:Currently, he's the founder and CEO of Paradox Machines,
Speaker:and it's a full-stack data and AI company. And they deploy a
Speaker:managed data platform into your cloud environment and embed a
Speaker:senior team to run it, aggregating the data from the systems you already use
Speaker:into a single structured layer that your leadership can
Speaker:actually query. I think that's cool. Product and service kind of bundled. We'll talk about
Speaker:that. Mm-hmm. But the most exciting thing, 2 exciting things. One,
Speaker:he's in Brooklyn, and 2, he started his professional
Speaker:career as an actuary, which is probably what people
Speaker:called data scientists before the term data scientist was
Speaker:coined. Welcome to the show, Ilan. Thanks, Frank. Thanks, Andy. Thanks for
Speaker:having me. And I'm very excited for this conversation,
Speaker:mostly because you 2 might be the only 2 that think being an
Speaker:actuary is the most exciting. Adding a little bit of commentary on
Speaker:you, or a commentary on me and how uninteresting
Speaker:my life is. But let's go with it. Let's go with it. Yes, being an
Speaker:actuary is definitely a little bit tedious. I mean, it's interesting
Speaker:because it really, I think the rise of big data, and you started your
Speaker:career just as big data started taking off as a commercial opportunity,
Speaker:but the rise of big data, I also noticed that you immediately switched to data
Speaker:science, I think:Speaker:Squarespace. according to your LinkedIn profile. So, so tell me
Speaker:about that, because when I made the switch from Windows development into
Speaker:data science, my wife, who has a background in mathematics from Carnegie
Speaker:Mellon and things like that, I told her all the courses I was taking and
Speaker:what I wanted to do. And she's like, she turned to me and said, so
Speaker:you want to be an actuary? Yeah, she, she
Speaker:probably wouldn't think it was cool like Andy and I do. So yeah, but I
Speaker:love her anyway. Yeah, I'm happy to share. So I started my my
Speaker:schooling. So I went to the University of Toronto in Canada. I
Speaker:grew up in Toronto and I started as a computer engineer
Speaker:because that's just what you did. Wait, if you're good at math and physics and
Speaker:kind of science and you're a nerd like me. And I was tinkering with
Speaker:s, early:Speaker:So it was super fun. Turns out that I didn't make a very good
Speaker:computer engineer. In particular, I wasn't good at at
Speaker:programming, at understanding how to, you know, there would be the exercises
Speaker:of, okay, program a chessboard in Java. And I just didn't really
Speaker:understand classes and static, public, all
Speaker:this stuff. But I was always good at math, right? I kind of aced my
Speaker:calculus, my linear algebra. That just kind of made sense to me. So I went
Speaker:to the counselor at school a year or two into my degree
Speaker:thinking, okay, I don't think this computer engineering thing is for me. Everybody's blowing
Speaker:by me. But, you know, I'm pretty good at math. And
Speaker:they said, well, have you ever considered being an actuary? And I said,
Speaker:I haven't because I've never heard of such a thing. And so they
Speaker:walked me through it. And all I took from this conversation
Speaker:was, with them was, you do a bunch of tests
Speaker:and the more tests you do, they're math tests. This is how it was
Speaker:pitched to me. You do a bunch of math tests after you graduate, mind you.
Speaker:Yeah. And the more you do, the more senior you get and the more money
Speaker:you make. And I said, well, this is perfect, right? I'm in testing mode.
Speaker:I'm good at math. I like the meritocracy of you
Speaker:just like, you know, the harder you study, the more money you make. I was
Speaker:like, it just made all the sense in the world. Of course, that's not how
Speaker:the world works. But when you're 18, 19, 20 years old and all
Speaker:you know is an entire lifetime effectively of
Speaker:schooling and this notion of you do tests and you move up,
Speaker:I thought, great, what a continuation of what I know already.
Speaker:And so I did it. You know, I toyed with the idea of being a
Speaker:math professor, but then I learned more about what that was,
Speaker:and you do even more schooling and you make even less money. And I was
Speaker:like, okay, forget that. Let me just be an actuary.
Speaker:And so I did that. I did that for a number of years, bounced around
Speaker:a couple different companies, mostly like large organizations, reinsurance companies.
Speaker:And it was like reasonably interesting. I did the tests, I
Speaker:passed the tests. I kind of got to this quote unquote
Speaker:peak as a young person, very young person, very
Speaker:inexperienced young person blowing through all the tests.
Speaker:And I moved to New York. I started working for Ernst
Speaker:Young, also as an actuary. And let me tell
Speaker:you, like the math was just not as, not nearly as interesting
Speaker:as one expects. And it
Speaker:wasn't as, I think, technically interesting for, again, a math
Speaker:nerd like me. And I think that was just the expectations of
Speaker:what I had versus the reality were just misaligned. And by the way,
Speaker:that's like what everybody goes through when they go through this journey. They
Speaker:realize like, oh, the real, like, business math is not
Speaker:academic math. And this is, you know, I was kind of sold like a bill
Speaker:of goods. And at the time, so this is like end of the
Speaker:s, early:Speaker:with their article about data science is the sexiest job of the
Speaker:21st century. And I was like, well, I want to, I want a sexy job.
Speaker:And I met my now wife, who at the time was a product manager at
Speaker:a startup. What the hell is a startup? Well, they had
Speaker:exposed brick, they played ping pong,
Speaker:they had a beer keg. Everybody there was in their 20s and I'm
Speaker:coming from like a large consultancy. Yeah. Ernst Young
Speaker:is very buttoned down and you're going to like presumably some Silicon
Speaker:Alley firm. Yeah, yeah, yeah, exactly. I went from like
Speaker:Midtown New York to Dumbo, which is like this cool warehousey,
Speaker:lofty space in Brooklyn. And I was like, what's this guy in the corner
Speaker:do? And she's like, oh, he's a data scientist. And I was like,
Speaker:the hell is that? That sounds made up, you know?
Speaker:And she's like, oh, he tells us about the correlations of X and
Speaker:Y and the charts. I was like, huh? You're like, I
Speaker:didn't know that. I know what the correlation— I mean,
Speaker:you're speaking my language. And I met him, I chatted with him, and he's like,
Speaker:this is what I do. I was like, this is so cool. Like, you're doing
Speaker:statistics in code and you're applying it and
Speaker:you're solving these problems that are coming at you every day. And you're
Speaker:iterating, you know, this is before I even know the word iterating, right? But you're
Speaker:iterating on these problems together and people are making decisions
Speaker:based on your analysis. Like, this is crazy interesting.
Speaker:And anyway, that led me down the journey of data science and
Speaker:tech and startups. And it's a whole different
Speaker:language and vocabulary I had to learn, but
Speaker:fundamentally they're using data. make decisions
Speaker:and doing an analysis and in between. And you are
Speaker:the person who understands, who can map data and patterns
Speaker:in the data to business decisions and outcomes
Speaker:that the business wants. And I was like, that is such an interesting job.
Speaker:And you're using code, not Excel. Excel is still obviously
Speaker:used, but you're using Python or R or whatever these like
Speaker:SQL, these different coding languages at the time that were arcane to
Speaker:me to do this. And by the way, there's like
Speaker:this huge path, a lot of excitement, so much
Speaker:energy. Everybody's in their 20s, you know, at least for
Speaker:in my circle at the time that I was like, this just makes
Speaker:so much sense for me to do. And, you know, I did the kind of
Speaker:fake it till you make it. I didn't know what the hell I was doing,
Speaker:but I can like, you know, try to
Speaker:network and try to learn what I needed to learn. And anyways,
Speaker:to your point, Frank, like I then ended up at
Speaker:Squarespace, which was like an up-and-coming website
Speaker:design company, pretty beloved, I would say, in the New York area.
Speaker:And yeah, the rest is boring history, I guess.
Speaker:So I'm gonna jump in. I love your passion.
Speaker:Right away I recognized that and I love it. I have that
Speaker:same passion. I love using data to help
Speaker:people and, you know, helping people make decisions
Speaker:qualifies. And I absolutely love it that
Speaker:you were sold a bill of goods, not unintentionally. It was— Yeah,
Speaker:exactly. But, and the people who did it had, you know, had
Speaker:your good in mind. They were actually looking out for you.
Speaker:And they rescued you from, at that time, which sounds
Speaker:like you're now more in, maybe in more in code, or at least you were
Speaker:when you jumped over to data science, but you needed, I think,
Speaker:that motivator to have an application
Speaker:for your math that was code included
Speaker:in that application. Is that right? How do you feel about that? Yeah, yeah. I
Speaker:mean, code, you know, enables you, you know, to move fast,
Speaker:to actually make real, to manifest these
Speaker:symbols, right? These like integrals and,
Speaker:you know, linear, like matrices, when you multiply them, you get a thing. And
Speaker:I've always been so fascinated with the fact that I can,
Speaker:you can kind of think through in formal
Speaker:logic and like deductive logic or some sort of a mathematical framework.
Speaker:You could write it down. It can make all the sense in the world, but
Speaker:it's very abstract. Yeah. And it's very just like academic, an
Speaker:ivory tower. And then you open up a notebook, like a Python
Speaker:notebook or SQL or something, and you literally
Speaker:translate into code the things that
Speaker:you've written down on a, you know, with pen and paper that in theory makes
Speaker:sense, right? Like in theory, when you integrate a distribution,
Speaker:the sum of the probabilities gets you to 1, and that's 100%.
Speaker:And that's what they told us in Statistics 101 or whatever you take. And
Speaker:you just are like, yeah, that makes sense. That's what an integral does. What the
Speaker:hell is an integral, right? Like, it's this, like, no, it's
Speaker:just like so far out there compared to, or a derivative
Speaker:compared to like arithmetic. Now, of course, it is arithmetic at
Speaker:bottom, but you're so far removed. But if I write a for
Speaker:loop or some sort of a loop in code, which is
Speaker:effectively what an integral is, and I do a summation of
Speaker:all the indices of the terms, and I define a
Speaker:probability distribution in code. Well, it turns out when I loop
Speaker:over from like 0 to 1 or negative infinity to
Speaker:infinity at the limit, I get, and then I
Speaker:take the sum of my probabilities, I get 1, I get 100%. And
Speaker:I just, that was, maybe I'm very naive or something, but
Speaker:it was so cool to me that I can see with my
Speaker:eyes and I can like break it down, the thing that I wrote
Speaker:on pen and paper that these mathematicians told me would be true.
Speaker:And of course, sometimes it doesn't correspond, sometimes it doesn't work and you get rounding
Speaker:errors or you get, you know, something that breaks down, but then you could use
Speaker:the code to debug your thinking. And it
Speaker:always was, you know, I don't know, I had this like boyhood kind of
Speaker:like, I don't know, enthusiasm for this
Speaker:because I could see it. You know, I could, I could see the code doing
Speaker:the thing that the math promised would be true. And I don't
Speaker:know, part of me thinks that people take for granted that it just works,
Speaker:that they're like, yeah, yeah, you just, here it is. It just works. And I
Speaker:say, no, it doesn't just work. You have to like do it. You know what
Speaker:I mean? Right. There's a certain magic in statistics.
Speaker:There's a certain magic of that. And for me, it's about finding the signal amongst
Speaker:the noise. Mm-hmm. Right? The data is telling you things.
Speaker:You just have to know where to find it and where to look at it,
Speaker:right? And it's fascinating. It's fascinating. And I also think too, like something you
Speaker:said was very funny was one, you know, the
Speaker:whole fake it till you make it thing. In the early days of data science,
Speaker:there was not really a well-worn path for this, right? Everybody was just kind of
Speaker:making it up as they go along. I think there's a lot of that too
Speaker:in the AI space too. You hear about AI and agentic patterns and things like
Speaker:that. I'm like, no one's really got this all figured out, right? And anyone that
Speaker:tells you they have it all figured out is selling, selling you their solution. They're
Speaker:selling you a bundle of goods, right? The other thing too is I didn't realize
Speaker:that I had my Tim Hortons cup today because there's a Tim— the first Tim
Speaker:Hortons opened in Maryland near my house. So, oh wow. I
Speaker:stopped by there and so I figured— I didn't realize you were Canadian,
Speaker:but I'm sitting here sipping this. I'm like, wait a minute.
Speaker:So we do a lot of, we do a lot of like distractions like that.
Speaker:Yeah. Yeah. Tim Hortons is an institution in Canada.
Speaker:I've been to a couple of Tim Hortons here in the US. They're not the
Speaker:same. Sorry to say. Yeah. I mean, it's the same
Speaker:branding and it's ostensibly the same if you didn't know any different,
Speaker:but somehow the coffee hits different. Uh, the Timbits,
Speaker:which you would call Munchkins, I think, in like Dunkin'
Speaker:Donuts. Yeah. Yeah. Yeah. Timbits, uh, hit different. Uh, the sandwiches a bit.
Speaker:Still good, but I think, I don't know, it's missing that je ne sais
Speaker:quoi. But Frank, I think you kind of stole the
Speaker:words out of my mouth. Nobody really knows
Speaker:what's going on. And in particular, those folks
Speaker:who claim that they do are the ones that are kind of selling you
Speaker:something. And that's been my MO the whole time is,
Speaker:you know, it's okay to have an idea, to guess, To
Speaker:take a stab at something. I mean, you got, you can't just like sit on
Speaker:your hands. You gotta make a decision. You gotta put your money somewhere. You gotta
Speaker:spend, you know, allocate resources, but don't delude
Speaker:yourself into thinking that, or that the person on the other side of the call
Speaker:knows. They might be confident, right? They might know
Speaker:something. But I always am quite
Speaker:skeptical. And maybe this is my statistics brain, which always thinks in
Speaker:distributions and thinks in, you know, spectrums. I'm always skeptical of
Speaker:those folks who have just high degree of certainty, right? I'm always
Speaker:saying, what are your— it's fine to make a prediction, but like, talk to me
Speaker:about your error bars. Are they wide? Are they narrow? How do you
Speaker:think about that? And if people don't, and sometimes
Speaker:they don't know how to talk about error bars, which is fine. Like,
Speaker:I don't know, my error bars are 20. Like, what the hell does that mean?
Speaker:Doesn't mean anything. But so then I say, okay, what would you do if
Speaker:you were wrong? Yeah. What are other decisions you make? How do you
Speaker:iterate? And if people don't have good answers to that, that
Speaker:tells me that they're only, they're thinking kind of in a single direction
Speaker:and they don't have, they couldn't fathom it going wrong.
Speaker:You know what I mean? Like, what if AI blows up
Speaker:tomorrow? And if they're like, well, I don't know, then you say, okay, then you
Speaker:must be pretty confident that it won't blow up because I guarantee
Speaker:you. If you had thought about it and you thought, well, what if it goes
Speaker:wrong? You would've come up with some contingencies or some
Speaker:remediation measures. And if you didn't, I don't think it's
Speaker:'cause you're not a thoughtful person. That could be true. But I think
Speaker:because you're just like super confident and I would question
Speaker:the amount of confidence you have in whatever it is that you're doing.
Speaker:That makes sense? Well, that's hard to say. That's 100%. Statistics, when you study
Speaker:statistics, It changes the way you think, and you can
Speaker:never hear things quite the same way again. Right? You know, one of the
Speaker:talks I give is about facial recognition and the ethics behind that. And
Speaker:you know, one of the—I'm not going to name them because I'm tired of dealing
Speaker:with lawyers. Long story there. But but
Speaker:they said, well, you know, they've been involved in a lot of false
Speaker:arrests and things like that, and lawsuits right now. And they're like, you know, their
Speaker:material says that. Or at least what the police said is that we were told
Speaker:this was 100% accurate. And again, if I hear
Speaker:100% accurate, immediately the hairs on the back of my neck stand up and I'm
Speaker:like, oh, yeah, 100%, you say?
Speaker:Yeah. Is anything 100%? I mean, what is like— The
Speaker:only thing that's 100% is it's probably not 100%. That's the
Speaker:only thing I can say. Exactly. Exactly. No. And, you
Speaker:know, so I tell my team often as well, like, Just because you're,
Speaker:you run the simulations and there's a distribution of results and maybe
Speaker:you're 80% confident in, you know, the going down,
Speaker:going on the left and you're 20% confident going on the right. Like,
Speaker:it's good to think through that. Ultimately, you gotta make a decision. So it's
Speaker:fine to go with your gut. It's fine to go in the
Speaker:direction that you're not 100%, you're gonna go in the direction that you're not 100%
Speaker:confident in. That's not the issue as much as it's, uh, you know,
Speaker:how do you mitigate your risk, right? How do you make sure that you're
Speaker:going, that you've taken all the precautions that are reasonable,
Speaker:right? Sure. And this is where constraints come in, whether it's a time
Speaker:constraint, a budget constraint, an information
Speaker:asymmetry constraint. Like we all operate in a
Speaker:world of imperfect information. That's fine. You just have to embrace that.
Speaker:And just, you know, despite that, make
Speaker:the best decision that you can, and, you know, kind of live to fight
Speaker:another day. I mean, it's science, right? The
Speaker:science in data science is about iteration, right? Sure. Hypothesis,
Speaker:test, correct, repeat. I
Speaker:think people forget that, right? And I think it's also interesting, you know, I'd
Speaker:made a quantum joke earlier. It's interesting how people got used
Speaker:to computing being very deterministic, right? 2 2 is
Speaker:always 4, right? But AI has gotten us used to, or at
Speaker:least you would hope, to probabilistic computing,
Speaker:which is realistically all quantum computing is essentially about, right? You're
Speaker:never guaranteed the same answer twice. Yeah. You know, I don't
Speaker:know. Yeah, yeah. I'm really interested in the
Speaker:fact that, um, so, you know, there's like literacy and there's, uh,
Speaker:what is it? Numeracy? Yes, numeracy. Yeah. Numeracy. And
Speaker:I'm really interested in society. And this is maybe, Frank, the point you're kind of
Speaker:getting at, society getting more numerate. Right? Like, we talk about being literate,
Speaker:but I don't think that we often talk about being numerate. And
Speaker:statistics plays a big role in that, right? Because we don't really think
Speaker:about calculus and linear algebra, but we think about numbers. How
Speaker:much money you have, how many people live in a country, how many people
Speaker:vote, what is the likelihood of a president getting elected, and the
Speaker:inflation rates and stuff like— these are numbers that float around
Speaker:our society all the time. And I think all around you, and once it's all
Speaker:around you, one of the things that warps your brain when you study statistics is
Speaker:like you see it everywhere. Weather forecast, weather forecast is probably the
Speaker:most obvious, right? Like, what does it mean there's a 30% chance of rain today?
Speaker:Like, so let me, let me tell you something that I find— I'm
Speaker:like, I, I feel like I'm talking a little bit too much here, but no,
Speaker:let me— You're the guest, man. Yeah, Andy and I
Speaker:bang on all the time, so So something that I'm, that I'm
Speaker:kind of curious to get your take on. So, and it's okay,
Speaker:COVID happened, right? We all remember that. And during COVID
Speaker:there were a lot of conversations around vaccines or
Speaker:different treatments. Putting aside your thoughts on them, let's just
Speaker:talk about the numbers. And I don't, I don't have the exact
Speaker:numbers off the top of my head, but I remember a lot of
Speaker:conversations Where it was of the frame,
Speaker:hey, you should get vaccinated because it has— and I'm going to make up some
Speaker:numbers— it has a 90% effective kind of effective rate.
Speaker:And they're great. Okay, fine. It's 90% effective. That's what public policy
Speaker:is, what the experts are saying. Fine. And, you know, people have been
Speaker:vaccinated for different things for, you know, decades now. So it
Speaker:wasn't like a new concept that vaccines have some sort of a rate of
Speaker:effectiveness. whatever that rate happens to be. So let's say
Speaker:it's 90%. Great. It's a high number, high enough that you think, okay, it's worth
Speaker:getting vaccinated. So then you do. And then you'd hear a lot of
Speaker:folks say, I was vaccinated and I still got the
Speaker:COVID And there would be a disconnect in their heads. They'd be like,
Speaker:but how could I possibly get it if it's 90% effective?
Speaker:And there was this disconnect because And this is
Speaker:to the point of society getting more numerate. The
Speaker:disconnect in my mind, I mean, there might be a lot of disconnects, but like
Speaker:from a pure numbers perspective, the disconnect is that
Speaker:when somebody says from a public policy perspective, it's
Speaker:90% effective, whatever the percent happens to be, what they mean is
Speaker:something like if 100 people got
Speaker:vaccinated, 90% would not get the
Speaker:COVID strain, right? And that's because they
Speaker:ran experiments and all the rest of it. That means 10% will get it.
Speaker:Something like this, you know, I think— That's what I would
Speaker:expect. That's a safe way
Speaker:of interpreting it, right? Even though I think it's a little bit different when
Speaker:you get into the nuts and bolts, but roughly. But you as an individual,
Speaker:you either get it or you don't get it, right? You don't get 90%.
Speaker:of the thing. You get 100% or 0%. So
Speaker:the people, but there's a disconnect in how we think about
Speaker:probabilities. And this is what I was saying before, where you have to make a
Speaker:decision, even if you're 80% confident that it's left
Speaker:and 20% confident that you go right, you still have to choose one or the
Speaker:other. Right. So that was a very interesting, that was the first time it
Speaker:dawned on me that, oh, because I was like, well, of course you might
Speaker:get it. You're 90% safe. But like, you either
Speaker:will or you won't. Like, you must understand that just because
Speaker:you get it doesn't mean that the claim that it is 90%
Speaker:effective is invalid. It doesn't have anything to do with that
Speaker:claim because we're talking about broad
Speaker:probabilities in a population level, like from a sample.
Speaker:And those are frequentist probabilities. Those are, I flip a
Speaker:coin 100 times to see if it's tails or heads
Speaker:to determine if it's a fair coin or not. But any given flip of a
Speaker:coin will either, will with 100% certainty
Speaker:either be heads or it will either be tails
Speaker:regardless of if it's a fair coin or not. Like regardless of if it's
Speaker:weighted or all these like experiments. And this was the exact same
Speaker:thing. And it was, and I'll get off my soapbox in a second.
Speaker:And it was, it was like an interesting— social
Speaker:experiment in my mind, how many people, and
Speaker:obviously like people have a lot of feelings about vaccines and COVID and the
Speaker:present. Like there's all kinds of emotions. There's a lot of other things around that,
Speaker:right? There's a lot of other things around that. Exactly. That maybe couched
Speaker:people's perceptions, but, or
Speaker:maybe actually like because of that, and this is,
Speaker:this is where data and math, I think, plays an out—
Speaker:like should be playing an outsized role. Is
Speaker:despite your emotions and your feelings, the
Speaker:math doesn't care about it. And I think that is one of the lessons
Speaker:is the numbers are what they are and
Speaker:interpreting them, you got to do it with like an unbiased hat
Speaker:on or whatever. And, and I think society was just not
Speaker:ready for that and probably still isn't. But to your point, Frank, about like
Speaker:AI is making things more probabilistic, I hope so. Yeah. Because the world is
Speaker:probabilistic, believe it or not. And— Right. And it's good
Speaker:for the consumers, you know, because AI is not just this
Speaker:B2B, like enterprises use AI. Consumers are using AI
Speaker:and they're using it in their chats and in their, you know, different apps.
Speaker:And I hope that they understand that they're engaging
Speaker:with a technology that is not guaranteed to give them the thing that they
Speaker:expect whenever they hit refresh. or they rerun it. And that
Speaker:says something really important. There's a really important point there.
Speaker:And even if they don't understand transformer architecture and all the rest of it and
Speaker:neural nets, it's still, I think my hope
Speaker:is that the next, our generation's lost, right? But I hope like my
Speaker:kids' generation that they grow up just appreciating
Speaker:that things are random and we have to deal with that fact.
Speaker:And so, Yeah, I always come back to the COVID example
Speaker:of like, at least for me, this was like the first example of like
Speaker:people just could not grapple with the fact that what the expert, what the
Speaker:government was saying in terms of effectiveness was different than their
Speaker:personal experiences. But that's okay. I mean, that's true,
Speaker:that's gonna happen. But what do you do with that? And— Well, that's
Speaker:why I think communication and data visualization is very
Speaker:important because it tells a story, right? The math will tell you the facts, the
Speaker:raw facts, But the raw facts are not interesting. Let's be real,
Speaker:right? Like, if you look— Totally. Okay. Um, you always see
Speaker:it packaged into neat infographic. And one thought I had while you were talking
Speaker:about numeracy at the population at large, you could probably
Speaker:tell how numerate a society or strata of society
Speaker:is— stratum, whatever the singular strata is— by how
Speaker:often they buy lottery tickets. Because I think if people became more
Speaker:numerate, the lottery system would collapse overnight.
Speaker:Yeah. Interesting. You think that would be the case? Because I know a lot of
Speaker:numerate people. So, so I actually debate this with my
Speaker:wife, who actually does have a degree in math. And I'm like, look, if it's
Speaker:a billion-dollar jackpot, $1 or $2 for one
Speaker:ticket, I'll get one ticket. But I'm talking about the people who buy like 50
Speaker:tickets, you know what I mean? Like, yeah, yeah. Okay. It's like, because like my—
Speaker:the effort to go from zero To just slightly
Speaker:above zero. Yeah. Versus
Speaker:the burn versus the opportunity. In my mind, once it
Speaker:hits $700 million and up, it's like, hmm, I see the sign as I
Speaker:drive around and I'm like, hmm, you know, but if it goes over a
Speaker:billion, then it's like, well, you know, there's zero and there's slightly
Speaker:more than zero, right? But I don't have fantasies. And I know people
Speaker:that grew up with that would just buy lottery tickets every week. play in the
Speaker:same numbers. And I, even then I'm like, random doesn't work that way,
Speaker:but they didn't want to hear any more smartass comments from me.
Speaker:Yeah. Well, I think so. So one of the things that's really
Speaker:important in this kind of conversation, to your point, is
Speaker:when I think about probability and statistics, I think about, you know, the term
Speaker:expected value, right? Which is the probability of the thing
Speaker:and its kind of impact. So I think those 2
Speaker:things are really important. I mean, you can't think about
Speaker:one without the other because you're right, who cares? Probabilities are very
Speaker:abstract and there's 80%, 20%, but what is the
Speaker:impact of the thing? So if the impact of the thing is you win $1
Speaker:billion, well, that changes
Speaker:how I think about the probability. And if it's, you win, you know,
Speaker:$100,000 and, you know, I don't know, maybe it's not worth it as much. Like
Speaker:it's probably not worth Burning the gasoline to go to the corner store. Exactly. Well,
Speaker:you live in Brooklyn. It's not worth the calories of— It's not worth it. Yeah.
Speaker:Although it's good to walk. Yeah, that's true. Yeah,
Speaker:yeah. But, um, but no, that's interesting. So I,
Speaker:I have one comment on the last bit, and then I want to return to
Speaker:what you said earlier about the numeracy
Speaker:conversation. I've always heard that lotteries are a
Speaker:tax on people who are bad at statistics. I've heard
Speaker:that. That's kind of cute. Yeah. And, um,
Speaker:but one of the things that I said in your, your conversation about
Speaker:numeracy reminded me of it. As a,
Speaker:a person who's led, I led a team of 40 ETL
Speaker:developers at Unisys Corporation for 2 and a half years.
Speaker:And one of the things I shared with several of them
Speaker:were math majors. As I said, you know, my take on
Speaker:statistics, especially applied to management
Speaker:principles, which I see a lot of disconnects
Speaker:there, speaking of innumerable, I would tell
Speaker:my directors as I was a manager that I had this saying,
Speaker:we can use statistics about everything to do with
Speaker:people except people.
Speaker:Interesting. What do you mean? And I
Speaker:think the way you expressed someone catching
Speaker:90% of some disease is probably
Speaker:the best way to articulate that. They
Speaker:don't experience 90% of a disease or even 51%.
Speaker:It's as you said, it's a Boolean,
Speaker:it's a switch, and it's either you've got it or you don't have it.
Speaker:And I think that I, as an electronics
Speaker:engineer, I refer to a lot of things as an impedance mismatch.
Speaker:And I think that's, you know, that's my word, my engineering word for disconnect.
Speaker:Or, you know, there's other words, cognitive dissonance,
Speaker:for that. I think that's what fuels that, is our experience
Speaker:doesn't match what the numbers appear to be telling us,
Speaker:or perhaps the way we're interpreting or maybe even
Speaker:misinterpreting the concept the numbers are expressing.
Speaker:And I love that example. I'm going to use that.
Speaker:Yeah. Yeah. Yeah. Feel free. Feel free. I can talk about probability
Speaker:and statistics for a while. It's a, I think it's a very interesting topic.
Speaker:It applies. It's the most practical, I think, mathematical
Speaker:topic out there just because it exists whether You
Speaker:want it to or not, it's everywhere. And, you know,
Speaker:if you don't, like, I feel, I sometimes feel bad for folks who get
Speaker:intimidated by charts and graphs and scary numbers.
Speaker:And because math and statistics in particular,
Speaker:I don't think it's taught very well in school. I think
Speaker:it's very dry. It's super boring. Like, what the hell is a p-value?
Speaker:Like, please get me out of here. Right. All those weird Greek
Speaker:letters and— Yeah. And then you lose people. And then it turns out,
Speaker:you know, a decade later after that class, they realize like, man, I really should
Speaker:have spent more time understanding interest rates and credit
Speaker:scores and so on and all this other
Speaker:stuff. And like, frankly, this is going
Speaker:to sound weird. I'm not into like betting and sports betting and stuff like
Speaker:this. Like, I don't think that's good for society. writ
Speaker:large. But I think some of the most
Speaker:numerate people are like the sports bettors
Speaker:who understand the odds and the over-unders.
Speaker:And they just, a lot of these, and people who play poker and understand. And
Speaker:yeah, I kind of wish that it was something that's a little bit, that was
Speaker:a little bit less toxic. But they're like, it would be
Speaker:great if there are other spheres of society in which
Speaker:folks who participated, who otherwise are
Speaker:not, you know, into numbers and, you know, aren't mathematicians
Speaker:or, you know, kind of anything like this, but they were just interested for the
Speaker:sake of a game or for the sake of a community or for the sake
Speaker:of spending their time. And it forced them to have to understand this
Speaker:language because those folks get it. They're super, they're whip
Speaker:smart. They understand how to make decisions. They understand risk
Speaker:management. And, and yeah, so like every time I talk to somebody
Speaker:who does like sports betting or anything like this, like they just get it really
Speaker:quickly. And not 'cause they studied p-values and
Speaker:probability distributions, it's like they wanted to partake in this
Speaker:activity. In order to do that, you do it over and over and over and
Speaker:over again, and you build up an intuition and you kind of just see through
Speaker:the numbers. I think, I think that's— That's a great way to put it.
Speaker:'Cause like I was listening to the audiobook version of Casino.
Speaker:which is obviously that famous movie with De Niro and Sharon Stone
Speaker:and Joe Pesci, right?
Speaker:Fantastic. But in the audiobook,
Speaker:there's a whole segment where the guy, I think his name was Frank, which
Speaker:is kind of funny, was talking about how he gathered all of
Speaker:his— there's a whole segment. He goes on a soliloquy about how like he knows
Speaker:more about the team than the coach does, right? He knows if the head football,
Speaker:the head quarterback has had a fight with his girlfriend or like his mom's
Speaker:got cancer. Like he knows all of those extra variables. And that's
Speaker:what made him— he credited like that level of depth and knowledge and
Speaker:almost spycraft into enhancing his odds, which is why
Speaker:it's in the movie, why they kept him alive. It's because he was
Speaker:really good at that. Yeah, yeah, yeah, exactly. You know, and
Speaker:then there's like less maybe challenging kind of,
Speaker:um, uh, or, uh, pernicious examples like Moneyball
Speaker:is maybe like the classic, right? That's another one. Yeah, yeah. Yeah. Right. And it
Speaker:kind of broke through to the mainstream a little bit. Now there is a bit
Speaker:of a backlash, I would say, for analytics in sports. I don't know if y'all
Speaker:are Knicks fans. Frank, you might be. Kind of. Yeah. Yeah. But they had a
Speaker:great year even though they weren't supposed to. So that's exactly right. They weren't
Speaker:supposed to. And I forgot what, what, what, which coach said it
Speaker:could have been the Sixers or the Cavs, one of those series or the
Speaker:Hawks. But he basically said like, analytically, we beat them.
Speaker:This is after they had lost to the Knicks. He's like,
Speaker:analytically, we beat them. Or it could have been analytically, we should have won, but
Speaker:it was something like this. Right, right, right. I kind of take offense to it
Speaker:because I'm like, no, no, you're giving analytics a bad name because now nobody's going
Speaker:to give— nobody's going to care about
Speaker:analytics when you say something like that because they're like,
Speaker:well, I don't care about your numbers because the Knicks won against the odds. Right?
Speaker:And then it just so happened that they kept winning against all the odds,
Speaker:like all the time, which was wild and very exciting.
Speaker:But yeah, sometimes analytics can go too far, right? You stare at
Speaker:the numbers and you say like, this must be the truth
Speaker:because I ran the model, I ran the numbers, I ran the simulations, and
Speaker:this is the most likely outcome. And it turns out like, well, the world
Speaker:doesn't care about your model or your simulations. Right. It's gonna do what it does.
Speaker:And there is randomness going back to probability and statistics,
Speaker:right? And you don't control that and stuff
Speaker:happens and you just have to keep moving. And so
Speaker:there's like a dogmatism with analytics. Yes. That I think we need
Speaker:to move away from and we have been, you know,
Speaker:despite as data-driven as you want to be, as much as you wanted the
Speaker:numbers to drive all the rest of it, Spoken
Speaker:as a data person, the numbers are actually a
Speaker:data point. There's like a meta-analysis here where the data
Speaker:is the data point. It doesn't matter how much data you have, whatever it is,
Speaker:is a single data point. You know, another data point, qualitative
Speaker:interviews of your customers. Another data point is the
Speaker:intuition that you and your board or your executive team or your product man,
Speaker:like, you know, the experts in your company, their intuition and their gut.
Speaker:is another data point. Another data point is the story you want to tell
Speaker:your investors or the story you want to tell your team, right? So
Speaker:you get all, and then there's exogenous data points. So you get all these data
Speaker:points together into your decisions. That
Speaker:to me is data-driven, not whatever the model says
Speaker:we're going to blindly follow. Right. And I think that is an important check
Speaker:on On analytics, on data. Spoken as, you
Speaker:know, again, spoken as a data person. I think that's a great way to put
Speaker:it, right? The numbers are always a model of reality. It's not reality. Reality is
Speaker:something we are unable to simulate as of
Speaker:today and probably for the next decade or two,
Speaker:even then. It's that whole map versus the
Speaker:terrain. It's the map, not the territory. So
Speaker:tell me about paradox machines because I'm sure there's Knowing your mathematical
Speaker:background and goes this deep, you must have a good reason for that name.
Speaker:And tell me about that. Yeah. So,
Speaker:so the name, so I'm, so we're building Perplexity inside of
Speaker:a holding company called Infinity Constellation. And they, they
Speaker:do AI services companies. So that's, they're kind of incubating us as we grow.
Speaker:The chairman of that company is very opinionated with when it comes to
Speaker:names within that, Within the Infinity kind of family.
Speaker:And I was opinionated as well. So we had a really good, and he's a
Speaker:kind of a philosopher type. So we had a few good conversations around it
Speaker:and we both mutually landed on paradox. And
Speaker:for me, data, AI, everything that we're in right now is a
Speaker:paradox, right? It's exactly the conversation that we're having.
Speaker:There is data everywhere, but you know, there's noise everywhere
Speaker:and we're searching for the signal. Yeah. Yes. Right. AI at once
Speaker:will create new products
Speaker:and new job opportunities and revolutionize the world.
Speaker:And it's this kind of like quote unquote savior complex we have. And at the
Speaker:same time, it's gonna take our jobs. People
Speaker:hate it. Young people in particular hate AI, but it's getting shoved down our throat.
Speaker:It's also stupid and dumb and like always gives me the wrong
Speaker:answer in my chat. So we have to hold these competing truths at the same
Speaker:time because both happen to be true, right? Yeah. And I
Speaker:think that there's data and AI, I think there's this really interesting paradox.
Speaker:So we both landed on Paradox, both as a brand that
Speaker:we both believe in and I really like it as a play
Speaker:on, you know, it's kind of fun, right? It makes you think a little bit.
Speaker:It's a bit whimsical. It hearkens back to, you know, the Greek tradition
Speaker:and I'm kind of a I don't know, also a philosopher type.
Speaker:And I like to think about the foundations of our knowledge or foundations
Speaker:of decision-making, right? When coming back to data and statistics.
Speaker:So that's kind of how Paradox was born, if that makes sense.
Speaker:Very cool. And your model is you embed it, you embed a
Speaker:full team and like do the full stack for an organization? Yeah.
Speaker:That's interesting. So would you call yourself a consulting firm or are you trying to
Speaker:avoid the C word? No, you know, I'm not necessarily trying
Speaker:to avoid it, but we do more than consulting. So just like
Speaker:very quick history. So I did my actuary stuff. I was a data scientist.
Speaker:I started leading data teams in various startups across
Speaker:different verticals. I joined a friend of mine, started a consultancy called
Speaker:Brooklyn Data, and that was a very successful consultancy
Speaker:where we did a lot of Snowflake implementations, kind of modern
Speaker:data stack circa:Speaker:was, when the modern data stack was ascendant. It's kind of peaked
Speaker:in '23 and has been on a decline in
Speaker:various regards since then. That company was sold to a
Speaker:private equity-backed company. He left, I kind of took over the data
Speaker:team. I then left and consulted for myself and then got
Speaker:the idea for Paradox and kind of got in touch with Infinity. So
Speaker:that was, that's kind of the arc of my career in a nutshell. And so
Speaker:I have the experience of leading teams and doing kind of on-the-ground
Speaker:work as a practitioner. I have the experience as a consultant at Brooklyn
Speaker:Data and implementing other people's technology, right? So the
Speaker:Snowflakes and the Databricks and the Tableaus and Sigmas and all the rest
Speaker:of it, and the Azures and the Fabrics of the world as well.
Speaker:But we never had our own platform. Right? We are a pure consultancy.
Speaker:So with AI, I wanted to take a stab at
Speaker:building a— and there's plenty of platform companies. There's a lot of SaaS tools out
Speaker:there of various flavors. Before AI, it was
Speaker:always very expensive and fraught and a long endeavor to build your own
Speaker:platform, right? To build your ETL and your storage and compute and your
Speaker:orchestration, your security, and all the rest of it, all the good stuff that we
Speaker:want in our data platforms. With the rise of AI
Speaker:and coupled with experts. So my team are all like
Speaker:staff level, like really senior engineers and myself who, you know, I'd
Speaker:like to think that I know what I'm doing as well. I wanted to take
Speaker:a stab at building a platform, but instead of having to
Speaker:raise tens of millions of dollars over the course of several years
Speaker:to try to stand up a platform, we would build it with AI.
Speaker:And it turns out if you know what you're doing, And you have some funding
Speaker:and you have some use cases, some customers who can't
Speaker:afford a Snowflake and a Databricks and a Fabric, can't afford to
Speaker:hire a team of engineers, can't afford that VP of data and AI
Speaker:who's gonna, you know, do the strategy and the change management.
Speaker:They can't afford all that. But that's the cost of entry.
Speaker:It turns out that with AI, you can build them a
Speaker:cost-effective platform. With AI, you can deliver
Speaker:services with margins that both support your
Speaker:business and they can afford, and it's still a sustainable business.
Speaker:Now that is a really interesting proposition and that really hasn't happened
Speaker:up until, you know, AI was capable. And that's, you know, as of maybe
Speaker:a year or two ago. So we started Paradox and this model of
Speaker:services and platform is rare. There's a lot of services
Speaker:companies, There's a lot of platform companies.
Speaker:There's a few that do both, Palantir being maybe the most
Speaker:popular among them, and they've had a 15-year-plus head start
Speaker:and really paved the way for what these companies can do. Popular is an
Speaker:interesting word to use with them, but widely known
Speaker:might be a safer word. Yeah, widely known. I'm not going to touch that. That
Speaker:is the third rail of this industry. But yeah. Yeah, maybe
Speaker:notorious. That might work. That's a little harsh,
Speaker:but yeah. Widely known is a nice, safe, neutral. Exactly.
Speaker:They are widely known. Again, put your thoughts and biases and
Speaker:emotions aside. It's like facts on the ground. They're widely known.
Speaker:And anyway, so I wanted to, and I have a lot of
Speaker:feelings about the services industry and consulting as a business model. And I think that
Speaker:the billable hour model is going away. I think we're seeing that with Accenture stock.
Speaker:with stock price decline. I think we're seeing that with BCG and
Speaker:McKinsey and how they're reimagining how they're
Speaker:doing delivery. I don't think consulting goes away as a
Speaker:function. I think that industry is here to stay and I think
Speaker:it'll still be thriving. But I think how services are being delivered needs
Speaker:to change because of AI. And I'm— and I was very
Speaker:interested in building a company from the ground up
Speaker:which was a services company. So I'm not afraid of the services word. We are
Speaker:a services company, but we don't just do consulting and we don't just
Speaker:configure other people's technology. We can build our own
Speaker:technology and we can build it in such a way, as I said, that is
Speaker:affordable for you and doesn't
Speaker:pretend to be the be-all and end-all. Like, I'm not pretending
Speaker:to rebuild Databricks. Like, that is a massive company
Speaker:with hundreds of billions of dollars and All the rest of it. But the
Speaker:mid-market, which are smaller companies, not
Speaker:sub-enterprise scale, they don't need a
Speaker:Fabric or a Databricks or a Snowflake, you know, not
Speaker:yet anyway. Maybe they will eventually, but they don't need all that machinery,
Speaker:but they're left with a, you know, what, there's no middle ground. What
Speaker:do I do? Right. So that's kind of the idea is to
Speaker:solve their problem both with the technology, but also with
Speaker:services, because they need a partner. They need a partner that's not going to rake
Speaker:them over the coals, that's not going to keep charging them billable hours and
Speaker:scope creep and all the rest of it. So it's been a very
Speaker:successful endeavor so far. A lot of traction, a lot of organizations
Speaker:like what we're, you know, what we're producing. So yeah, it's been a fun journey.
Speaker:I absolutely love your focus on, you know, small to medium
Speaker:businesses, SMBs. That's where my software company is
Speaker:targeted as well. And I see what you
Speaker:see in kind of an emerging
Speaker:application. And I'm intrigued.
Speaker:I'd love to chat with you maybe differently than
Speaker:publicly on the podcast here about your experiences
Speaker:and what you see, especially given your statistics-driven mind
Speaker:about that. I have notions. But I wouldn't call what I
Speaker:have innovation. And I'm building based on those
Speaker:notions. You talked about considering the risks, counting the
Speaker:costs earlier and stuff like that. My MO,
Speaker:because of just me,
Speaker:is, you know, damn the torpedoes.
Speaker:That's kind of a, got this idea, I'm going to go with it. I'm
Speaker:that person you were warning us about earlier. Not
Speaker:considering the the error bars at all.
Speaker:And I'm trapped in here with me, Elon, so I don't really have a
Speaker:choice to do that. I had to pick a path and run down it full
Speaker:speed ahead. And every now and then, you know this, even if the error
Speaker:bars say don't do this, sometimes the nicks win.
Speaker:100%. And, you know, something that I tell folks as well, and this
Speaker:goes back to the conversation we're talking about, You gotta make a decision. Sure.
Speaker:And, and, and you can't always trust the numbers or like, I shouldn't say trust
Speaker:the numbers, make a decision based on them. I believe this to be true, and
Speaker:this kind of undercuts what I do, but I'm a pretty
Speaker:honest broker, I'd like to think. Sure. Is there have never been
Speaker:massive step function types
Speaker:of decisions based on
Speaker:data. They, there is no Fortune 50 CEO
Speaker:that is out there deciding something meaningful
Speaker:and thinking, well, what do the numbers say? Again, the numbers are, are
Speaker:a data point, but they talk to, again, the board. They have their
Speaker:intuition. They just believe something to be true
Speaker:and they push forward. And, you know, you can torture the data to tell you
Speaker:whatever you want it to say. And I don't think you should do that, to
Speaker:be clear. But I'm real with myself, right? I'm not
Speaker:pretending that, hey, if you're a small to medium-sized
Speaker:company and you have your dashboard and your data, there you go. Now you
Speaker:can compete with the big guys. It's like, no, like now you can make better
Speaker:decisions and now you can have more, you can have more tools
Speaker:in your toolkit. You can have more confidence and you can have more
Speaker:remediation measures and all the rest. Like this is a net good, don't get me
Speaker:wrong. But it's not that now that you have the
Speaker:data cleaned, you are going to— it's going to solve your problems, right?
Speaker:Like big decisions are still going to be made. I
Speaker:believe this for better or for worse, based on
Speaker:what important people at your company.
Speaker:It's the HIPPO thing, you know, the highest paid person's opinion. Now, I don't like
Speaker:it and I don't think it's necessarily the highest paid person, but I'm not
Speaker:deluding myself into thinking that like, oh, data is what drives
Speaker:Really fundamental. Again, like on the margins, it drives a lot of things, or it
Speaker:should. But when you have to like pull the trigger or you have to
Speaker:push the button to do the thing,
Speaker:it's gonna be based so much on your intuition, your instinct. And because you as
Speaker:a CEO or you as the like important person in the room, that's what you're
Speaker:paid to do. This is what I tell managers. This is what I tell a
Speaker:lot of people that I coach often when they're like, oh, should I hire this
Speaker:person or that person? Or should I structure my team this way? And that
Speaker:was like reasonable questions. You can make a case for either side.
Speaker:You know, you can look at the data, but ultimately you've been hired and been
Speaker:elevated to and put in this position to make the hard
Speaker:choice. And you gotta make that choice.
Speaker:And that's what I feel. Sorry, I kind of forget how we got on this
Speaker:topic, but— That means it's a good show. Like, at least—
Speaker:yeah, but that's kind of how I feel about the most important decisions are
Speaker:You just like, you do it and if it's wrong, maybe
Speaker:you get fired. You know, like, sorry, that's just the cost of making
Speaker:important decisions sometimes. Yeah. I mean, that's the
Speaker:risk-reward function at play. Exactly. Exactly. For good or for
Speaker:bad. So we are, we could talk to you for another hour or two, but
Speaker:we want to be respectful of your time. Where can folks find out more about
Speaker:you and Paradox? paradoxmachines.com.
Speaker:is a great place to read up about us. My LinkedIn,
Speaker:which you can just, you know, LinkedIn my name, I should pop up there. I
Speaker:try to be active there. Those are probably the 2 best. If
Speaker:you have any cyclists or runners, you can check out my Strava.
Speaker:I'm pretty active on the Strava app. And
Speaker:yeah, that's where you could find me. Excellent. With that in mind, we'll
Speaker:let the AI finish the show. Or the theme
Speaker:music. I haven't decided how I'm going to edit this. Thanks for your time, guys.
Speaker:Hey, thanks. Thank you. Hey, thanks, man.