The Curiosity Current: A Market Research Podcast
Human-powered sampling in the age of ai with Lisa Wilding Brown
March 24, 2026
AI is accelerating research, but it isn’t replacing human judgment. In this episode of The Curiosity Current: A Market Research Podcast, Molly Strawn-Carreño is joined by Lisa Wilding Brown, CEO at InnovateMR. They explore what “data quality” really means in today’s environment of AI-powered tools, hybrid methodologies, and increasing fraud risk. Lisa shares why there is no silver bullet for quality, how respondent experience directly impacts insight integrity, and where human-powered sampling still makes the difference between surface-level metrics and meaningful foresight.
AI is accelerating research, but it isn’t replacing human judgment.

In this episode of The Curiosity Current: A Market Research Podcast, Molly Strawn-Carreño is joined by Lisa Wilding Brown, CEO at InnovateMR. They discuss hybrid research methodologies, human-powered sampling, and how to protect data quality in an era defined by speed, automation, and AI.

Drawing on more than two decades in digital research, Lisa explains why quality exists on a spectrum and why fraud is only one piece of the equation. From survey design and respondent experience to field time compression and incidence rates, she outlines the trade-offs researchers often overlook when prioritizing speed. With nearly half of global online traffic estimated to be non-human, Lisa emphasizes that quality is a shared responsibility between researchers, sample providers, and technology partners.

The conversation also explores the strategic thinking behind InnovateMR’s acquisition of Ivy Exec and the growing demand for hybrid qualitative and quantitative solutions. By integrating expert networks with large-scale sampling, research teams can move beyond isolated data points and toward more holistic, forward-looking insights.

As AI continues to reshape workflows, Lisa offers a pragmatic perspective: treat AI as fit-for-purpose. Use it to remove repetitive tasks, accelerate iteration, and enhance operational efficiency. However,  reserve high-stakes decisions for real human context and validation. AI can sharpen processes, but empathy, nuance, and trust remain fundamentally human.

The episode closes with a personal reflection on curiosity, risk-taking, and career growth. From aspiring journalist to CEO, Lisa shares why growth never happens inside your comfort zone. She emphasises how doing the hard, uncomfortable things often creates the greatest professional acceleration.

What You’ll Learn:
About the Guest:
Lisa Wilding Brown is CEO at InnovateMR, a global sampling and data collection company focused on delivering high-quality, tech-enabled research solutions. With more than two decades in digital research, Lisa has played a pivotal role in advancing online methodologies, panel development, and hybrid qualitative-quantitative approaches across the industry.

She is an Insights Association Laureate, a former member of the SMAR Council, and a founding member of the Multicultural Insights Collective. Lisa also serves on the boards of WIRE and SampleCon, has been named to the Insight250 list, and was recognized as an MRS Research Hero in 2021.

Known for her focus on data integrity, respondent experience, and human-powered sampling, Lisa is a respected voice on the evolving intersection of technology, AI, and research quality.

Episode resources:


 The Curiosity Current: A Market Research Podcast is handcrafted by our friends over at: fame.so

Transcript

Molly 0:02 Today on the Curiosity Current, we are joined by Lisa Wilding Brown, CEO of InnovateMR. Lisa has spent more than twenty years advancing the future of online research from building global panels at USAM to leading Innovative Mars evolution into a powerhouse of high quality tech enabled sampling. To name just a few of her incredible achievements, Lisa is an Insights Association Laureate, a former member of SMAR Council, a founding member of the Multicultural Insights Collective, sits on the board of directors of WIRE and SampleCon, was on the Insight two fifty list, was a recipient of the Global Research Business Network's participant excellence program, and was named an MRS research hero in 2021. Okay. I gotta, like, take a breather after that. Wow. Uh, so in this episode, we'll be exploring how hybrid research methodologies are reshaping the industry, why respondent experience remains a business advantage, and where human driven sampling fits into the world increasingly powered by AI. Lisa, welcome to the show.

Lisa 1:04 Oh, thank you, Molly. It's great to be here. Thanks for having me.

Molly 1:07 And I am also personally so excited that, uh, Lisa is joining us here today. Um, we had the privilege of working together a few years ago during my tenure at at Innovate, and, um, I grew out of my shell a ton more and felt more confident to take on big things under her tutelage, and the trajectory of my career was absolutely helped by this woman. So I am so excited to have you on.

Lisa 1:32 Uh-huh. Molly, thanks so much. That means a lot. That's everything to me. It's just getting to work with great people like you. So I'm really glad you had such a positive experience, and it's great to be on your show now. I love to see where you're going and evolving. This is awesome.

Molly 1:45 Yay. Okay. I know we can catch up a ton, so we're gonna have to hang out afterwards. Um, Um, but let let's jump into the question. So to start us off, you know, we mentioned earlier that you have spent more than two decades shaping how data is collected, evaluated, and scaled across this digital research industry that we call home. So before we we dive into the nitty gritty, how do you personally define quality insights in a landscape that continuously is demanding faster data, but also deeper answers at the same time? re than two decades shaping how data is collected, evaluated, and scaled across this digital research industry that we call home. So before we we dive into the nitty gritty, how do you personally define quality insights in a landscape that continuously is demanding faster data, but also deeper answers at the same time?

Lisa 2:16 Yeah. Yeah. I mean, we probably don't have enough time for this all things quality. But, you know, I've been in the space since the early two thousands, and I started in the industry during a really interesting time when a lot of, we call it, traditional research, which had been done in person, via caddy, on phone. Mhmm. Even paper surveys were still a thing back then. A lot of that was migrating to this new world of of online research. It was really at that point kind of a a real untested methodology. And so my role in those early days was to work closely with the methodology team, do a lot of research on research, and help really convey to clients that, uh, the online world was was was, uh, an area that we could really expand, uh, and and get the benefit of of so many aspects of just the user experience and and and delivering agile research, uh, insights so much quicker than I think what historically had happened. And so it's been really interesting to sort of see that journey and see the online world really take hold.

Molly 3:23 Mhmm.

Lisa 3:23 Um, so I'm dating myself now, certainly, but, uh, quality has really evolved, I would say, uh, quite a bit. You know? And I've often talked about quality existing on a spectrum. Right? When you talk about what is a quality insight, uh, and what are threats to quality.

Molly 3:40 Right. I Mhmm.

Lisa 3:23 Um, so I'm dating myself now, certainly, but, uh, quality has really evolved, I would say, uh, quite a bit. You know? And I've often talked about quality existing on a spectrum. Right? When you talk about what is a quality insight, uh, and what are threats to quality.

Molly 3:40 Right. I

Lisa 3:40 think there's a lot of different flavors. I think, you know, most of the time, folks immediately go to the blatant elephant in the room, which is the cyber fraudsters, those professional survey participants that are leveraging technology, uh, that historically had very sophisticated skills, but I think there's been a democratization to survey fraud in in recent Mhmm. The the, um, increasing, um, penetration of of AI and all things AI. Uh, I think that helps to accelerate fraud, uh, in many ways, but that's just one angle. Right? We could talk a lot about the threats of survey fraud and professional survey participation, but there's also a lot of other permutations or elements to consider, and that's the user experience. Right? What is the participant seeing? What is that survey engagement, that instrument look like? How is it engaging or not engaging them? Uh, and then on the other end, you just have kind of, like, natural duplication that can exist if you're multi sourcing, which I think is becoming more and more a common practice as clients are reaching out for very hard to reach low incidence population. So I think the net net, Molly, is that there's a lot of different challenges to delivering a quality insight, and it starts with certainly working with great partners that understand best practices around, uh, survey research. Uh, we're very proud here at Innovate. We just announced our ISO certification for 02/2001 as well as Congratulations. Um, we're really thrilled about that, but I think it's about, you know, not just saying that you are compliant with these best practices, but actually going through the process of certification, um, putting your your your money where your mouth is and really walking the walk, uh, is is so critical. So working with great partners to help guide you is, I think, mission critical item number one. Um, so, you know, partnering with the right folks, uh, but, you know, certainly looking at what are you trying to address, what business problems are you trying to solve for, what are your recent really making sure that the why matches the then the recommended methodology and the strategy that you're gonna be employing is so key. Um, and then it comes down to the brass tacks of data collection. The the sample that you're using, the audiences that you're looking to go after, the survey instrument itself, the design of the survey is just so critical. Uh, and I wish I could tell you that surveys look a whole lot different than what they did when I started back in the early two thousands, but I would say that there's still a lot of really traditionally designed surveys out there. Mhmm. They're pretty long in nature. There's still a lot of surveys out there that are over twenty minutes. They may be aren't as well optimized for mobile devices, for example. Um, these are all really things that I think as an industry, we need to continue to pressure test. Uh, and, certainly, there's a lot of great companies out there that are doing some cool new things. Uh, but in terms of being fully embraced, that's always something that I think is is pretty challenging. Uh, you gotta monetize those new products. Uh, you can't just have kind of that shiny product that looks cool and Right. Is more engaging for a participant if you're not able to to really get the traction from a client perspective. So I think there's a lot of discussion that has that needs to happen and a lot of socialization and education that needs to happen, but it really runs the gamut. But I think it all it all starts with the partners that you, um, get together with, the the the design of the research, and really thinking about the participant experience. Mhmm. Really making sure that the participant is front and center in all the decisions that you're you're making as you design your work. e gamut. But I think it all it all starts with the partners that you, um, get together with, the the the design of the research, and really thinking about the participant experience. Mhmm. Really making sure that the participant is front and center in all the decisions that you're you're making as you design your work.

Molly 7:25 Yeah. And I I personally know how challenging that those ISO serves can be because we we're doing, uh, we've just been approved for the same ones here at AYTM. And it yeah. It was a it was an extensive process, but a super important one to ensure that we have those quality of insights. Um, I feel like to your point, we could go a billion different directions with all of that and drill down into so many things. Um, but I wanna zero in on partners, specifically Innovate's acquisition of Ivy Exec, um, which feels like a signal to the whole industry that this future is not necessarily just about speed or just about depth, but rather it's a really important and dynamic balance of both. So what what kind of problems do you believe that this merger was solving specifically, um, for certain positions, um, that you guys are now tackling?

Lisa 8:17 Yeah. I know. It's a great question. We came together with Ivy Exec a few years ago. And to me, it was just the perfect marriage, and it continues to be a a great, uh, a great marriage. Um, we're all fully integrated now. And, you know, I think anytime you make an acquisition, it's really important to think about the culture of the business, the ethos of the business. How aligned are those two companies? Can they really come together to offer a a great solution for for clients and partners? It's one of those situations like one plus one equals three.

Molly 8:48 Right.

Lisa 8:49 Know that you're really adding more value by coming together. And what we were seeing in the market, obviously, Innovate historically had been a quantitative sampling global firm, but really focused on quantitative solutions across a wide variety of different audiences. Anytime you sell sample, you really have to be good at finding all types of of audiences, whether it's consumer or health care or certainly b two b, which is, I think, a core specialty, uh, an area of expertise for us from a quantitative standpoint. But we are missing the qualitative solution.

Molly 9:18 Right. Anytime you sell sample, you really have to be good at finding all types of of audiences, whether it's consumer or health care or certainly b two b, which is, I think, a core specialty, uh, an area of expertise for us from a quantitative standpoint. But we are missing the qualitative solution. Right.

Lisa 9:19 And what we were seeing from a lot of clients was that they were working with one vendor for qual and another vendor for quant, and sometimes a lot was getting lost in the fray. Um, and and by bringing those two those two methodologies together, we're really able to offer more of a hybrid solution where we're using Ivy's expert network, which is an incredibly, um, high quality asset for the business. Uh, it's a multimillion membership, uh, of of true experts who participate in whether it's thirty minute or sixty minute IDIs. They participate in advisory councils, uh, some more longitudinal engagements. We've done, um, community recruitments, whether it's a short term community or a long term community. Um, but the idea really is about finding that true expert that is high quality that you can get on a video call with or get on a phone call or even meeting a focus group facility to really glean deep, deep insights that are not only telling us what's happened, but most importantly, what's going to happen, that foresight, uh, that only true industry experts can give you. So I think the idea is now is, like, a lot of clients were coming to us with this challenge of, okay. I'm working with this vendor for for QUAD, and I'm working with this vendor for QUAD. Coming together really allowed us to offer a more comprehensive and holistic solution where we might start off with some some quality work on the front end that helps to then later inform the quantitative design of a survey instrument or vice versa. So we start with quant, and then we do a deep dive from some of those, uh, participants via qualitative interviewing. Um, and it just really brings and stitches the story together and gives a very, again, number one, holistic view, but just allows our clients to get to a deeper level of insight. Um, and so it's been a really wonderful a wonderful marriage, uh, and we're continuing to grow together and really help our clients think think big, um, and think about the box. And so now outside of just community recruits, we're also doing recruitment for AI models.

Molly 11:26 Oh. Yeah. Interesting. You know? Um, and so it's been a really wonderful a wonderful marriage, uh, and we're continuing to grow together and really help our clients think think big, um, and think about the box. And so now outside of just community recruits, we're also doing recruitment for AI models. Oh. Yeah. Interesting. You know?

Lisa 11:29 I know we're gonna talk a lot about AI. It's a hot topic now in our industry and other industries, but I think it's it's it's really interesting to see that evolution. This idea that, you know, if you are I think historically, a lot of AI is kind of seen as this black box. Right? It's like, what how is that working, and how can I trust those insights? And so what's really important for any LLM is that you have very high quality inputs going into those models to then yield the the high quality output. If it's a garbage in, guess what? It's the garbage out. So, um, you know, because of our focus on quality, uh, I think that's that's been a real answer for for many clients as they start to think about their AI strategy. So I'm excited to see where it goes.

Molly 12:13 That's super interesting. I wanna definitely come back to that because I know we have some stuff later on that while we're talking about AI. Um, but I wanted to go back to what you were talking about about. And and just just a side comment. We've definitely heard in the industry that there's a lot of clients that say, I would rather go with one vendor that is an a plus in something, but then a b in everything else if that meant that I got all my all my research, everything that I needed. They understood the nuances of my needs in one place rather than all these kind of little desperate solutions disparate solutions. Mhmm. Mhmm.

Lisa 12:48 Yeah. No. I think it's always convenient. I mean, I hear that from a lot of clients. I think if you think about it from a sampling perspective, we can't be everything to everyone. Right?

Molly 12:58 Mhmm. I ather than all these kind of little desperate solutions disparate solutions. Mhmm. Mhmm.

Lisa 12:48 Yeah. No. I think it's always convenient. I mean, I hear that from a lot of clients. I think if you think about it from a sampling perspective, we can't be everything to everyone. Right?

Molly 12:58 Mhmm. I

Lisa 12:58 think there are definitely areas of specialization that every company should have and hang their hat on. But I think when you are in the business of selling sample, you have to be really great at finding lots of different types of of audiences. Yeah. Um, so you can be that kind of one stop solution for clients. Um, but I do think there's a lot of multisourcing that's going on in our space. I think a lot of agency clients in particular have a lot of pricing pressures, and so that's certainly something that I think we've all felt, especially over the last few years given Yeah. The dynamics, socioeconomic dynamics of of of our country and and really the the the wider globe, uh, really. Uh, it's just been a weird time over the last few years since the pandemic. I don't know about you, but, like, the last five or six years have just been different than earlier years in in my career. Challenges, and it feels more unpredictable than it might have been, um, in years in years past. Um, but I I do think that clients are feeling a lot of pressure, and so they do go to a multitude of different vendors. Um, but I I'm I know from talking with a lot of clients that that that feeling of being spread so thin across so many different vendors brings a lot of challenges. I think the upside is it gives you a lot of optionality. Um, it allows you to work with specialists when it makes sense. Um, it allows you to make sure that you're you know, got great feasibility and you got great reach. If one vendor lets you down, you've got more vendors kind of in the background that can, um, take the share. So I understand it from a from a business perspective why it makes so much sense. But I I do hear from a lot of clients that many of them are going through this process of really trying to consolidate their vendor and partner list so they can be smarter. They can benefit from that sort of consolidated spend. Um, you know, a lot of companies out there are spending a lot on sample and other ancillary services around sample. And so really being intentional with that spend can help them create savings, uh, create create that sort of repeat partnership where your reports really starts to build. You really start to understand what clients need, how they like to be communicated with, and and then speed is obviously what prevails through that. Right? Mhmm. More efficiency. You become more agile. You deliver insights that much faster for your clients by having those strong partnerships in place. So, uh, I think partnership is is so important. And despite all the technological advancement, whether it's, you know, really advanced algorithms and programmatic APIs or DIY platforms, whatever, you name it. Yeah.

Molly 15:37 I think hat much faster for your clients by having those strong partnerships in place. So, uh, I think partnership is is so important. And despite all the technological advancement, whether it's, you know, really advanced algorithms and programmatic APIs or DIY platforms, whatever, you name it. Yeah. I think

Lisa 15:38 at the end of the day, we all like to work with people, and it's all about the people, whether it's our employees or our clients or our partners. Ultimately, it's about forging really great relationships that you can trust and that you can count on time and time again. So I don't ever want us despite all the focus on tech and AI and all the kinda shiny cool things that we get to do in a digital space, let's not forget what's most important. And to me, it's the people.

Molly 16:05 Absolutely. And that that's not just the partnerships, but I know that Innovate often talks about this idea around human powered sampling. So from top to bottom, it's important to be working with people. And like you said, there's so much tech and automation that's everywhere and is taking over, and people can get very obsessed with the technical, the the automation side of it. So where, uh, what what does it really take to keep that human element at the front and center, especially in panel engagement and when it comes to data integrity? here's so much tech and automation that's everywhere and is taking over, and people can get very obsessed with the technical, the the automation side of it. So where, uh, what what does it really take to keep that human element at the front and center, especially in panel engagement and when it comes to data integrity?

Lisa 16:38 Mhmm. Well, I think you've gotta remember that there's no silver bullet. You know? There's no quick fix. You gotta put in the work, whether it means hiring the right people. How are you vetting candidates that come in through your front door as you're looking to open roles, being really careful and thoughtful around what makes sense. You know? A person can have all the right skills, have a really impressive background, but maybe they're not the right culture fit. You know? I saw something interesting recently. It talked about, um, they called it the UBA framework. And they said as you're looking at staff and the employee experience and the employee value, you've gotta think about it outside of just, you know, doing the actual work. You know? You start to think about people's value and what they bring to the table. You really need to widen the view you have around that output. And so it's really about what outputs are they creating, what outcomes are they creating, what behaviors are they demonstrating, and what attitudes are they bringing to the workplace. So some of those kind of soft skills, we talked about EQ and empathy and, you know, being a great listener, um, you know, and and being sensitive and kind in your interactions. Like, that is so important. So I love this concept, this UBA framework. So o o b a, output, output, behavior, and attitudes when you start to think about what you want out of folks that you might bring on to your team or partners that you work with, um, and thinking outside of just what are they delivering for us as a business, uh, or what are they selling to us as a business. It's really Mhmm. To be seen on a on a much more holistic level. Uh, but I think it really starts with training and development as well. So once you get the right people here, how are you setting them up for success? And what does that training look like? It shouldn't just be two weeks of onboarding, and then our job is done. Right?

Molly 18:37 Yeah. Bye bye. It has to level. Uh, but I think it really starts with training and development as well. So once you get the right people here, how are you setting them up for success? And what does that training look like? It shouldn't just be two weeks of onboarding, and then our job is done. Right? Yeah. Bye bye. It has to

Lisa 18:40 be ongoing education, and that education should vary. It shouldn't, again, just be about the duties of the job. You have to think about some of these other aspects around soft skills that are arguably just as important in a digital world that we operate in as they've ever been. Right? And more challenged, though, because we're both calling, you know, onto this podcast today from our home offices. Right? So we're not in the same room together. And, historically, a lot of that interaction was in person. Uh, and as we've kind of evolved in this in this industry, there's and with COVID certainly, and there's a lot more remote work, which certainly has its benefits for us as people and as moms and wives. Um, but at the same time, I think it puts us on our toes a bit more. We have to be more thoughtful and more intentional on how we show up for each other as colleagues. Uh, um, and so, you know, really focusing on that training and development, that's been something that's been a a really big area of focus for us over the years as well as career pathing. Even when you and I work together, Molly, we used to talk about where are you headed, Molly? What does the future look like for Molly? Right? Like, I am, uh, I'd be naive to sort of say that I expect folks to stay with us forever. You know? I I get a moment with the people that I work with, and that moment could be a year. It could be five years. It could be ten years. I've worked with some people for fifteen plus years. I have a client where we've worked together since 2003. Um, you know, we really know each other on such a deeper level at this stage, and so we shouldn't forget about the people piece. I think that's so important. But also recognize that in this world, whether it's because we're geographically so spread out and or, you know, working in these remote isolated environments, I think it really needs to put all of us on our toes to be that much more thoughtful and that much more intentional on connecting as real people. Um, so to me, that's what that means when you sort of say, you know, keeping it human centered. It's let's not forget that the magic is in the people that we get to work with and partner with, and how do we help them bring their best selves to work and their best selves to an engagement, whatever that might look like. Um, so to me, that's what that means when you sort of say, you know, keeping it human centered. It's let's not forget that the magic is in the people that we get to work with and partner with, and how do we help them bring their best selves to work and their best selves to an engagement, whatever that might look like.

Molly 20:55 Yeah. And I think it's kind of a this remote environment is a little bit of a catch 22. Because to your point, we're we're across the country from each other. And, you know, we've met in person. I could probably count it on one hand even though you've been such a wonderful mentor and friend for all these years. Same thing, um, with a lot of my managers and coworkers at Innovate. And also then here at AYTM, you know, my my direct supervisor is in Arizona, and then I have colleagues at Florida and North Carolina. And I love those people, and I wouldn't have been able to meet them otherwise. You know? Like, if we had just had one office in Los Angeles, I would not know those people. But at the same time, I don't know the depth to them as a person, like, perhaps when I worked in an in person office. So it's it's it it definitely is you get more exposure to people. It obviously widens your your bucket of talent that you can pull from when you're hiring for roles. Um, so it just requires, like, to your point, intentionality about making sure that you're making those genuine connections. But there is a part of me that does kind of miss being in an office and knowing what everybody did over the weekend and, like, to see somebody as a whole person. Because when we're in a meeting, you're bringing your best self to the meeting, and there's normally an objective, and there's normally, you know, something you're supposed to be accomplishing versus, like, do you guys wanna go get Mexican food? You know? Like, I do really miss that as much as I do love being at home and present with my husband and my son. Um, but I don't know. There's a little part of me that does still miss that. and there's normally, you know, something you're supposed to be accomplishing versus, like, do you guys wanna go get Mexican food? You know? Like, I do really miss that as much as I do love being at home and present with my husband and my son. Um, but I don't know. There's a little part of me that does still miss that.

Lisa 22:27 Oh, I don't think you're alone. I think just from talking with a lot of folks across all generations, I think a lot of them have suggested that, oh, it'd be so nice to kind of have more FaceTime. And that's, I mean, that's the thing we really have been focused on is how do we create more opportunities to meet up in person, whether like we had a great off-site with our leadership team last year in Miami and spent several days together, and it was just so nice to meet in person. But also just when we're talking with our sales team, you know, how often are they getting on the road? That's something we talk a lot about. It's like, let's not forget that even though you can do it online and do it digitally, sometimes it makes sense to jump on a plane and go sit across the table from your client or your partner, have a cup of coffee, and talk shop. Mhmm. In my mind. So I think, again, we don't wanna lose sight of the opportunity that meeting face to face can have too. Although, albeit, it's not gonna be as frequent as maybe what it was when we were all in offices back in the day, but I still think those moments can be so rewarding and help to really accelerate business as well.

Molly 23:31 I I always feel like, uh, it's like a celebrity moment for me because I've always seen you on a TV screen. And now I see you in person, I was like, this is a celebrity. I'm meeting a celebrity.

Lisa 23:41 Oh, stop, Mau. Come on.

Molly 23:44 Well, I wanna pull us back to talking about data quality, which is I know your bread and butter, and we could talk about all day. But the industry I feel has never stopped talking about fraud and speeders and bots and declining panel trust. All of those things as we enter new ages. At first, it was DIY, and then it was automated tech, and now it's AI. There's that's still a continuing and evolving concern in discussion. So from your perspective, what's perhaps maybe the most common misunderstood cause of poor data quality? So when we have clients that are going and trying to say, I want the best data that I can get, but perhaps they're approaching it the wrong way or not taking something into consideration. How do you think that researchers can perhaps rethink their role in addressing and fixing those issues?

Lisa 24:33 That's a great question, Moe. I mean, I think the first thing is that there is no magic silver bullet here.

Molly 24:40 Mhmm. hing it the wrong way or not taking something into consideration. How do you think that researchers can perhaps rethink their role in addressing and fixing those issues?

Lisa 24:33 That's a great question, Moe. I mean, I think the first thing is that there is no magic silver bullet here.

Molly 24:40 Mhmm.

Lisa 24:41 Fix if we're talking about cyber fraud and the sophistication of cyber fraud. And, you know, I always go back. There's a couple of stats. Right? There's a report from a company called Imperva. I follow them pretty closely. They put out an annual report every year. Uh, and last year's report indicated that close to 50%. So one out of two clicks online today across the world is not real. It's not a real human being. One out of two clicks. And that's where we're all fishing to find people to participate in surveys. Okay? Yep. Yep. So it's it's a it's it's messy out there. Uh, it's high risk. Um, and that is going to continue to go in a direction that's gonna be challenging. I think point number two, you know, outside of there's no quick fix, is that we all have a a collective interest to make sure that the the data quality that is produced at the end of whatever project you're doing is of the utmost highest quality. And there is a shared responsibility because guess what? None of us are ever gonna solve cyber fraud. Right? So one out of two clicks online isn't real. If you were to quantify the global cost of cyber fraud this is another interesting factoid. First time I saw it, it shocked me. If you were to to quantify that so not just our industry, but across all industry, the global cost of cyber fraud, you were to kind of calculate that as a GDP, gross domestic product. Uh, the third largest third largest economy after The US and China. Like, let that sink in. So we're all fighting the good fight here, but anyone that says they've solved it is being really disingenuous, and you're only as good as your last project. So when I when I talk to folks, it's really about recognizing the realities that it's not going away. None of us can say with confidence that we've solved for it. And so we have to go in eyes wide open. And that starts with education, transparency, talking about it, sharing the knowledge, talking about what those risks are, and really seeing it as a shared responsibility. So we all have a part to play. Certainly, those that are procuring the audiences that go into these have a a huge responsibility and duty of care to their clients. Right? Um, so that starts with making recommendations around sourcing or even methodology. Like, there are certain audience profiles that we'll see from a client. They'll come to us and they'll say, hey. I've been doing this study online. Uh, I've been buying, you know, the sample, uh, through some platforms, and, uh, I'd love to give that to you guys. And I'll give one look at it, and I'll say, this shouldn't even be done online. This should be sourced via Caddy, uh, because you're you're going after such a low incidence population. Mhmm. It really requires that kind of niche, targeted, focused approach. Um, because if you do it online, you're gonna have to cast a really wide net, and you might, again, kiss some frogs to find the prince. Get those sort of false qualifications, false positives that can really create damage in your in your in your survey results. Um, so, you know, thinking about the methodology. And then the other piece too, in that example I gave you, if it's been done online and you're switching to a mode, that has different implications in terms of the survey participant experience. How do you something in an online self administered survey is very different than as you're participating with, um, a phone interviewer and hearing these things versus visually seeing them. So modal changes have a a really big impact on on results as well. So I think it's just really about working through some of those challenges, making sure that you're giving the right recommendations, and helping clients understand what are the trade offs that you're making. So you want this done in two days. Well, this is a really low incidence population, so we're going to have to cast a wider net. Or have you thought about, you know, expanding the field time to ensure that you're getting a more representative sample, uh, that you're taking into account that this particular audience may be more likely or have a stronger proclivity to take surveys after hours or on the weekends. Yeah. You know, there's all sorts of implications, and so I think it's really about, again, working with the right partners who are gonna make the right recommendations, uh, and recognizing that there isn't, uh, a magic quick fix. Uh, and then in terms of what clients can do is, I think, again, being open to feedback, bringing sample providers in earlier in the engagement. I think that's a little bit of one of my pet peeves is that often sample is sort of an afterthought. It's sort of like, okay. My survey is designed. It's programmed. Um, now let's go out and get our sample, uh, and let's get in field today. So I think a lot of times, you know, field collection is compressed. Right? You might take weeks and weeks and weeks to divine the design the survey instrument itself, but you're giving three to five days for data collection. Like, if we sort of step back and think about the overall flow of the project and our objectives, uh, I would challenge that you might wanna reconsider that depending on the audience that you're going for. Faster isn't always better. Faster comes with cost, uh, and trade offs. And I think, again, it's very important to consider that. But I think the ultimate, um, you know, element that clients can help with or anyone that's buying sample is to really think about the design of your survey. What are you asking of respondents? How long are you are you requiring their attention? Keep in mind, at this stage, human attention spans are even less than that of Goldfish. So there's so much coming at us. We're so digitally fragmented, whether it's our tablet, our TV, our computers, our phones. Um, we're constantly being pulled in so many different directions. So I think meeting respondents where they are, keeping in mind that what we're asking of them, do they wanna complete 15 open end responses in a quantitative survey? Or could we reapproach that design and think about that in a different way to still capture great colorful insights, um, but maybe also balance it with what we're asking of participants? I think that that should be more of a focus than what it has been historically. Yeah. 15 open end responses in a quantitative survey? Or could we reapproach that design and think about that in a different way to still capture great colorful insights, um, but maybe also balance it with what we're asking of participants? I think that that should be more of a focus than what it has been historically. Yeah.

Molly 31:09 Absolutely. All I'm thinking when I'm hearing all of this is, wow, it's been a long time since I've worked directly with sample. This is, like, all coming back to me. Um, I wanna pause for a second. I know we only have about twelve minutes. Do you have a little bit of

Lisa 31:25 extra time, or do you have a hard stop?

Molly 31:26 Because if you have a hard stop, we we had I had a couple other questions about, um, mixed method, but I think that you covered it really well. So we can go into I had a question about, obviously, about AI and then some career stuff, but I just wanted to check time wise with you.

Lisa 31:41 Yeah. I've got twelve minutes. So I've got a hard start. I'm at 02:00 now. Yeah.

Molly 31:46 Okay. That's all good. Let's do the AI question. Let's do a little career stuff, and then we'll wrap it up. Okay. Cool. And I think you you mentioned too about humans. We're continuing to go back to the theme of humans being super important, but it's in this world where everybody in our space is racing towards AI powered data collection and analysis. Where do you see that AI is offering a true value to research, but where do you also feel that the line should be drawn in order to protect context, empathy, human nuance, a lot of these important things that's essential for for researchers to be capturing?

Lisa 32:25 Right. Well, just like there's no magic bullet to solve cyber fraud, I don't think AI is the magic bullet that's gonna solve all of our deepest insights challenges. Right? I think it's really about thinking about AI as fit for purpose. You know, there are certain elements where AI can help create more efficiency for our teams, um, can help them reserve the the headspace and the mental bandwidth to focus on other elements of their role that AI can't do. Right? So doing a lot of redundant, mundane activities, to me, that's just right for AI to help supplant those really repetitive, um, processes so that you can free yourself up to focus on the things that are unique, uh, uniquely reserved for the human brain.

Molly 33:13 Yeah. nts of their role that AI can't do. Right? So doing a lot of redundant, mundane activities, to me, that's just right for AI to help supplant those really repetitive, um, processes so that you can free yourself up to focus on the things that are unique, uh, uniquely reserved for the human brain. Yeah.

Lisa 33:15 Uh, so it's about fit for purpose. I think, you know, as AI continues to, uh, get more attention and become more well established, I think it's really about trying to understand where it fits in your repertoire of research solutions. Um, you know, maybe it's more top of the funnel research. So some cut early concept testing, package testing to sort of validate some of these early thesis, uh, you know, and then, you know, go into real research with real humans to then subsequently validate. So it's not sort of choose AI or human. It's how do we marry these two to not only create efficiency, but also, you know, maybe reserving, um, the big burning business questions for human centered sample collection and data collection. Uh, but some of those early iterative pre preconcept ideas, uh, that need further testing can be done through synthetic, for example. Mhmm. Um, you know, I think so it's not a one size fits all. I think it is absolutely fit for purpose. And I saw an interview with Jeff Bezos last year, he was talking about AI more as, like think of it almost like electricity. Like, it's a layer that feeds your entire organization. So it's not like this AI product here is going to be the end all be all. It's really about how do we inject AI into various areas of our business to help, again, help our teams be that much more accelerant in what they're doing and more efficient, uh, and and really deliver better quality outputs, uh, whether it's the interactions they're having with clients or the insights that they're delivering. Um, you know, it's really it's really not an either or. It's it's sort of an and, um, in my mind. And I think it's important to really lean into it, Molly. Like, we've gotta lean into it. I think there's still so many businesses and and folks in the space that I've I've personally spoken with that are are are seemingly a little resistant to it. And I I I worry about leaning in and figuring out how to inject the the the benefits. You know? So for example, we built a tool. I'm sure you remember our text analyzer tool. So this is a tool that we built selfishly for ourselves many years ago, um, to evaluate open ends in real time and check for things like gibberish and duplication and speeding, uh, and and then to even measure how contextual the response is to the actual prompt itself. Um, now with AI, we've been able to really accelerate that tool, um, to make it that much more intuitive and and the context measures to be that much more accurate. And we've most recently, um, injected the ability to detect AI. So were you like it's very matter when you think about it. Like, try to catch the AI. Um, and so it's it's really it's really interesting. And so that's creating more efficiency and better higher, you know, higher quality for our clients and more confidence with the participants that we recruit into surveys. So, um, that's just a a use case, but I I think we gotta lean into it and figure out the right applications and encourage our teams to to leverage it wherever they can. ing more efficiency and better higher, you know, higher quality for our clients and more confidence with the participants that we recruit into surveys. So, um, that's just a a use case, but I I think we gotta lean into it and figure out the right applications and encourage our teams to to leverage it wherever they can.

Molly 36:32 Absolutely. Absolutely. Um, it it's I love that you talk about using it as that iteration process. I find that I do that all the time with it too. It's just thinking through some thoughts, like a little brainstorming partner, and then asking truly what I need from from human stakeholders. Um, so that's that's super fascinating. Well, in the last few minutes that we have your your wonderful time, Lisa, I wanted to talk a bit about you and looking over your journey from operations to now CEO. Where has for the namesake of our podcast, where has curiosity led you to take risks that perhaps didn't seem obvious at the time? And how do these choices that you've made for yourself shape the way that you you lead an innovative company today?

Lisa 37:19 Oh, that's a great question too. Well, I mean, I think I love the name of your podcast cause I think it's all about being curious and also being a great listener. Right? We got two ears, one mouth for a reason. So we can listen more and talk less, although I've been doing a lot of talking on this podcast, but you're a great

Molly 37:35 listener, Molly. Uh, that's a that's just like a pivot. I've heard you say that many times, and I'm not gonna lie. It's stuck with me. It has stuck with me.

Lisa 37:43 I I really subscribe to that because I think there's so much power in the art of listening. It's a form of data collection really and truly. Right?

Molly 37:52 Oh my gosh. Bringing it back. I love it.

Lisa 37:56 So I am always been a very curious person.

Molly 38:00 I think I get

Lisa 38:00 it from my mom. I think I love to ask a lot of questions. And so I actually went to college. I had the idea to, um, I wanted to go into journalism. And

Molly 38:10 Shout out journalism, girlies.

Lisa 38:12 Wow. Wow. Um, I really wanted to be like the next Connie Chung or Barbara Walters if if

Molly 38:18 Yes.

Lisa 38:18 People listening in are old enough to know who those two folks are. I used to sit at my dining room table, my parents' table, and pretend to read the news. Like, I was obsessed. I really I really thought that that was the career for me, but I found my way to market research. And at first, I was like, well, this isn't really what I went to school for, but so many of the applications within research were sisters to journalism.

Molly 38:44 You know? to read the news. Like, I was obsessed. I really I really thought that that was the career for me, but I found my way to market research. And at first, I was like, well, this isn't really what I went to school for, but so many of the applications within research were sisters to journalism. You know?

Lisa 38:44 For sure. A reporter or journalist is looking to get to the why, the what, the where, the when, the who. Um, they have so many questions, and they're so curious. You need that in your very fiber as a person, I think, to be successful in that field, and the same is true in research. So if you have a curious mind and you love to understand the why and what makes people tick, what makes products tick, what what what what's the next thing, uh, where have we come from, where are we going, like, those big broad questions, then this is absolutely the field for you. So once I landed in market research, it definitely got its hooks into me. And I've it it filled my my tank up in a way that I thought journalism would have, but I I got sort of ticked that box here in the research industry, um, and never looked back. Um, I would say, you know, it is important to take risks with your career. Um, there's another saying that I always go back to that that I'm sure you'll remember, Molly, but a comfort zone is a beautiful

Molly 39:44 garden, but not nothing

Lisa 39:46 grows. Right. Yes.

Molly 39:47 You have ed back. Um, I would say, you know, it is important to take risks with your career. Um, there's another saying that I always go back to that that I'm sure you'll remember, Molly, but a comfort zone is a beautiful garden, but not nothing

Lisa 39:46 grows. Right. Yes.

Molly 39:47 You have

Lisa 39:47 got to take risks. You've gotta do the hard things that no one else wants to do or the hard things that others are almost too afraid to do. So for example, getting up on stage, putting that submission paper into an association or a conference group to get up on stage, I know that's probably, like, the number one fear people have is getting up on stage and speaking. Mhmm. I still get nervous. My hands start to sweat, and I start to feel my heart starts to pound. You get, like, these physiological reactions that you can't always control because you're nervous, but the nerves need to be harnessed for positivity. The nervousness is just a signal that your body is sending that you really care, and you wanna do a great job at whatever you're you're putting your head to. Right? So do the hard things. Do the scary things. Take those risks because that's where the growth is, and that's typically where the career opportunity is, whether it's an opportunity to expand your network, to meet that new colleague at a industry conference who's gonna give you your next great gig, um, or introduce you to some awesome client that that Mhmm. With, um, and and bring value to. There's just a lot of opportunity laying around there behind every corner, and you have to be brave. So doing the brave thing even if it's so uncomfortable and fighting through that kind of dissonance, um, is so critical, I think, for the growth. Um, and I think that's been something I've really reminded myself of because we're as human beings, we always have that feeling of wanting to play it safe, or I'm I'm not really credentialed to do this or do you have agency to do this. Um, but it's the ones that lean in and figure it out along the way that that continue to grow and evolve and take their careers to the next level. So for those listening in, if you're afraid, just convince yourself that you're gonna get through it and lean in, and, um, you might really surprise yourself. I know I have throughout my career. So keep keep striving. Keep doing that.

Molly 41:49 That makes me feel slightly better about my sweaty hands before I join a podcast. It still happens to me. Uh, granted, I haven't been hosting super, super long, but I definitely before we get in, we have a prep call beforehand. And I'm like, try not to hyperventilate. And I'm like, you know, like, getting my and my heart starts going for sure, and I'm, like, pretty sure I blackout for some of it. Um, so it that that makes

Lisa 42:14 No. That's

Molly 42:15 Yeah. Fear

Lisa 42:16 that people have is public speaking.

Molly 42:19 Yeah. Um,

Lisa 42:20 you know? And so you just have to say, this is just a signal my body's sending me to tell me that I care. And it's not hard to of it. Um, so it that that makes No. That's

Molly 42:15 Yeah. Fear

Lisa 42:16 that people have is public speaking.

Molly 42:19 Yeah. Um,

Lisa 42:20 you know? And so you just have to say, this is just a signal my body's sending me to tell me that I care. And it's not hard to

Molly 42:26 be able to do something you really care about and wanna do a great job at. So You are consistently an inspiration, Lisa. Well, thank you so so much for your time and for for hopping on with me. Um, you've been a wonderful wealth of knowledge. And, again, I'm so personally happy that I get to spend this time with you.

Lisa 42:46 Aw. Thank you, Molly, so much for having me. And I just have to tell you, I'm so proud of you. I'm so proud of you.

Molly 42:51 You've Oh my gosh.

Lisa 42:52 In your career and to see you doing this podcast now and now an SMR rep. Like, it's amazing. And I'm so proud of everything you've accomplished, and, um, I'm so grateful to have you in my life and to know you. So it's great to see that you are continuing to grow and accelerate. I love it.

Molly 43:09 I'm I'm giving you a hug through the screen.

Lisa 43:12 Hugging back. Hugging back.

Molly 43:14 Alright. Well, thank you so much again, and, uh, we'll catch you on the next

Lisa 43:19 episode, listeners. Take care.