Architecture to manage data costs & complexity — Adrian Estala // Starburst
Adrian Estala
Starburst
- Part 1The evolution of the CDO role — Adrian Estala // Starburst
- Part 2 Architecture to manage data costs & complexity — Adrian Estala // Starburst
Show Notes
-
02:34The cost and complexity of dataWhen we talk about complexity, it's the diversity. First and foremost, every organization's data complexity starts with dealing with what they already have in place. And then, secondly, you're talking about live operations and live production systems that are actively being used.
-
04:31The cost is a big issue.The cost is absolutely a big issue. It is one of the reasons we do things or don't do things strategically.
-
05:37How large language models (ChatGPT) have changed the conversations CDOs have with CTOsTheres excitement about the possibilities, and then theres fear. There is a lot of concern about exploiting this and whether you can remain competitive without exploiting it.
-
07:08Data governance and ChatGPT usage concernsIt's hard to tell how the AI models get the data, raising concerns over Companys IP and copyrights. However, as a CDO, you must find a way to exploit and be competitive with it.
-
10:14How self service can work in a large, diverse organizationAny large organization with different verticals, they all are going to have different requests, and those requests are going to change over time. Creating a lake environment where you can allow every team with a data product to structure the data however, they see fit enables self-service.
-
11:53Are you a CTO gathering data in a small data lake, and with the scarcity of data scientists and AI experts, what value can a CDO bring to your company?You have to help the CDO understand what you should be doing and what you could be doing. And then they can figure out if your company can do it now. Or they can figure out how to build those capabilities to get your company there quickly.
Quotes
-
"When we talk about complexity, it's the diversity. First and foremost, every organization's data complexity starts with dealing with what they already have in place. And then, secondly, you're talking about live operations and live production systems that are actively being used." - Adrian Estala
-
"The key to managing costs and maximizing the ROI is, number one, leveraging what you have. Number two is pivoting more towards a lake and making that data available, more accessible to the AI engines versus trying to get into a structured warehouse, where you must pick the pieces, you'll move over there. And it takes a lot longer. Number three is self-service. You want to reduce the cost; what am I going to do? Hire a bunch of data scientists? Good luck finding them. What you want to do is in this modern AI world, modern data culture world, if I can get the data to the people leveraging the sources I already have, then I can start to enable teams to do more on their own - self-service." - Adrian Estala
-
"Any large organization with different verticals, they all are going to have different requests, and those requests are going to change over time. And so as soon as you build a structure, someone will say I want a different one or order a new copy of this structure. And so it's the idea of creating a lake environment where I can allow every team with a data product to structure the data however they see fit. They can still share, but they also can customize." - Adrian Estala
-
"We've been saying no to data for so long; it won't work. We have to start to say, Open Access unless. We will open all the data access unless somebody can tell me why not. It's hard to do, but that's the right way to think about data. Tell me why I can't use it because I can grow value if I can use it." - Adrian Estala
- Part 1The evolution of the CDO role — Adrian Estala // Starburst
- Part 2 Architecture to manage data costs & complexity — Adrian Estala // Starburst
Up Next:
-
Part 1The evolution of the CDO role — Adrian Estala // Starburst
The Chief Data Officer role is relatively new but has quickly evolved from governance and data capabilities to thinking about the business, specific use cases, and the projects that will deliver those use cases. However, the biggest issue for a CDO, especially in a big company, is every one of your business consumers has a different ask. They want to use the same data, but they want to use it differently. How do you cope with that? Listen to Adrian Estala, VP, Field Chief Data Officer of Starburst, as he discusses the evolution of the CDO role.
Play Podcast -
Part 2Architecture to manage data costs & complexity — Adrian Estala // Starburst
The era of hoarding access to data is fast passing because access to data is driving incredible value. But how do you manage the costs and complexity? As a CTO, when do you bring on a CDO to help your company leverage all the data you've been gathering? Listen to Adrian Estala, VP, Field Chief Data Officer of Starburst, as he discusses architectures and ways to manage data costs and complexity.
