Secrets of Data Analytics Leaders

In this episode, Wayne Eckerson and Matthew Schwartz discuss non-traditional uses of business intelligence tools. Although BI tools have been around for almost three decades, most companies just scratch the surface of what’s possible to do with those tools. Using web layers and APIs, a company can use their imagination to customize and leverage their exiting BI tool-set to monetize data, integrate tribal knowledge and build industry-specific proprietary products. Matthew Schwartz is the chief technology officer of Sage Hospitality, one of the world's largest hotel operators. Although Matt is responsible for all aspects of Sage’s IT operations, he has a deep fondness for data and analytics, having served as a BI director for several companies, including PetSmart and Staples. Matt firmly believes in the power of BI tools to transform organizations.

This audio blog probes the business value in analytics by examining the concept of Action Distance. Originally published at https://www.eckerson.com/articles/finding-value-in-analytics-action-distance

One of the hardest parts of running a data analytics program inside a large organization is governing data and reports. It’s simply too easy for the definition of core data elements and metrics to get out of sync and reports to contain conflicting information. Angie Davis has straddled both the business and IT worlds for more than 20 years. She served as a business analyst in several organizations before switching to the information technology side of the business where she ran analytics teams, first at JD Irving for six years and more recently at Brookfield Renewable where she is an IT director. Angie has a degree in mathematics and electrical engineering from Dalhousie University in Halifax, Nova Scotia.

This audio blog focuses on the importance of establishing a strong relationship between business and technical teams and describes various business engagement models that sit at the heart of all successful data analytics programs.

Learn how to achieve the DataOps objectives of improved efficiency and data quality by migrating to a streaming architecture based on Apache Kafka.

Companies that excel at advanced analytics and data science maximize the value of their data. They unearth hidden opportunities and become innovators in the industry. Although each organization has different goals, the underlying processes and tools to become successful at analytics remain somewhat the same. In this episode, Alan Jacobson explains them one by one and finishes off with his top three recommendations. Alan Jacobson is the chief data and analytics officer (CDAO) of Alteryx, driving key data initiatives and accelerating digital business transformation for the Alteryx global customer base. As CDAO, Jacobson leads the company’s data science practice as a best-in-class example of how a company can get maximum leverage out of its data and the insights it contains, responsible for data management and governance, product and internal data, and use of the Alteryx Platform to drive continued growth. Alan was recognized as a top leader in the global automotive industry as an Automotive Hall of Fame Leadership & Excellence award winner and an Outstanding Engineer of the Year by the Engineering Society of Detroit, and works with the National Academy of Engineering and other organizations as an advisor on data science topics.

With the growing popularity of machine learning and artificial intelligence, creating a data science program is a key initiative at most companies today. However, it’s not always clear to executives how they can deliver a return on investments in data science. To explain this, we invited an expert who has spent most of his career in the data science trenches and has a clear-minded perspective on how to deliver ROI with data science. Alan Jacobson is the chief data and analytics officer (CDAO) of Alteryx, driving key data initiatives and accelerating digital business transformation for the Alteryx global customer base. As CDAO, Jacobson leads the company’s data science practice as a best-in-class example of how a company can get maximum leverage out of its data and the insights it contains, responsible for data management and governance, product and internal data, and use of the Alteryx Platform to drive continued growth. Prior to joining Alteryx, Alan held a variety of leadership roles at Ford Motor Company across engineering, marketing, sales and new business development; most recently leading a team of data scientists to drive digital transformation across the enterprise. As an Alteryx evangelist at Ford, Alan spent many years leveraging the Alteryx Platform across the company and witnessed first-hand the impact a culture of analytics can have on the bottom line and what it takes to succeed as a data-driven enterprise.

How do you organize a data analytics program to maximize value for the organization? Although there is no right or wrong way to do this, several patterns emerge when you examine successful organizations. Originally published at https://www.eckerson.com/articles/organizing-for-success-part-ii-how-to-organize-a-data-analytics-program

Despite our reliance on reports, the state of reporting in most companies is awful. There are too many reports in too many locations created by too many different people and tools.

The goal of self-service analytics is to empower business people to build their own reports, dashboards, and predictive models. If that happens, does your company still need a corporate business intelligence team? Originally published at https://www.eckerson.com/articles/organizing-success-part-1-organize-bi-team

Although dashboards will never disappear, they will be radically transformed by artificial intelligence. They will become more intelligent, predictive, timely, and conversational.

Before a company hires data science talent, they should understand the role and types of data scientists. Failing to differentiate between research, applied, and citizen data scientist can result in appointing the wrong people on crucial projects. To continue our previous episode's discussion, we invited Alex Vayner for a second time to get an answer to the question: What is a data scientist? Alex Vayner is a Partner and Americas Data & AI Practice Leader for PA Consulting Group, an innovation and transformation consultancy. Alex has spent his entire career in data & analytics, with his last five roles focused on building and running high-performance data science teams and capabilities in consulting and corporate environments. Before joining PA Consulting, Alex ran the NA Data Science & AI practice at Capgemini. He joined Capgemini from Equifax, where he served as VP, Global Data Innovation Leader, building a team responsible for pioneering disruptive data & analytics solutions for clients across all industries.

Explore how data analytics leaders can balance the use of specialists and generalists. Originally published at https://www.eckerson.com/articles/specialists-or-generalists

New challenges to analytics platforms have prompted SAS to create new responses. The software giant responds with automation and decision support tools.

Data science has made immense progress, but companies are still stuck with the question: how do you use data science to deliver real value to the business? They hire dozens of data scientists and invest in state-of-the-art technology, but only a few have delivered ROI and business impact. In this episode, Wayne Eckerson and Alex Vayner discuss what organizations need to do for data science success. Alex Vayner is a Partner and Americas Data & AI Practice Leader for PA Consulting Group, an innovation and transformation consultancy. Alex has spent his entire career in data & analytics, with his last five roles focused on building and running high-performance data science teams and capabilities in consulting and corporate environments. Before joining PA Consulting, Alex ran the NA Data Science & AI practice at Capgemini. He joined Capgemini from Equifax, where he served as VP, Global Data Innovation Leader, building a team responsible for pioneering disruptive data & analytics solutions for clients across all industries.

IoT has created a tidal wave that data savvy organizations can turn into profitable business solutions. Most IoT data comes from sensors, which are now attached to almost every device imaginable, from factory floor machines and agricultural fields to your cell phone and toothbrush. But IoT is forcing companies to rethink their data architectures to ingest, process, and analyze streaming data in real-time. To help us understand the impact of IoT on data architectures, we invited Dan Graham to our show for a second time. Dan is a former product marketing manager at both IBM and Teradata, renowned for combining deep technical knowledge with industry marketing savvy. During his tenure at those companies, he was responsible for MPP data management systems, data warehouses, and data lakes, and most recently, the Internet of Things.

Just-in-time design is the practice of designing working software in small increments that support a business-defined need or story. Just-in-time design, as well as just-in-time testing, is an integral part of the agile software methodology. In fact, you can’t really do agile without just-in-time design. To help us understand the nuances of just-in-time design, we invited Aaron Fuller, a long-time data architect and member of Eckerson Group’s consulting network. Across an 11-year career as the enterprise data architect for an insurance company, he modeled data, created technical designs for a broad range of systems, established governance and stewardship, and led the establishment of their enterprise data warehousing, business intelligence, and enterprise architecture programs. As principal consultant and owner of Superior Data Strategies since 2010, he leads a team of highly skilled data professionals who are uniquely capable of planning and executing agile data projects.

Last month, I attended Domo’s annual user conference for the first time. I came a skeptic, but left a believer. Domo has invested large sums of money to create a comprehensive data and analytics platform that scales to run small and medium-size businesses, and possibly large ones. Most importantly, it has a cadre of highly satisfied brand-name customers who want to extend the platform to support all business users and their analytic applications. Originally published at: https://www.eckerson.com/articles/catching-the-domo-spirit

Processing continuous data streams is becoming increasingly important. However, traditional analytics architectures were often not built for real-time scenarios. This article will illustrate challenges and discuss how streaming-first approaches can change the way we think about analytics architectures. Originally published at: https://www.eckerson.com/articles/streams-everywhere-towards-streaming-first-architectures

This second article in a series on modern data architectures. It focuses on what drives customers to want a modern data architecture (i.e., fear and opportunity) in the first place. It then lists ten requirements that customers desire for a modern data architecture, ranging from “cloud-first” and “streaming-first” to “best of breed” and “predictable pricing”. Originally published at: https://www.eckerson.com/articles/ten-things-companies-want-from-a-modern-data-architecture

Data virtualization has been around for decades and has always been controversial. In the 1990s, it was called virtual data warehousing or VDW-- or as some skeptics liked to say, "voodoo and witchcraft”. It’s also been known as query federation and more recently, data services. The idea is that business users don't need to know the location of the data; they merely need to log into the data service and all data appears as if it’s local to their server, modeled in a fashion that makes sense to them. Andrew Sohn is the Global Head of Data and Analytics at Crawford & Company, a $1B+ service provider to the insurance and risk management industry, where he designed and leads its data and digital transformation strategy and program. With more than 25 years in the industry, Andrew has managed a broad range of infrastructure and application technologies. He’s a strong advocate of data virtualization technology and believes it is an integral part of a modern, agile data ecosystem.

Why is Data Quality still an issue after all these years? To get an answer to the prevalent question, Wayne Eckerson and Jason Beard engage in a dynamic exchange of questions which lead us to the root cause of data quality and data governance problems. Using examples from his past projects, Jason shows the value of business process mapping and how it exposes the hidden problems which go undetected under the standard IT lens. In his most recent role as Vice President of Process & Data Management at Wiley, a book publisher, he was responsible for master data setup and governance, process optimization, business continuity planning, and change management for new and emerging business models. Jason has led business intelligence, data governance, master data management, Process Improvement, Business Transformation, and ERP projects in a variety of industries, including Scientific and Trade publishing, Educational Technology, Consumer Goods, Banking, Investments, and Insurance.

Being a change agent is hard. It's tough to inspire people and get them motivated to work on a shared vision. To understand the mechanics of digitalization and tactics required to implement them, Wayne Eckerson invited Andrea Ballinger so that she could share her hard-won lessons from her illustrious career as a technology leader. Andrea is currently leading a transformation program at LSU, revamping the university’s information technology resources across multiple campuses. Prior to that, she served as Interim CEO and President for the University of Illinois Alumni Association and CTO of Illinois State University. She began her data career at the University of Illinois where she earned a reputation as the foremost data warehousing expert in higher education.

The road to AI adoption is far more complex than one can imagine. Building data science models and testing them is only one piece of the puzzle. To understand the roadblocks and best practices, Wayne Eckerson invited Nir Kaldero in our latest episode to learn why organizations need to start paying more attention to people, culture and processes to make data science projects a success and how democratization skills pays off in the long run. Nir Kaldero is the Head of Data Science, Vice President at Galvanize Inc. and the creator of the GalvanizeU Master’s of Science in Data Science program. A tireless advocate for transforming education and reshaping the field of data science, his vision and mission is to make an impact on a wide variety of communities through education, science, and technology. In addition to his work at some of the world’s largest international corporations, Kaldero serves as a Google expert/mentor and has been named an IBM Analytics Champion 2017 & 2018, a prestigious honor given to leaders in the field of science, technology, engineering, and math (STEM).

In this episode, Daniel Graham dissects the capabilities of data lakes and compares it to data warehouses. He talks about the primary use cases of data lakes and how they are vital for big data ecosystems. He then goes on to explain the role of data warehouses which are still responsible for timely and accurate data but don't have a central role anymore. In the end, both Wayne Eckerson and Dan Graham settle on a common definition for modern data architectures. Daniel Graham has more than 30 years in IT, consulting, research, and product marketing, with almost 30 years at leading database management companies. Dan was a Strategy Director in IBM’s Global BI Solutions division and General Manager of Teradata’s high-end server divisions. During his tenure as a product marketer, Dan has been responsible for MPP data management systems, data warehouses, and data lakes, and most recently, the Internet of Things and streaming systems.

Recent technology developments are driving urgency to modernize data management. What do you do about architecture, modeling, quality, and governance to keep up with big data, cloud, self-service, and other trends in data and technology? Examining some best practices can spark ideas of where to begin. Originally published at https://www.eckerson.com/articles/stepping-up-to-modern-data-management

Data catalogs have become the centerpiece of modern data management. They are the means to connect self-service analysts with the right data, the “go to” technology for data curation, and the new gold standard for metadata management. With many data catalog tools available, choosing the right data catalog is an important decision.

In this episode, Wayne Eckerson asks Steve Dine about the approach needed to migrate to the Cloud and architecture required to run analytics in the Cloud. Steve Dine talks extensively about the pitfalls to avoid during Cloud migration and finishes off by saying that even though security is a big issue, most organizations will have part of their architecture in the Cloud during the next two-three years. Steve Dine is a BI and enterprise data consultant and industry thought leader who has extensive experience in designing, delivering and managing highly scalable and maintainable modern data architecture solutions.

BI teams often work extremely hard but have little to show for their effort, and they can never get ahead of a continuous backlog of requests. The business rewards their hard work by reducing their budget and staff. Even if they know what needs to be done, they have little authority to make it happen. To succeed, BI leaders need to partner with the business and deliver quick wins to turn the tide of adoption in their favor. Originally published at https://www.eckerson.com/articles/why-bi-teams-struggle-the-tipping-point-of-success

In this Episode, Wayne Eckerson asks Charles Reeves about his organization’s Internet of Things and Big Data strategy. Reeves is senior manager of BI and analytics at Graphics Packaging International, a leader in the packaging industry with hundreds of worldwide customers. He has 25 years of professional experience in IT management including nine years in reporting, analytics, and data governance.

A data analyst workbench will inevitably integrate data catalog, data preparation, and data analysis functionality. Data analysts don’t want to jump from tool to tool when executing a workflow that is both linear and iterative. Data analysts with this kind of workbench will be more productive and foster higher levels of reuse and data literacy. Originally published at https://www.eckerson.com/articles/self-service-triumvirate-the-new-data-analyst-workbench

In this episode, Wayne Eckerson and Shakeeb Ahkter dive into DataOps. They discuss what DataOps is, the goals and principles of DataOps, and reasons to adopt a DataOps strategy. Shakeeb also reveals the benefits gained from DataOps and what tools he uses. He is the Director of Enterprise Data Warehouse at Northwestern Medicine and is responsible for direction and oversight of data management, data engineering, and analytics.

A classic management practice dictates that a newly-appointed leader must accomplish certain things in their first 90 days. While some of this is general knowledge, there are specifics when it comes to Data Management and Analytics If you have been recently named to head any group that has to manage or facilitate the use of data, at any level in the organization, then this audio blog post is for you. Originally published at https://www.eckerson.com/articles/what-do-you-do-first-after-being-hired-as-a-bi-analytics-data-engineering-director

In this episode, Wayne Eckerson and Rich Fox discuss what differentiates data science from analytics, why and how data science addresses business needs, why balance scorecards are relevant, and why Excel is a problem. Throughout the podcast, Fox shares many real-life examples and personal experiences. Fox is vice president of Data Science and Analytics at Apex Parks Group, one of the largest entertainment center companies in the United States, which operates amusement parks, water parks, and family entertainment centers.

With all the hype and attention around big data and huge data platforms, there can sometimes be some data envy. There are still organizations and companies that don’t have big data: are they not poised for analytics too? Can they not get insights as well? The BI Pharaoh gives tips on how to work with your little data just like the big boys. Originally published at https://www.eckerson.com/articles/little-data-needs-love-too

We’re at the dawn of a new era in decision making made possible by the intersection of business intelligence and artificial intelligence. Rather than replace BI, AI will make BI more pervasive. AI-infused BI tools will be easier to use, generate more useful insights, and make business users more productive. Rather than replace human decision makers, AI will free them to focus on value-added activities and make decisions with data rather than rely solely on gut instinct. Originally published at https://www.eckerson.com/articles/the-impact-of-ai-on-analytics-machine-generated-intelligence

In this episode, Wayne Eckerson and Rich Galan discuss the obstacles to delivering timely analysis, the problems that large volumes of data create, solutions to those issues, and where BI is headed in the near future. Rich is a veteran data analytics leader with 20 years of experience in a variety of data-driven organizations.

Data analysts who sit in each business function (i.e., sales, marketing, finance) are critical to the success of a self-service analytics strategy. The problem is that most data analysts don’t receive the training and support they need to be proficient with self-service data and analytics tools. The easiest way to improve the skills and satisfaction of most data analysts is simple: bring them together into a power user network. Originally published at https://www.eckerson.com/articles/power-user-networks-the-key-to-self-service-analytics

In this episode, Wayne Eckerson and Steve Dine discuss modernizing data architectures. They cover the definition of a modern data architecture, telltale signs you need to modernize, best practices to modernize, and much more. Dine is the President of Datasource Consulting, an EXL company. He has extensive experience designing, delivering, and managing successful, highly scalable and maintainable modern data architecture solutions.

Data pipelines become chaotic with pressures of agile, democratization, self-service, and organizational “pockets” of analytics. From enterprise BI to self-service analysis, data pipeline management should ensure analysis results are traceable, reproducible, and of production strength. Robust data pipelines rely on eight critical components. Originally published at https://www.eckerson.com/articles/the-complexities-of-modern-data-pipelines

In this episode, Wayne Eckerson and Jen Underwood explore a new era of analytics. Data volumes and complexity have exceeded the limits of current manual drag-and-drop analytics solutions. Data moves at the speed of light while speed-to-insight lags farther and farther behind. It is time to explore intelligent, next generation, machine-powered analytics to retain your competitive edge. It is time to combine the best of the human mind and machine. Underwood is an analytics expert and founder of Impact Analytic. She is a former product manager at Microsoft who spearheaded the design and development of the reinvigorated version of Power BI, which has since become a market leading BI tool. Underwood is an IBM Analytics Insider, SAS contributor, former Tableau Zen Master, Top 10 Women Influencer and active analytics community member. She is keenly interested in the intersection of data visualization and data science and writes and speaks persuasively about these topics.

In this podcast, Carl Gerber and Wayne Eckerson discuss Gerber’s top five data governance best practices: Motivation, Assessment, Data Assets Catalog, CxO Alliance, and Data Quality. Gerber is a long-time chief data officer and data leader at several large, diverse financial services and manufacturing firms, who is now an independent consultant and an Eckerson Group partner. He helps large organizations develop data strategies, modernize analytics, and establish enterprise data governance programs that ensure data quality, operational efficiency, regulatory compliance, and business outcomes. He also mentors and coaches Chief Data Officers and fills that role on an interim basis.

With today’s unprecedented velocity of change in data and technologies, the single version of the truth (SVOT) is sometimes looked upon as a nice to have. But SVOT is not optional. Despite the difficulties in constructing a single version of the truth, it is now needed more than ever to keep CEOs happy and to stay compliant with new regulations like the GDPR. Originally published at https://www.eckerson.com/articles/single-version-of-the-truth-not-optional

Ethics is challenging because right and good are not always clear. More data, more kinds of data, and advanced analysis of data often conflict with concerns of data privacy, security, anonymity, and ownership. Resolving these conflicts requires acknowledgment, discussion, and the hard work of defining ethics-based policies and creating a culture of ethical conduct. Originally published at https://www.eckerson.com/articles/data-ethics-the-new-data-governance-challenge

In this episode, Wayne Eckerson and Jeff Magnusson discuss the data architecture Stitch Fix created to support its data science workloads, as well as the need to balance man and machine and art and science. Magnusson is the vice president of data platform at Stitch Fix. He leads a team responsible for building the data platform that supports the company's team of 80+ data scientists, as well as other business users. That platform is designed to facilitate self-service among data scientists and promote velocity and innovation that differentiate Stitch Fix in the marketplace. Before Stitch Fix, Magnusson managed the data platform architecture team at Netflix where he helped design and open source many of the components of the Hadoop-based infrastructure and big data platform.

To survive and thrive in today’s information economy, organizations need to establish a compelling data strategy that advances the company’s key objectives and goals. This is not a job for the chief information officer or even chief data officer; it’s a task that the CEO must own and champion and assemble his best and brightest to execute. This audio blog examines the ten step methodology that Eckerson Group uses to help organizations create a data strategy. Originally published at https://www.eckerson.com/articles/how-to-create-a-data-strategy-part-1-overview

Data engineering is one of the hottest and most difficult jobs to fill in the field of analytics. Breadth and depth of required skills limits the number of people qualified to work as data engineers. If you’re seeking to hire data engineers, consider the 24 skill areas identified here as guidance to shape job descriptions and to screen candidates. If you’re seeking to become a data engineer, take the skills assessment to highlight your strengths and identify your gaps. Originally published at https://www.eckerson.com/articles/data-engineering-coming-of-age

In this podcast, Wayne Eckerson and Joe Caserta discuss data migration, compare cloud offerings from Amazon, Google, and Microsoft, and define and explain artificial intelligence. You can contact Caserta by visiting caserta.com or by sending him an email to [email protected]. Follow him on Twitter @joe_caserta. Caserta is President of a New York City-based consulting firm he founded in 2001 and a longtime data guy. In 2004, Joe teamed up with data warehousing legend, Ralph Kimball to write to write the book The Data Warehouse ETL Toolkit. Today he’s now one of the leading authorities on big data implementations. This makes Joe one of the few individuals with in-the-trenches experience on both sides of the data divide, traditional data warehousing on relational databases and big data implementations on Hadoop and the cloud.

Every organization that manufactures data for decision making is rethinking its data architecture. Compared to five years ago, there is a treasure trove of new technologies and techniques that promise to transform the way organizations compete and serve customers. This audio blog summarizes the major characteristics of a modern data architecture and serves a high-level guide for organizations that are in the midst of developing a new data strategy for the modern age. Originally published at https://www.eckerson.com/articles/ten-characteristics-of-a-modern-data-architecture

In this podcast, Wayne Eckerson and James Serra discuss myths of modern data management. Some of the myths discussed include 'all you need is a data lake', 'the data warehouse is dead', 'we don’t need OLAP cubes anymore', 'cloud is too expensive and latency is too slow', 'you should always use a NoSQL product over a RDBMS.' Serra is big data and data warehousing solutions architect at Microsoft with over thirty years of IT experience. He is a popular blogger and speaker and has presented at dozens of Microsoft PASS and other events. Prior to Microsoft, Serra was an independent data warehousing and business intelligence architect and developer.