Domain Expertise and AI Tools for Data Analysts | Meghan Maloy, Staff Analytics Engineer

Key Lessons

1. Real-world experience and domain expertise can be your edge as a data analyst. Understanding the domain leads to better understanding the data.

2. AI can’t replace data analysts who understand the context of their data and have the communication skills to share results.

3. Using AI tools effectively requires clear & specific prompts while also understanding the limitations of LLMs.

4. Why Staff Level is hard to define and how to handle it.

5. NYC Open Data is a great way to explore some real world data.

Links

• Upcoming NYC Open Data Classes

• How I Learned to Understand the World by Hans Rosling

• How not to be ignorant about the world

Timeline

[00:00:00] Introduction to the Bits of Chris show and guest Meghan Maloy, staff analytics engineer at Datadog.

[00:00:58] Discussion on using New York City open datasets to investigate real-life experiences.

[00:02:19] Meghan shares an example of investigating traffic light timing changes in her neighborhood using open data.

[00:05:33] Exploration of 311 data sets and their applications in understanding city complaints.

[00:08:14] Meghan discusses her presentations at meetups using New York City open data.

[00:09:34] Conversation about approaches to exploring data sets and asking questions.

[00:12:54] Discussion on consuming information and book recommendations, including "How I Learned to Understand the World" by Hans Rosling.

[00:17:21] Insights on the importance of domain expertise for data analysts and understanding data collection methods.

[00:23:14] Meghan shares her experience transitioning to a staff-level role and finding impactful work.

[00:27:23] Chris and Meghan discuss the challenges of measuring performance and impact at higher-level roles.

[00:31:58] Conversation about the impact of AI and LLMs on the future of data analysis roles.

[00:37:52] Discussion on using AI tools, including ChatGPT, Perplexity, and Claude, for various tasks.

[00:44:38] Insights on the importance of specificity in prompts when using AI tools and interacting with colleagues.

[00:50:34] Meghan shares her experience during a three-month sabbatical and the benefits of work-life balance.

[00:53:53] Information about New York City Open Data training sessions and the Open Data Ambassadors program.