Episode 164

full
Published on:

12th Jun 2025

164: I built an entire data pipeline in 30 minutes using only AI (no code required)

Try Keboola ๐Ÿ‘‰ https://www.keboola.com/mcp?utm_campaign=FY25_Q2_RoW_Marketing_Events_Webinar_Keboola_MCP_Server_Launch_June&utm_source=Youtube&utm_medium=Avery

Today, we'll create an entire data pipeline from scratch without writing a single line of code! Using Keboola MCP server and ClaudeAI, weโ€™ll extract data from my FindADataJob.com RSS feed, transform it, load it into Google BigQuery, and visualize it with Streamlit. This is the future of data engineering!

Keboola MCP Integration:

https://mcp.connection.us-east4.gcp.keboola.com/sse

I Analyzed Data Analyst Jobs to Find Out What Skills You ACTUALLY Need

https://www.youtube.com/watch?v=lo3VU1srV1E&t=212s

๐Ÿ’Œ Join 10k+ aspiring data analysts & get my tips in your inbox weekly ๐Ÿ‘‰ https://www.datacareerjumpstart.com/newsletter

๐Ÿ†˜ Feeling stuck in your data journey? Come to my next free "How to Land Your First Data Job" training ๐Ÿ‘‰ https://www.datacareerjumpstart.com/training

๐Ÿ‘ฉโ€๐Ÿ’ป Want to land a data job in less than 90 days? ๐Ÿ‘‰ https://www.datacareerjumpstart.com/daa

๐Ÿ‘” Ace The Interview with Confidence ๐Ÿ‘‰ https://www.datacareerjumpstart.com/interviewsimulator

โŒš TIMESTAMPS

00:00 - Introduction

00:54 - Definition of Basic Data Engineering Terms

02:26 - Keboola MCP and Its Capabilities

07:48 - Extracting Data from RSS Feed

12:43 - Transforming and Cleaning the Data

19:19 - Aggregating and Analyzing Data

23:19 - Scheduling and Automating the Pipeline

25:04 - Visualizing Data with Streamlit


๐Ÿ”— CONNECT WITH AVERY

๐ŸŽฅ YouTube Channel: https://www.youtube.com/@averysmith

๐Ÿค LinkedIn: https://www.linkedin.com/in/averyjsmith/

๐Ÿ“ธ Instagram: https://instagram.com/datacareerjumpstart

๐ŸŽต TikTok: https://www.tiktok.com/@verydata

๐Ÿ’ป Website: https://www.datacareerjumpstart.com/

Mentioned in this episode:

โœจ Try Julius!

This episode is brought to you byย Juliusย โ€“ your AI data analyst companion. Connect to your database and/orย businessย tools, pull insights in minutesโ€“no coding required. Thanks,ย Julius, for sponsoring this episode. Try Julius at https://landadatajob.com/Julius-DCP

https://landadatajob.com/Julius-DCP

๐Ÿ’Œ Join 10k+ aspiring data analysts & get my tips in your inbox weekly

If you enjoy this podcast, you're going to LOVE my newsletter. Every week, I send you 1 email jam-packed with tips, tricks, and resources. Don't miss it!

๐Ÿ’Œ Subscribe To My Newsletter

๐Ÿ’™ Thank you for subscribing & leaving a review

Thanks to YOU we recently became the most popular data podcast out there. Thank you so much for listening. If you haven't subscribed yet, hit subscribe. It costs $0. If you enjoy the show, leave us a 5-star rating on Spotify or Apple. It helps people like you find the show AND it helps us land better guests. Thank you so much for your support.

Transcript

Listen for free

Show artwork for Data Career Podcast: Helping You Land a Data Analyst Job FAST

About the Podcast

Data Career Podcast: Helping You Land a Data Analyst Job FAST
The Data Career Podcast: helping you break into data analytics, build your data career, and develop a personal brand

About your host

Profile picture for Avery Smith

Avery Smith

Avery Smith is the host of The Data Career Podcast & founder of Data Career Jumpstart, an online platform dedicated to helping individuals transition into and advance within the data analytics field. After studying chemical engineering in college, Avery pivoted his career into data, and later earned a Masters in Data Analytics from Georgia Tech. Heโ€™s worked as a data analyst, data engineer, and data scientist for companies like Vaporsens, ExxonMobil, Harley Davidson, MIT, and the Utah Jazz. Avery lives in the mountains of Utah where he enjoys running, skiing, & hiking with his wife, dog, and new born baby.