Overview
Build a fully functional real-time data dashboard from scratch—no prior experience required., Learn step-by-step how to collect, stream, store, analyze, and visualize live data using AWS EC2, Kafka, PostgreSQL, Paython and Grafana., Master essential Linux commands, learn how to collect real data using Python APIs, and build confidence with core SQL by analyzing live streaming datasets., Build a real-time analytics project to showcase in your technical portfolio., Gives you practical experience with AWS EC2, Kafka, Python, SQL, PostgreSQL, and Grafana.
This course is great for beginners, students, career changers, or developers who want real hands-on experience with tools like Kafka, Python, SQL, and AWS. If you want to learn how modern data systems work and build a full real-time pipeline from scratch, this course is for you.
There are no strict prerequisites — this course is designed to be beginner-friendly.
This course is designed for absolute beginners and early learners who want to understand real-time data—without needing any cloud, engineering, or programming background.
If you’ve been curious about AWS, Kafka, PostgreSQL, Python, or Grafana dashboards, this is the most beginner-friendly and practical way to start. You will follow a clear, step-by-step process and build a complete real-time crypto dashboard from scratch.
We focus on hands-on learning. Every section includes real activities, copy-and-run commands, and quizzes to reinforce your understanding. By the end of this course, you will not only understand how real-time pipelines work, but also have a fully functioning project running on AWS.
What This Course Covers
Section 1 — Introduction
Overview of the course, downloadable resources, and important AWS EC2 setup guidelines to ensure a safe learning environment.
Section 2 — Getting Started with AWS
Learn how to create your AWS account, launch your first EC2 instance, and safely stop resources to avoid additional charges. Includes guided activities and a review quiz.
Section 3 — Linux Essentials & Python Environment
Set up your Python virtual environment, learn basic Linux commands, and understand how API-based data collection works. Includes hands-on practice and a quiz.
Section 4 — Python Crypto Price Collector
Build your first Python script that collects live BTC and ETH prices every two minutes. Learn API calls, JSON handling, timestamps, and continuous execution.
Section 5 — Kafka & Streaming Fundamentals
Understand how Kafka and ZooKeeper work, how topics are created, and how producers and consumers exchange data. Install and configure Kafka, and stream real crypto prices into a Kafka topic.
Section 6 — PostgreSQL & SQL Commands
Install PostgreSQL, create databases and tables, and store Kafka messages in real time. Run SQL queries, compute 24-hour trends, and build a prediction pipeline using Python and SQL.
Section 7 — Build Grafana Dashboard
Install Grafana, connect it to PostgreSQL, and create visually appealing real-time dashboards. Build charts for price trends, predictions, 24-hour highs and lows, and more.
By the End of This Course, You Will Have Built:
- A complete real-time crypto pipeline
- Live data streaming from Python to Kafka
- Real-time storage inside PostgreSQL on AWS
- Interactive dashboards in Grafana
- BTC and ETH trend visualizations
- 24-hour high/low and price-change panels
- A prediction dashboard using Python and machine learning
- A professional, portfolio-ready project
Why This Course Is Perfect for You
- No cloud experience required
- No data engineering background needed
- No prior experience with Kafka, SQL, or Grafana
- Clear, beginner-friendly explanations
- 100% hands-on, step-by-step learning
- Builds a real, production-style system on AWS
If you’ve always wanted to understand how modern data pipelines work but didn’t know where to start, this course is the easiest and most practical way to begin.
Let’s build your first real-time dashboard together.
Sunghwan Ki
Hello! My name is Sunghwan Ki, and I am a Senior Data Engineer with 7+ years of experience in the finance industry, specializing in building large-scale, high-performance data systems used in real-world enterprise environments.
Throughout my career, I’ve designed and managed end-to-end data pipelines involving Kafka, Oracle Exadata, Hadoop, and Apache Spark, working with mission-critical, high-volume datasets that power analytics and operational systems for financial institutions.
I’m passionate about simplifying complex technologies and helping beginners build confidence through real, hands-on projects. My teaching style focuses on:
- Beginner-friendly explanations
- Copy-and-run practicality
- Real-world tools used in industry
- Step-by-step, no-stress learning
In my courses, you’ll learn how to build real-time dashboards, data pipelines, and cloud-based systems using AWS, Python, Kafka, SQL, PostgreSQL, and Grafana. You won’t just watch — you’ll build real, portfolio-ready projects from scratch.
I love seeing students go from zero experience to confidently running real-time systems on their own. If you're curious about streaming data, cloud engineering, or modern data stacks, you’re in the perfect place.
Let’s build your first real-time data project together.