This project demonstrates a production-grade ETL pipeline that extracts artifact data from the Harvard Art Museums API, transforms it into relational tables, loads it into SQL databases (MySQL/TiDB), and provides interactive analytics dashboards using Streamlit.
What This Project Does
The Harvard Artifacts Collection app provides:
API Integration
Paginated data collection from Harvard Art Museums API with rate limiting
ETL Pipeline
Extract nested JSON, transform to relational format, batch load to SQL
SQL Analytics
20+ predefined analytical queries for artifact insights
Interactive Dashboards
Streamlit-based visualization with Plotly charts
Database Design
Normalized schema with
artifactmetadata
,
artifactmedia
, and
artifactcolors
tables
Installation
Show more
Installs
549
Repository
aradotso/data-skills
GitHub Stars
1
First Seen
May 23, 2026
Security Audits
Gen Agent Trust Hub
Warn
Socket
Warn
Snyk
Pass