๐ Data Engineer @ VNPT AI
๐น Building scalable Lakehouse & Data Platforms
๐น Experienced with Big Data, Streaming, and Cloud Infrastructure
๐น Passionate about Data Infrastructure, APIs, and Workflow Orchestration
- Python (ETL, APIs, data pipelines, orchestration)
- Java (Big Data, Kafka, Flink, Spark ecosystem)
- Apache Iceberg, Delta Lake
- Apache Spark, Apache Flink
- Kafka, Kafka Connect, Debezium (CDC from Postgres/MySQL/MongoDB)
- Google BigQuery, Cloud Scheduler
- AWS S3, MinIO
- GCS (Google Cloud Storage)
- PostgreSQL, MySQL, MongoDB
- Qdrant (Vector Database)
- Apache Superset
- Apache Airflow, Cronjob, Cloud Scheduler
- Docker, Docker Compose
- Kubernetes, Helm
- Terraform, GitHub Actions
- FastAPI
- Git, GitHub (version control & collaboration)
- ๐๏ธ Lakehouse with Iceberg + Spark โ End-to-end data lakehouse with schema evolution & time travel
- ๐ CDC Data Pipelines with Debezium + Kafka โ Real-time CDC ingestion from Postgres/MySQL/MongoDB into lakehouse
- ๐ BigQuery ETL Framework โ Managed ETL workflows using Airflow + BigQuery
- โ๏ธ Data Platform on GCP โ Orchestration with Cloud Scheduler, storage in GCS, analytics in BigQuery
- ๐ BI Dashboard with Superset โ Interactive dashboards on top of data warehouse
- ๐ณ K8s Data Service Deployment โ Deploying scalable data services with Helm & Kubernetes
- ๐ Vector Search with Qdrant โ Semantic search and embedding-powered retrieval pipeline
- Data mesh & federated query engines (Trino/Presto, Dremio)
- Advanced Iceberg optimizations (partitioning, compaction, metadata scaling)
- Hybrid pipelines (batch + streaming with Flink + Spark)
- AI/LLM integration with vector databases (Qdrant)
โญ๏ธ From ducdn