Big Data Engineer

Required Skills & Experience:
8+ years of experience in Big Data Engineering 

Strong hands-on experience with: 
Apache Spark 
Spark SQL 
Spark Core 
DataFrames 
PySpark or Scala 

Advanced SQL programming and query optimization experience 
Strong experience building and maintaining ETL/ELT pipelines 
Experience working with large-scale structured and unstructured datasets 
Hands-on experience with BigQuery and GCP ecosystem 
Experience with enterprise Data Lakes and Data Warehousing concepts 
Strong troubleshooting and performance tuning expertise for Spark and SQL workloads 

Experience optimizing: 
Partitioning 
Joins 
Caching 
Query execution plans 
Experience integrating data from multiple enterprise systems 
Strong understanding of distributed computing concepts 
Ability to collaborate with cross-functional teams in agile environments