Data Engineer (GCP)

Job Description    

Position: Data Engineer with GCP

Location: Alpharetta, GA (Onsite) 

Experience: 10+ years

Final round in-person interview at Alpharetta, GA

Mandatory: Python, SQL, Apache spark, Java coding, GCP, Apache beam, Dataflow.

Key Responsibilities:

• Design, build, and maintain scalable and reliable data pipelines to process large volumes of data.
• Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
• Work with BigQuery to manage and analyze large datasets, ensuring high performance and efficiency.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement data validation and quality checks to ensure data integrity and accuracy.
• Monitor and troubleshoot data pipelines and workflows to resolve any issues and ensure smooth operation.
• Stay updated with the latest trends and technologies in data engineering and apply best practices.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer.
• Strong proficiency in Python for data processing and automation.
• Advanced SQL skills, with experience in writing complex queries and optimizing performance.
• Hands-on experience with BigQuery for data storage, processing, and analysis.
• Familiarity with data warehousing concepts and data modeling.
• Experience with cloud platforms (e.g., Google Cloud Platform, AWS, Azure).
• Excellent problem-solving skills and attention to detail.
• Strong communication skills and the ability to work effectively in a team-oriented environment.

Preferred Skills:

• Experience with other data processing tools and frameworks such as Apache Beam, Apache Spark, or similar.
• Knowledge of data governance and data security best practices.
• Familiarity with CI/CD pipelines and version control systems (e.g., Git).
• GCP.