Data Engineer

Job Title: Data Engineer (Data, ETL and Pyspark)

Client: Mphasis

Exp: 8y to 10y

Visa: H1B / H4 EAD / GC EAD (Passport Number Mandatory)

Location: North Carolina, US

Job Summary:

We are seeking a skilled Data Engineer to join our team at Mph-ClientSite in North Carolina. The ideal candidate will possess a strong background in both relational and non-relational SQL, along with expertise in ETL processes, database performance tuning, and proficiency in PySpark and PL/SQL. This role is critical in ensuring the efficient management and transformation of data to support our business objectives.

Responsibilities:

Design, develop, and maintain robust data pipelines and ETL processes to facilitate data integration and transformation.
Optimize database performance through effective tuning and monitoring of relational and non-relational databases.
Utilize Autosys for job scheduling and automation of data workflows.
Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
Implement data quality checks and validation processes to ensure data integrity and accuracy.
Develop and maintain documentation for data processes, architecture, and workflows.
Stay updated with industry trends and best practices in data engineering and analytics.
Mandatory Skills:

Proficiency in relational SQL and experience with non-relational SQL databases.
Strong knowledge of ETL tools and processes.
Experience in database performance tuning and optimization techniques.
Hands-on experience with PySpark for big data processing.
Proficient in PL/SQL for database programming and management.
Familiarity with Autosys for job scheduling and automation.