Data Engineer

Position: Data Engineer

Location: NYC- NY- Onsite

Type: Contract

Exp: 12+ years

Primary Skill : Python, unit test, PySpark, Java

Skill Cluster :  Data-AWS Glue with EMR, Spark, Redshift,Kinesis,S3,AWS Native Data Services.

Job Description:

10 years of relevant work experience showing growth as a Data Engineer.
Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS Lake Formation.
Experience of performance optimization in Batch and Real time processing applications
Expertise in Data Governance and Data Security Implementation.
Good hands-on design and programming skills building reusable tools and products
Experience developing in AWS or similar cloud platforms.
Preferred: ECS, EKS, S3, EMR, DynamoDB, Aurora, Redshift, QuickSight or similar.
Familiarity with systems with very high volume of transactions, micro service design, or data processing pipelines (Spark).
Knowledge and hands-on experience with server-less technologies such as Lambda, MSK, MWAA, Kinesis Analytics a plus.
Expertise in practices like Agile, Peer reviews, Continuous Integration.