Sr. Data Engineer

Job Description:
* We are seeking a highly experienced Data Engineer with a strong background in Snowflake, Python, and AWS/Terraform.
Required Skills & Experience:
developing data pipelines for streaming and batch data processing needs to move data in and out of the Snowflake data warehouse.
* Collaborate with engineering and DevOps team members to implement, test, deploy, and operate data pipelines and ETL solutions.
* Develop scripts to Extract, Load and Transform data and other utility functions.
* Optimize data pipelines, ETL processes, and data integrations for large-scale data analytics use cases. 
* 7+ years of experience building and maintaining data pipelines and ETL/ELT processes in data-intensive organizations.
* Strong coding skills using Python.
* Familiar with Python libraries related to data engineering and cloud services including pandas, boto, etc.
* At least 3 years of experience with AWS S3, SQS, Kinesis, Lambda, AWS DMS, Glue/EMR, AWS Batch or similar services.
* Hands-on experience building streaming and batch Big Data pipelines.
* Strong experience with Anaconda and Jupyter Notebook.
* Must have knowledge of building Infrastructure in AWS cloud using Cloud formation or Terraform.
* 3+ years of working experience with Snowflake cloud data warehouse including Snowflake data shares, Snowpipes, Snow SQL, Tasks etc.
Must have Anaconda & Jupyter Notebook Hands on exp!

* Must have working knowledge of various databases, SQL and NoSQL.
* Hands-on experience with cloud platforms such as AWS and Google Cloud.
* Must have working knowledge of various file formats like CSV, Json Avro, and Parquet.
* Experienced in CI/CD and release processes, proficient in Git or other source control management systems, to streamline development and deployment workflows.
* Minimum 5 years of designing and implementing operational production grade large-scale data pipelines, ETL/ELT and data integration solutions.
* Familiarity with MongoDB or similar NoSQL database systems.