Data Engineer

• Ensure data quality, integrity, and availability across systems.
• Integrate data from multiple sources (APIs, databases, streaming systems).
• Work with large datasets using distributed processing frameworks.
• Collaborate with data scientists, analysts, and stakeholders.
• Monitor and troubleshoot data workflows and pipeline failures.
• Implement data security and governance best practices.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 3+ years of experience in data engineering or related roles.
• Strong proficiency in Python, SQL, and/or Java.
• Experience with data processing frameworks like Apache Spark.
• Hands-on experience with ETL tools and data pipeline development.
• Experience with relational and NoSQL databases.
• Familiarity with version control systems like Git.
• Strong analytical and problem-solving skills.

Preferred Qualifications

• Experience with cloud platforms such as Amazon Web Services, Google Cloud Platform, or Microsoft Azure.
• Familiarity with big data tools like Apache Hadoop, Apache Kafka.
• Experience with workflow orchestration tools (e.g., Apache Airflow).
• Knowledge of data warehousing solutions (Snowflake, Redshift, BigQuery).
• Understanding of data governance and security best practices.
• Experience with containerization tools like Docker.

Key Skills

• Data pipeline design and optimization
• Data modeling and warehousing
• Distributed systems and big data processing