Azure Databrick Developer

Data Pipeline Development
o Develop and fine tune data processing pipelines within Databricks.
o Implement performance optimization techniques.

Integration with Analytics Teams
o Work closely with data science and analytics teams to integrate data solutions.
o Support data architecture initiatives that incorporate Databricks technologies.

System Support and Troubleshooting
o Provide support for Databricks based tools.
o Resolve operational and performance issues, ensuring system reliability.

Documentation and Knowledge Sharing
o Document technical processes and system behaviors.
o Lead knowledge transfer sessions to train team members on data processing techniques and tools.

Governance and Security Implementation
o Establish and enforce data governance and security protocols within Databricks.
o Ensure compliance with regulatory requirements related to data management.

Key Responsibilities
Develop and maintain data processing pipelines using Databricks.
Work with big data technologies to optimize data analysis and pipeline performance.
Collaborate with data science and engineering teams to integrate Databricks solutions into existing systems.
Support data engineers, data scientists, and analysts with advanced querying tools and data visualization services.
Implement and troubleshoot data governance and security best practices.

Deliverables
Data processing pipelines in Databricks.
Performance optimization reports.
Documentation on data governance and security best practices.
Data visualization dashboards.