AWS With Databricks Administration
Job Description
• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proven experience in cloud computing, specifically AWS, with a focus on GovCloud.
• Strong understanding of Databricks and its integration with AWS services Key Responsibilities:
1. Platform Management:
o Administer and maintain the Databricks environment within AWS GovCloud.
o Monitor Databricks workflows, clusters, and jobs to ensure optimal performance and uptime.
2. Security and Compliance:
o Ensure compliance with government and organizational security standards.
o Manage access controls and permissions for Databricks users in alignment with security policies.
3. Performance Optimization:
o Analyze system performance and implement improvements for performance tuning and resource optimization.
o Collaborate with data engineering and analytics teams to optimize data pipelines and workflows.
4. Integration and Automation:
o Implement automation solutions for reporting, monitoring, and resource provisioning within Databricks.
o Work with APIs and SDKs for seamless integration with other AWS services and third-party tools.
5. User Support and Training:
o Provide technical support to users and troubleshoot issues related to Databricks.
o Conduct training sessions and workshops for users to help them leverage the capabilities of Databricks effectively.
6. Collaboration:
o Collaborate with DevOps, security, and data engineering teams to support deployment strategies and best practices.
o Participate in cross-functional projects, ensuring data governance and integrity.
7. Documentation and Reporting:
o Maintain comprehensive documentation related to Databricks configurations, procedures, and best practices.
o Generate and analyze reports on system usage, performance metrics, and compliance adherence.
Skills
AWS Solution Architect
AWS Security FerRamp
GoV Cloud FedRamp
Data bricks
Similar Jobs
Azure Databricks Architect
New Jersey
AWS Data Engineer
Texas
Azure Databricks Engineer
Remote
AWS Data Engineer
Indiana
AWS Data Engineer
California