Databricks Developer- Remote- Full Time Role- 8+years
Role: Databricks Developer (8+years)
Location: Washington, DC (Remote)
Duration: Full Time
Job Description
Key Responsibilities
- Develop and maintain ETL/ELT data pipelines using PySpark and SQL within the Databricks platform.
- Design, create, and optimize Delta Lake tables to support scalable and high-performance data processing.
- Build and manage Databricks Workflows jobs to orchestrate and automate data pipelines.
- Write and execute unit tests to ensure code quality, reliability, and maintainability.
- Investigate and resolve data quality issues, ensuring the accuracy and integrity of data assets.
- Produce clear technical documentation for developed solutions, processes, and pipeline configurations.
- Participate in peer code reviews and incorporate feedback to maintain coding standards and best practices.
Required Qualifications
- 8+ years of experience in Data Engineering, including 3+ years of hands-on experience with Databricks.
- Strong proficiency in PySpark and SQL.
- Working knowledge of Delta Lake and at least one major cloud platform (Azure, AWS, or Google Cloud Platform).
- Familiarity with Git-based source control and CI/CD practices.
- Ability to independently deliver well-defined technical solutions from development through deployment.
Preferred Qualifications
- Databricks Data Engineer Associate Certification (preferred).
- Experience working within established data platform and engineering best practice frameworks.
- Strong troubleshooting and problem-solving capabilities.