Database Developer - III (San Francisco) Job at Compunnel, Inc., San Francisco, CA

REt4cEVYaURiNWdYNDcxK2tReGM4WWZjZkE9PQ==
  • Compunnel, Inc.
  • San Francisco, CA

Job Description

We are looking for a skilled Data Mesh Data Modeler with expertise in Databricks to join our team. The ideal candidate will be responsible for designing and implementing scalable and efficient data models within a data mesh architecture, ensuring reliable and efficient data processing while collaborating with cross-functional teams. You will leverage Databricks for various data engineering tasks, from data processing to orchestration, to meet the needs of our data-driven organization.

Job Responsibilities:

  • Design and implement scalable, efficient data models within a data mesh architecture, following principles such as domain-driven design and federated data governance.
  • Work closely with data architects, engineers, and business stakeholders to translate business requirements into technical solutions.
  • Communicate data model designs effectively to technical and non-technical teams.
  • Leverage Databricks for data engineering tasks, including data processing, data validation, and data orchestration.
  • Optimize data pipelines to ensure high performance, scalability, and efficient data processing.
  • Implement data validation rules and quality checks to ensure data integrity and consistency
  • Design, implement, and manage the lifecycle of data products within the Data Mesh architecture.
  • Collaborate with other teams to build, manage, and monitor efficient data pipelines and data products.
Required Skills:
  • Experience in Data Mesh Architecture: Expertise in modeling data products and understanding the principles of data mesh, domain-driven design, and federated governance.
  • Databricks Expertise: Strong hands-on experience with Databricks, including using Spark for large-scale data processing, validation, and orchestration.
  • Programming Skills: Proficiency in SQL and Python for data processing, transformation, and validation.
  • Data Pipeline Optimization: Experience in designing and optimizing data pipelines to ensure scalability, high performance, and efficient data flow.
  • Data Integrity: Implementing robust data validation and quality checks to ensure data consistency and accuracy across systems.
  • Collaboration: Strong ability to work closely with cross-functional teams, including business users, data architects, and engineers.
  • Problem-Solving: Strong troubleshooting and problem-solving skills to ensure the efficiency and reliability of data systems.
Preferred Skills:
  • Experience in designing and managing the lifecycle of Data Products within a Data Mesh architecture.
  • Familiarity with data governance practices and tools for managing data quality and compliance.
  • Knowledge of cloud platforms like AWS, Azure, or GCP for deploying and managing data solutions.
Certifications:

Databricks Certification or other relevant data engineering certifications are a plus.

#J-18808-Ljbffr

Job Tags

Full time,

Similar Jobs

Concentric Healthcare Staffing

Behavioral Health Technician Job at Concentric Healthcare Staffing

 ...include, but are not limited to: Provide direct care to behavioral health patients Conduct patient safety checks Assist in maintaining...  ...to guidance and direction from Lead Behavioral Health Technicians or Site Supervisor Assists in admitting and discharging patients... 

The Budd Group

Join Our Cleaning Team! Full-Time & Part-Time Opportunities Available! Job at The Budd Group

 ...Daily Pay On-Demand Available!!! Mobile Friendly Application! Are you a reliable , detail-oriented , and hardworking...  ...join our team! We have immediate openings for both full-time first shift and full-time/part-time second shift positions. Experience is preferred,... 

ClaimsHero Holdings LLC

Document Review Attorney (Chicago) Job at ClaimsHero Holdings LLC

 ...looking for a detail-oriented, reliable, and Arizona-based Document Review Attorney to join our growing team. This person will work directly under...  ...high-quality work Experience working in a predominantly remote environment as a document reviewer Located in Arizona... 

East West Bank

Senior Relationship Banker (San Francisco) Job at East West Bank

 ...IntroductionSince 1973, East West Bank has served as a pathway to success. With over 110 locations across the U.S. and Asia, we are...  ...California, East West Bank (Nasdaq: EWBC) is a top-performing commercial bank with a strong foundation, an enterprising spirit and a commitment... 

The Cowlitz Indian Tribe

Victim Advocate Job at The Cowlitz Indian Tribe

 ...Job Description Job Description POSITION TITLE: Victim Advocate DEPARTMENT: Pathways to Healing Program LOCATION: DuPont/Tukwila, WA REPORTS TO: Program Manager FLSA STATUS: Non-Exempt WAGE RANGE: $29.05 - $33.40 CLOSING DATE: Open Until Filled...