Azure Databricks Architect Job at Diverse Lynx, Atlanta, GA

VHM5SGlZL0tzTVBsNGVXVzdVNGRxVzFRY2c9PQ==
  • Diverse Lynx
  • Atlanta, GA

Job Description

Azure Databricks Architect @@@ Atlanta, GA Job Title: Data Architect (Azure Databricks) Location: Atlanta, GA Employment Type: Full-time Overview: We are seeking an experienced Data Architect with deep expertise in Azure Databricks to design and implement scalable, high-performance data solutions. The ideal candidate will have strong technical skills in Azure services, Apache Spark, and data processing frameworks, along with a proven ability to architect data pipelines, optimize performance, and ensure data governance. Experience: Proven experience as a Data Architect or similar role, with extensive experience designing and implementing solutions on Azure Databricks . Technical Skills: Azure Databricks & Apache Spark : Proficiency with Azure Databricks and Apache Spark for big data processing. Azure Services : Strong experience with Azure services, including Azure Data Lake , Azure Synapse Analytics , and Azure SQL . Data Architecture : Familiarity with data modeling , ETL processes , and data warehousing concepts. Programming Languages : Proficiency in programming languages such as Python , Scala , and SQL . Core Skills: Problem-Solving : Excellent problem-solving and analytical skills, with a strong focus on optimizing data solutions. Communication : Strong verbal and written communication skills, with the ability to collaborate effectively with cross-functional teams. Project Management : Ability to manage multiple projects and prioritize tasks effectively in a fast-paced environment. Preferred Certifications: Azure Data Engineer or Azure Solutions Architect certifications are preferred but not mandatory. Key Responsibilities: Architecture Design : Design and architect scalable , high-performance data solutions on Azure Databricks, including: Data pipelines for ETL/ELT processes. Data lakes for structured and unstructured data storage. Real-time data processing systems. Implementation : Lead the implementation of Azure Databricks solutions, ensuring best practices for performance, security, and data governance are followed. Integration : Integrate Azure Databricks with other Azure services such as: Azure Data Lake Storage Azure Synapse Analytics Azure SQL Database lso, integrate with third-party tools and external data sources as required. Optimization : Monitor and optimize data workflows and queries for performance, reliability, and cost efficiency on Azure. Collaboration : Work closely with data engineers , data scientists , and business stakeholders to understand project requirements and deliver effective data solutions. Governance : Ensure data governance and security policies are properly implemented and adhered to within the Databricks environment. Documentation : Create and maintain comprehensive documentation for architectural designs, processes, best practices, and system configurations. Mentorship : Provide guidance and mentorship to junior team members, helping them navigate technical challenges and promoting best practices. Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company. Diverse Lynx

Job Tags

Full time,

Similar Jobs

Apple

New Product Operations Program Manager - Vision Pro Job at Apple

 ...New Product Operations Program Manager - Vision Pro Imagine what you could do here. At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what... 

The Halal Guys

Jr Real Estate Analyst Job at The Halal Guys

 ...Job Description Job Description Position Overview: The Junior Real Estate Analyst will support real estate decision-making and franchise development by conducting site analyses, managing documentation, and coordinating with franchisees on site selection processes... 

Rincon Consultants

Cyber Security Analyst Job at Rincon Consultants

 ...Rincon Consultants, Inc. is seeking a Cyber Security Analyst to join our Information Technology team! This position will focus on auditing...  ...work arrangements that can include a mix of in-office and remote work, our changing business needs will ultimately determine our... 

3L Logistics Inc.

Delivery Driver Job at 3L Logistics Inc.

3L Logistics Inc. is seeking individuals for our FedEx delivery routes in Waterloo, IA. This is a physical, fast - paced job. You will...  ...expanding to the Waterloo area! This position can be full or Part Time. Responsibilities Drive vehicle to deliver goods to customers... 

BJC HealthCare

Clinical Nurse Operating Room Job at BJC HealthCare

 ...Job Description Additional Information About the Role ~ OR experience preferred ~8 HR Shifts ~ Nights. 10P-630A ~ M-F ~ No...  ...The BJC RN Career Ladder differentiates BJC as the place for nurses to work in the greater St. Louis area. This is a tool to empower...