Databricks Architect Job at Cyborgwave, Raleigh, NC

VGM5Q2o0ak10TWpuNU9XVzZrb2RwbWxUY3c9PQ==
  • Cyborgwave
  • Raleigh, NC

Job Description

Job Description

Job Description

Job ID: 749745

Title: Databricks Architect

Client: State of North Carolina – NCDOT

Location: Raleigh, NC (Hybrid)

Databricks Certifications in MUST

Job Description

**The candidate must come onsite on the first day to collect equipment.**

**All candidates must be local to the Triangle region of North Carolina, and posting may require up to 1-2 days per month in a Triangle area office for meetings.**

NCDIT-Transportation Database Team seeks a Databricks Administrator/Architect with proven skills for a 12-month engagement for creation/tuning support of the Databricks environment. This position will be responsible for developing and designing the Databricks environment at NCDIT-T. This individual will work with internal staff to plan/design/maintain the Databricks environment and recommend changes needed to accommodate/grow as our business needs dictate. This individual will facilitate changes through DIT-T’s change process and work very closely with the DBA Development Staff regarding all aspects of the design and planning of the Databricks environment.

Responsibilities:

  • Provide mentorship, guidance, overall knowledge share, and support to team members, promoting continuous learning and development.
  • Oversee the design, implementation, and maintenance of Databricks clusters.
  • Ensure the platform’s scalability, performance, and security.
  • Provide escalated support and troubleshooting to users.
  • Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog.
  • Review clusters health check and best practices implementation.
  • Review and maintain documentation for users and administrators.
  • Design and implement tailored data solutions to meet customer needs and use cases, spanning from ingesting data from APIs, building data pipelines, analytics, and beyond within a dynamically evolving technical stack.
  • Work on projects involving on-prem data ingestion into Azure using ADF.
  • Build data pipelines based on the medallion architecture that clean, transform, and aggregate data from disparate sources.

&

Skill

Required / Desired

Required Experience

Candidate Experience

Last Used

Extensive hands-on experience implementing Lakehouse architecture using Databricks Data Engineering platform, SQL Analytics, Delta Lake, Unity Catalog

Required

5

&

&

Strong understanding of Relational Dimensional modeling.

Required

5

&

&

Demonstrate proficiency in coding skills - Python, SQL, and PySpark to efficiently prioritize perf, security, scalability, robust data integrations.

Required

6

&

&

Experience implementing serverless real-time/near real-time arch. using Cloud (i.e., Azure, AWS, or GCP Tech Stack), and Spark tech (Streaming ML)

Required

2

&

&

Experience Azure Infra config (Networking, architect and build large data ingestion pipelines and conducting data migrations using ADF or similar tech

Required

4

&

&

Experience working w/ SQL Server features such as SSIS and CDC.

Required

7

&

&

Experience with Databricks platform, security features, Unity Catalog, and data access control mechanisms.

Required

2

&

&

Experience with GIT code versioning software.

Required

4

&

&

Databricks Certifications

Desired

&

&

&

Job Tags

Local area,

Similar Jobs

CM Resort, LLC

Snowmakers AM & PM Shifts 2025-26- New Hire (Ages 18+) Job at CM Resort, LLC

 ...running, and adjusting snow guns. As a customer focused organization, a crucial part of each employees job is to get and keep guests. Full or part-time seasonal employment; day and night shifts available. Candidates must be at least 18 years of age to apply.... 

tzumi electronics

Web Designer/Developer - Full time Freelance to Perm Job at tzumi electronics

Web Designer - Full time Freelance to Perm Join to apply for the Web Designer - Full time Freelance to Perm role at tzumi electronicsJob Description Freelance Website Designer. tzumi Electronics is looking for a talented and enthusiastic Web Designer/Developer. This person... 

Paul Robeson Charter School

Part-Time Compliance Health Officer - 2025/26 School Year Job at Paul Robeson Charter School

 ...Opportunity PRCS is seeking passionate and hardworkingPart-Time Compliance Health Officer to join the PRCS family for the 2025-26 School Year. The...  ...Certification/License ; Experience in a school or healthcare setting strongly preferred; Knowledge of state and... 

Cushing Terrell

Mechanical Engineer - HVAC (Boise) Job at Cushing Terrell

 ...Position Title: Mechanical Engineer - HVAC Description Position Description Were looking for a Mechanical Engineer with strong...  ...currently authorized to work in the United States on a full-time basis. Cushing Terrell will not sponsor applicants for work visas... 

Penzone Salons

Event Staff Job at Penzone Salons

 ...Job Description Job Description Role: Event Support Summary: This is an hourly position with varying hours based on the event schedule. Here's what to expect: Event Support will be part of the team that welcomes hosts and their attendees into BASE ONE. They...