Senior Databricks Data Engineer Job at Paul May Associates, Saint Louis, MO

VDhORGhvdklzY1h0NWVlUzdFNGFvV3hXZlE9PQ==
  • Paul May Associates
  • Saint Louis, MO

Job Description

Job Description

Job Description

Job Title: Senior Databricks Data Engineer

Location of role: Greater St. Louis - Able to be in office, Clayton, Hybrid role. Good work/life balance.

Salary total comp base and bonus in the 150K to 160K area - Depending on experience DOE

Qualifications:

Summary:

This person must have solid ETL Databricks experience with full end-to-end programming.

Need to be able to do data standardization, aggregation, data quality, medallion architecture with strong knowledge of Python and SQL.

Someone who works with Delta Lake, Pyspark, Cluster optimization, streaming, workflows / pipelines, (DABS would be nice but not required).

Must be able to do both developing and maintaining of pipelines

  • Bachelor's degree Computer Science, Information Technology or a related field
  • At least 5 years of professional experience in ETL, BI, data integrations engineering.
  • Hands-on experience with Databricks and AWS/Azure
  • Hands-on experience designing and implementing modern data platforms and pipelines
  • Experience with Python, PySpark, C#, or similar high-level language
  • Experience with Microsoft SQL databases and SSIS development preferred
  • Experience with development in public cloud, preferably in AWS
  • Ability to perform complex data analysis and troubleshooting

Preferred Qualifications:

  • Experience with IaaS Development: VS Code, Github, Terraform
  • Hands-on experience designing and implementing modern data platforms and pipelines

Responsibilities

  • This Senior Engineer will be developing and maintaining data pipelines for high impact areas. Emphasis on define, design, develop, unit test, and support ETL solutions to meet complicated critical business requirements.
  • Please have experience with sensitive production incident resolution, performing code reviews, and pipeline testing.
  • Troubleshooting and resolve data integration issues is essential, as is documentation and knowledge sharing as it relates modernizing data engineering practices.


Relocation - At this time, client will NOT relocate for this role

Company sponsorship - At this time, client will NOT sponsor for this role

Travel: This role may require 0% travel

Duration of role: Direct hire Role - Fulltime

If applying for this role - Please take each key point and provide number of years experience and what you would rate yourself, 1 thru 10 (10 being expert) for each key point. Send your resume and notes on the role to expediate our recruiting services.

Job Tags

Full time, Relocation,

Similar Jobs

Outlier AI

Math Teacher (Part time work from home) Job at Outlier AI

 ...Description Outlier helps the worlds most innovative companies improve their AI models by providing human feedback. Are you an experiencedMath Expertwho would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented... 

CBOHN

Capital Markets Paralegal Job at CBOHN

 ...Responsibilities Currently recruiting for an entry level full-time Capital Markets Paralegal to be based in our New York office. This position will support the New York Capital Markets Practitioners and the national Capital Markets Practice Group. This position will... 

Prime Time Healthcare

Travel Echo-Vascular Technician - $2,800 per week Job at Prime Time Healthcare

 ...Job Description Prime Time Healthcare is seeking a travel Echo-Vascular Technician for a travel job in Madison, Wisconsin. Job Description & Requirements ~ Specialty: Echo-Vascular Technician ~ Discipline: Allied Health Professional ~ Start Date: 01/06/2... 

St. David's Medical Center

Newborn Nursery Registered Nurse Job at St. David's Medical Center

 ...Introduction Do you want to be appreciated daily? Our nurses are celebrated for being on the front line, empathetic for patients...  ...from any other healthcare provider. We are seeking a(an) Newborn Nursery Registered Nurse to join our healthcare family. Benefits... 

Colorado Protective Services, LLC

Private Security Officer Job at Colorado Protective Services, LLC

 ...Description Job Description Responsibilities and duties May vary depending on locations and needs of the company and or our clients. Secure premises and personnel by patrolling property; monitoring surveillance equipment; inspecting buildings, equipment, and access...