Senior Data Engineer- Azure/Databricks Job at Technology Recruiting Solutions, Houston, TX

  • Technology Recruiting Solutions
  • Houston, TX

Job Description

Senior Data Engineer – Azure / DatabricksLocation: Houston, TX – HybridPosition Type: Full-TimeA well-established Houston-based company is seeking an experienced Senior Data Engineer to join its Data & BI team and help implement and support a modern Azure cloud-based data platform.This is a hands-on, delivery-focused role for a senior data engineer with strong experience in Databricks, Python, Azure data technologies, and enterprise data integration. The Senior Data Engineer will build and maintain scalable Lakehouse solutions, develop ELT/ETL pipelines, integrate data from multiple enterprise systems, and help ensure the performance, security, and reliability of the company's data platform.Candidates must reside in the Houston area and be available to work onsite at the company's Houston office as needed.Key ResponsibilitiesBuild, implement, and maintain scalable cloud-based data solutions using Azure and Databricks.Develop and support Lakehouse and medallion architecture solutions.Design and maintain ELT/ETL workflows using Databricks, Azure Data Factory, Lakeflow, and Azure Data Lake Storage.Integrate data from enterprise applications and databases, including ERP systems, Oracle, SQL Server, and other business platforms.Develop solutions using Python, PySpark/Spark SQL, Delta Lake, and SQL.Configure and maintain Databricks Unity Catalog, including access policies, metadata, and lineage.Implement data security and access controls, including RBAC/ABAC and row- and column-level security.Monitor data pipelines, troubleshoot failures, resolve data-quality and performance issues, and support production environments.Participate in DevOps and CI/CD processes using Git, Azure DevOps and/or GitHub Actions.Develop and maintain technical documentation, including data flows, pipeline designs, runbooks, and configuration documentation.Collaborate with technical and business teams in an Agile environment.Required Qualifications5+ years of hands-on Databricks data engineering experience.Strong Python development skills.Strong experience with Databricks, including Delta Lake, PySpark/Spark SQL, notebooks, jobs, and cluster management.Hands-on experience with the Microsoft Azure data ecosystem, including Azure Data Lake Storage Gen2 and Azure Data Factory.Strong experience developing ETL/ELT pipelines and implementing Lakehouse/medallion architectures.Experience with dimensional modeling and incremental data loads.Strong database experience with Oracle and SQL Server, including PL/SQL and/or T-SQL.Experience integrating data from enterprise applications and multiple source systems.Hands-on experience implementing data security and access controls.Experience with Git and modern CI/CD/DevOps practices.Working knowledge of Power BI.Strong troubleshooting, documentation, and communication skills.Preferred ExperienceExperience extracting and integrating data from JD Edwards (JDE).Experience with Databricks Unity Catalog and Lakeflow.FiveTran and/or dbt experience.Streaming technologies such as Event Hubs, Kafka, or Structured Streaming.Microsoft Fabric, Azure Synapse, Azure Functions, Azure Logic Apps, Azure ML, or Oracle Cloud.Machine learning and AI development or deployment experience.Work ArrangementThis is a Houston-based hybrid position. Candidates must currently reside in the Houston metropolitan area and be available to work onsite at the Houston office when business needs require.Candidates must be authorized to work in the United States on a permanent basis without current or future sponsorship. Third-party and C2C submissions will not be considered.BenefitsThe company offers a comprehensive benefits package that includes medical, dental and vision coverage, 401(k), pension, life insurance, paid time off, paid holidays, and wellness programs.

Job Tags

Permanent employment, Work at office

Similar Jobs

Braze

Senior Security Engineer, Enterprise Security Job at Braze

 ...passionate team at your back. If Braze sounds like a place where you can thrive, we cant wait to meet you.WHAT YOU'LL DOAs a Senior Security Engineer on the Enterprise Security team, you'll protect Braze employees, their assets, and work locations using various tools and... 

Mechanics Bank

Sr. Lending Advisor Job at Mechanics Bank

 ...Mechanics Bank is currently searching for a Sr. Lending Advisor to join our team. Here at Mechanics Bank, we value connection, partnership...  ...program is designed for you to live your best life at work, home, and everywhere in between. Employees working 25 hours or more per... 

CAIR San Diego

Civil Rights Attorney Job at CAIR San Diego

 ...Job Description Job Description Title: Civil Rights Attorney Work Location: San Diego, CA Term: Full-time, occasional evening...  ...a dedicated attorney to advance and defend the civil and human rights of the American Muslim community at a time when those rights... 

Honda Dev. and Mfg. of Am.,LLC

New Model Senior Project Engineer - Paint Job at Honda Dev. and Mfg. of Am.,LLC

 ...team. If your goals and values align with Hondas, we want you to join our team to Bring the Future! Job Purpose Serve as new model project leader for North American Paint plant departments. Manage standard new model flow and activities to achieve project targets... 

Team Thiel

Social Media Brand Ambassador & Field Coordinator Job at Team Thiel

 ...Job Description Job Description We are looking for a Social Media Brand Ambassador & Field Coordinator who is energetic, organized, professional, and genuinely enjoys being out in the community. This is a hands-on role for someone who can move seamlessly between...