Azure Data Engineer Job at 3B Staffing LLC, Chicago, IL

  • 3B Staffing LLC
  • Chicago, IL

Job Description

This will require an onsite interview or require the candidate to pick up their laptop in person


Requirements/Top Skills Needed:
ADF
Databricks
Python
SQL
Retail experience would be helpful, but not required


Job Title: Azure Data Engineer
Job Summary: We are seeking a highly skilled Azure Data Engineer to design, build, and optimize our next-generation cloud data platform. You will build scalable data pipelines, manage enterprise data warehouses, and transform massive datasets using Azure Cloud, ADF, Databricks, Spark, and PySpark.

Key Responsibilities
• Pipeline Orchestration: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF).
• Big Data Processing: Build high-performance, distributed data transformation workloads via Azure Databricks and Apache Spark/PySpark.
• Data Warehousing: Architect, model, and maintain cloud-native Data Warehouses and Data Lakes (ADLS Gen2).
• Architecture Implementation: Apply modern architectural patterns like the Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake formats.
• Performance Tuning: Optimize Spark jobs, cluster configurations, and SQL queries to minimize latency and cloud compute costs.
• Governance & Security: Implement security frameworks, data lineage, and user access policies using Unity Catalog.
• CI/CD Automation: Deploy, monitor, and automate workflows using Azure DevOps and automated alert configurations.

Required Technical Skills:
• Cloud Platform: Microsoft Azure Ecosystem (ADLS Gen2, Azure SQL, Synapse Analytics, Key Vault, Storages, Azure Functions, Logic Apps).
• Data Orchestration: Advanced proficiency in Azure Data Factory (ADF).
• Compute & Analytics: Deep hands-on experience with Azure Databricks.
• Big Data Frameworks: Strong mastery of Apache Spark and PySpark (including Spark SQL).
• Languages: Expert level in Python and SQL.
• Data Warehousing: Solid understanding of Data Modeling (Star/Snowflake schema) and warehousing concepts

Job Tags

Similar Jobs

Johns Hopkins HealthCare

PATIENT ESCORT (Day Shift) Job at Johns Hopkins HealthCare

 ...Position Summary : Responsible for the safe, timely, courteous, and competent transportation of patients and specimens throughout the Johns Hopkins Bayview Medical Center, primarily via wheelchair or stretcher. Receives assignments for specific trips and associated... 

Jzms Group

GRAPHIC DESIGN INTERN Job at Jzms Group

 ...WORLDWIDE company, is seeking a creative and motivated Graphic Design Intern to join our Sales & Marketing team for the 2027 summer. This...  ...print projectsOrganize and maintain digital assetsAssist with web projects as neededAssist with updating marketing collateral and... 

Unicorn Trades Inc.

Entry-Level Drainage Installer - Start a Skilled Trade Job at Unicorn Trades Inc.

Unicorn Trades Inc. in Snohomish, WA is hiring an Entry-Level Drainage Installer to join our growing, family-owned team. Youll help protect properties from water damage by installing, maintaining, and repairing drainage systems across the Greater Seattle area. No experience... 

URBN

Nuuly Graphic Design Intern Job at URBN

Nuuly is looking for a Graphic Design Intern to join us for the summer. This intern will embed with our creative team, supporting design work across seasonal campaigns, web/app, email marketing, and organic and paid social. They'll get hands-on experience taking concepts... 

Service Express

Azure Data Engineer Job at Service Express

 ...Express in Cleveland at the Highland Heights office is seeking a Data Engineer to build data pipelines and enable access for data scientists...  ...will work in a hybrid role that focuses on moving data into Azure Synapse using Spark, Python, SQL, and C# within established data...