Dofactory.com
Dofactory.com

Azure Cloud Data warehouse Engineer

Location
United States
Pay
$62 - $65 / Hour 
--
Contract
Level
Senior level
Skills

Job Description

Job Role: Datawarehouse Engineer - Azure Cloud

Location: New York, NY

Visa Type: US Citizen / Green Card

Duration: 12+ Months

Job Type: Contract

Job Description:

We are seeking an experienced Azure Data warehouse Engineer to join our team and play a pivotal role in in architecting and implementing a data management and reporting solution using Microsoft Azure platform. In this role, you will work closely with data scientists, data analysts, and business stakeholders to design, develop, and maintain data pipelines and analytical solutions using Azure Databricks.

Responsibilities:

1. Data Pipeline Development: Design, develop, and maintain data pipelines and ETL processes using Azure Databricks, Apache Spark, and other Azure services to ingest, transform, and prepare data for analytics and reporting.

2. Data Modeling: Collaborate with to design and implement scalable data models that support advanced analytics and machine learning workloads.

3. Data Integration: Integrate data from various sources, including on-premises systems and cloud-based sources, ensuring data quality, reliability, and consistency.

4. Performance Optimization: Optimize data pipelines and queries for performance, scalability, and cost-effectiveness, utilizing best practices for distributed computing and parallel processing.

5. Data Governance and Security: Implement data governance and security measures to ensure data privacy, compliance, and adherence to organizational policies and regulations.

6. Monitoring and Troubleshooting: Set up monitoring and alerting for data pipelines, and proactively troubleshoot and resolve issues to minimize manual interventions.

7. Documentation: Create and maintain documentation for data engineering processes, data flows, and system architecture.

8. Collaboration: Work closely with cross-functional teams, including data scientists, analysts, software developers, and business stakeholders, to understand analytics requirements and deliver solutions that meet business needs.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • Proven experience in architecting and implementing data engineering, ETL development, and big data processing using Azure Databricks and Apache Spark.
  • Strong proficiency in SQL, relevant programming languages.
  • Familiarity with Azure services such as Azure Data Factory, Azure SQL Data Warehouse, and Azure Storage.
  • Knowledge of data warehousing concepts, data lakes, and data modeling.
  • Experience with version control systems (e.g., Git) and DevOps practices.
  • Excellent problem-solving skills and the ability to work in a collaborative, fast-paced environment.
  • Capable to lead small team and can work independently.
  • Strong communication skills to convey technical concepts to non-technical stakeholders.
  • Experience in healthcare domain will be a huge added advantage.
  • Nice to have good knowledge and understating of .Net framework.

Job Type: Contract

Salary: $62.00 - $65.00 per hour

Experience level:

  • 10 years

Experience:

  • Azure Data warehouse Engineer: 10 years (Preferred)
  • Azure Data Factory, Azure SQL Data Warehouse: 3 years (Preferred)
  • Azure Databricks and Apache Spark: 4 years (Preferred)
  • DevOps practices: 3 years (Preferred)

Work Location: On the road

 
Ref #
2759747
Posted
30+ days ago
  •  
Last updated 30+ days ago


Stay Inspired!
Join other developers and designers who have already signed up for our mailing list.
Terms     Privacy     Cookies       Do Not Sell       Licensing      
Made with    in Austin, Texas.  - vsn 44.0.0
© Data & Object Factory, LLC.